Skip to content

arxiviq-factory: OpenAlex affiliation pass (pack grows to 14,979 rows) - #64

Merged
jcdavis131 merged 3 commits into
mainfrom
claude/arxiviq-openalex
Sep 24, 2026
Merged

jcdavis131 merged 3 commits into
mainfrom
claude/arxiviq-openalex

Conversation

@jcdavis131

@jcdavis131 jcdavis131 commented Sep 24, 2026

Copy link
Copy Markdown
Owner

This is the OpenAlex pass scheduled after #55, run once the keyless budget reset.

  • enrich --openalex: asked about 1,242 papers, found 1,089 in OpenAlex, and filled in affiliations for 155 authors that arXiv HTML, Semantic Scholar and the arXiv API had left blank.
  • Re-curated pack: 14,782 → 14,979 rows, split 11,974 train / 3,005 holdout (was 11,813 / 2,969). Nimble pairs went from 2,647 to 2,700.
Family Before After
first_country 64 116 (US 51, other 20, CN 14, GB 12, FR 8, DE 6, CA 5)
industry 32 (12.5% positive) 71 (22.5% positive)
institution_of 354 460

Label source renamed. These families were labelled arxiv-html-affiliation+ror, which was already inaccurate before this pass: affiliations also came from Semantic Scholar and the arXiv API. They are now labelled author-affiliation+ror. Each author's affiliation_source is still recorded in sources/enrich.jsonl.gz:

Source Authors
semantic-scholar 211
arxiv-html 164
openalex 155
arxiv-api 48

Checks.

  • curate produces byte-identical output across two runs.
  • The factory's unittests pass.
  • Ruff reports 2 findings in skillify.py. That file isn't touched here, and main has the same findings.

This PR also carries the HANDOFF restamp from #61, which fixes main's red CI.

🤖 Generated with Claude Code

https://claude.ai/code/session_01WH1hPpf3u1xWecEhS6AHD2

…affiliation source

enrich --openalex asked 1,242 works, matched 1,089 and filled 155 authors the
arXiv HTML / Semantic Scholar / arXiv API sources had left without an
affiliation. Re-curated: 14,979 rows (11,974 train, 3,005 holdout);
first_country 64 -> 116, industry 32 -> 71, institution_of 354 -> 460 rows.

The affiliation families were labelled arxiv-html-affiliation+ror although
their affiliations already came from several sources; they are now
author-affiliation+ror, and the per-author affiliation_source stays in
sources/enrich.jsonl.gz.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01WH1hPpf3u1xWecEhS6AHD2
The block named 07a2146, a claude/decision-plane commit that the squash merge
left off main, so check_handoff_fresh.py --check failed lint-and-test on main.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01WH1hPpf3u1xWecEhS6AHD2
(cherry picked from commit d9aaa9b)
@vercel

vercel Bot commented Sep 24, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
arxiviq Ready Ready Preview Sep 24, 2026 12:46am UTC
dottie-os-console Ready Ready Preview Sep 24, 2026 12:46am UTC

Request Review

@jcdavis131
jcdavis131 marked this pull request as ready for review September 24, 2026 00:53
@jcdavis131
jcdavis131 merged commit e21bd4f into main Sep 24, 2026
11 checks passed

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved. Cursor Bugbot was not present after the first poll, remaining checks finished without findings that need human review, and no approval policy required extra review. No reviewers were assigned.

Open in Web View Automation 

Sent by Cursor Approval Agent: Pull Request Router and Approver

This branch was successfully deployed

2 active deployments
Preview – dottie-os-console 83842182 Deployed Sep 24, 2026 by vercel[bot]
Preview – arxiviq 83842182 Deployed Sep 24, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants