feat(world_cepii_baci): BACI international trade (HS92/HS17) + per-revision HS directories

[rdahis]

What (draft — first pass)

Onboards CEPII BACI bilateral international trade (harmonized UN COMTRADE) as world_cepii_baci, with English table/column names. Ships the BACI-HS half now; SITC + complexity are pending (see below).

Tables (dev-validated, dbt test PASS=24/24)

Table	Rows	Coverage
world_cepii_baci.trade_hs92	269,894,500	1995–2024, HS 1992 rev.
world_cepii_baci.trade_hs17	89,207,221	2017–2024, HS 2017 rev.
br_bd_diretorios_comercio_internacional.hs1992	5,022	HS 1992 code set
br_bd_diretorios_comercio_internacional.hs2017	5,384	HS 2017 code set

Grain: year × exporter × importer × product. Columns: year, id_country_exporter, id_country_importer, product_code, value (thousand USD), quantity (metric tons).

FK design

• product_code → hsXXXX.id_sh6 is exact — each trade table references its own revision's per-revision directory table, so no code-vintage mismatch. This is the reason for the per-revision hs* directories.
• Country FK is tolerant (custom_relationships) — BACI uses aggregate/former-country codes absent from the standard M49 directory (842=USA+PR+VI, 251=France+Monaco, 58=Belgium-Luxembourg, 891=Serbia-Montenegro, …). Kept faithful to source and documented via ignore_values, as br_me_comex_stat does.

Pending in this PR (blocked)

trade_sitc, complexity_country, complexity_product — need the Harvard Atlas SITC data (Dataverse is currently rate-limiting downloads; will add once it clears).

Notes

• Cleaning: models/*/code/clean_*.py stream annual CSVs → year-partitioned parquet. Upload: models/world_cepii_baci/code/upload.py (dev staging).
• Also removes MIGRATION_PLAN.md accidentally merged in feat(br_bd_diretorios_comercio_internacional): migrate sistema_harmonizado from diretorios_mundo #1790.
• Metadata registration (backend) not yet done — follows after tables are complete.

🤖 Generated with Claude Code

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 67e4ddf9-e276-440f-b26f-cb794ac6c311

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[mergify]

@rdahis esse pull request tem conflitos 😩