Skip to content

Temporary: generate official international health baseline - #98

Draft
Occumed79 wants to merge 124 commits into
mainfrom
data/international-source-bootstrap
Draft

Temporary: generate official international health baseline#98
Occumed79 wants to merge 124 commits into
mainfrom
data/international-source-bootstrap

Conversation

@Occumed79

Copy link
Copy Markdown
Owner

Temporary data-generation branch. Runs official World Bank and WHO API downloads, normalizes the latest country-level observations, and commits reviewable SQL chunks. Do not merge this PR; it exists only to trigger and inspect the data-generation workflow.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jul 14, 2026

Copy link
Copy Markdown

Deploying network-map with  Cloudflare Pages  Cloudflare Pages

Latest commit: 64a5382
Status: ✅  Deploy successful!
Preview URL: https://adda2146.network-map-dew.pages.dev
Branch Preview URL: https://data-international-source-bo.network-map-dew.pages.dev

View logs

@coderabbitai

coderabbitai Bot commented Jul 14, 2026

Copy link
Copy Markdown

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 2858822f-407f-48b0-a8c5-3adfdd7f026a

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch data/international-source-bootstrap

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@greptile-apps

greptile-apps Bot commented Jul 14, 2026

Copy link
Copy Markdown

Greptile Summary

This PR adds temporary data-generation workflows and scripts for official international health baselines. The main changes are:

  • WHO, World Bank, and Source 5 download and discovery workflows.
  • Bootstrap scripts that normalize health indicators, UHC data, workforce data, HIDR data, and facility records.
  • Generated SQL chunks, manifests, logs, and import status files for review.
  • One-off repair/import workflow support for Source 5 country batches.

Confidence Score: 2/5

This PR should not be merged in its current temporary data-generation state.

Several generated artifacts and workflow paths still show failed or incomplete import states. Previously identified blocking data-generation and import issues remain visible in the current changeset. No new non-duplicate inline findings were added.

data/generated/international/download.exit-code, data/status/who-workforce-import-status.txt, data/status/who-hidr-healthcare-import-summary.json, .github/workflows/download-international-health-data.yml, .github/workflows/download-who-hidr-healthcare.yml, scripts/compact-source5-sql.mjs, scripts/import-who-hidr-healthcare.py

T-Rex T-Rex Logs

What T-Rex did

  • Executed the global health facilities validation harness using validate_global_health_facilities.mjs to perform the contract validation.
  • Reviewed the after-run artifact to confirm a clean completion and expected data shape, including 776/776 full rows and 776/776 compact rows.
  • Checked the database import blocker log and confirmed the import could not proceed due to psql_unavailable.
  • Referenced the preserved before calibration artifact to establish the before/after comparison baseline.

View all artifacts

T-Rex Ran code and verified through T-Rex

Important Files Changed

Filename Overview
.github/workflows/download-global-health-facilities.yml Adds Source 5 facility generation and compact chunk publication; shared output paths still affect country batch artifacts.
.github/workflows/download-international-health-data.yml Adds WHO workforce download/import and HHFA/SARA discovery jobs; World Bank generation is not part of this workflow path.
.github/workflows/download-who-uhc.yml Adds artifact-only WHO UHC and HHFA/SARA discovery/extraction jobs.
.github/workflows/repair-source5-al-ad-ao.yml Adds a one-off Neon repair workflow that imports archived AL/AD/AO datasets and publishes corrected status files.
scripts/bootstrap-global-health-facilities.mjs Adds Source 5 facility normalization and SQL generation using Healthsites or Overpass with idempotent canonical-table upserts.
scripts/bootstrap-world-bank-health-data.mjs Adds World Bank country-level indicator bootstrap with aggregate-region filtering and SQL/manifest output.
scripts/bootstrap-who-uhc-data.mjs Adds WHO UHC service coverage normalization into international health indicator SQL chunks.
scripts/import-who-hidr-healthcare.py Adds WHO HIDR workbook import logic for international health inequality observations.
scripts/compact-source5-sql.mjs Adds compact Source 5 staging chunks for Neon transfer.
data/generated/global-health-facilities/manifest.json Commits generated Source 5 manifest currently representing the AO country batch.
data/generated/international/download.exit-code Commits a failed international download marker.
data/status/who-workforce-import-status.txt Commits an unsuccessful WHO workforce import status.
data/status/who-hidr-healthcare-import-summary.json Records a failed HIDR import due to missing database URL.

Sequence Diagram

%%{init: {'theme': 'neutral'}}%%
sequenceDiagram
  participant GH as GitHub Actions
  participant WB as World Bank API
  participant WHO as WHO APIs/Archives
  participant OSM as Healthsites/Overpass
  participant Artifacts as data/generated SQL + manifests
  participant Neon as Verified Neon DB
  GH->>WB: bootstrap-world-bank-health-data.mjs
  WB-->>Artifacts: international indicator SQL/manifest
  GH->>WHO: workforce/UHC/HIDR/HHFA discovery scripts
  WHO-->>Artifacts: normalized SQL, logs, summaries
  GH->>OSM: bootstrap-global-health-facilities.mjs
  OSM-->>Artifacts: Source 5 facility SQL + compact chunks
  GH->>Neon: import/repair workflows apply generated SQL
  Neon-->>GH: counts and validation status
  GH->>Artifacts: publish data/status files
Loading
%%{init: {'theme': 'base', 'themeVariables': {"darkMode": true, "background": "#0d1117", "primaryColor": "#21262d", "primaryTextColor": "#e6edf3", "primaryBorderColor": "#8b949e", "lineColor": "#8b949e", "textColor": "#e6edf3", "edgeLabelBackground": "#161b22", "actorBkg": "#21262d", "actorBorder": "#8b949e", "actorTextColor": "#e6edf3", "actorLineColor": "#8b949e", "signalColor": "#8b949e", "signalTextColor": "#e6edf3", "noteBkgColor": "#373320", "noteBorderColor": "#d4a72c", "noteTextColor": "#f0e6c0", "labelBoxBkgColor": "#21262d", "labelBoxBorderColor": "#8b949e", "labelTextColor": "#e6edf3", "loopTextColor": "#e6edf3", "activationBkgColor": "#30363d", "activationBorderColor": "#8b949e"}}}%%
sequenceDiagram
  participant GH as GitHub Actions
  participant WB as World Bank API
  participant WHO as WHO APIs/Archives
  participant OSM as Healthsites/Overpass
  participant Artifacts as data/generated SQL + manifests
  participant Neon as Verified Neon DB
  GH->>WB: bootstrap-world-bank-health-data.mjs
  WB-->>Artifacts: international indicator SQL/manifest
  GH->>WHO: workforce/UHC/HIDR/HHFA discovery scripts
  WHO-->>Artifacts: normalized SQL, logs, summaries
  GH->>OSM: bootstrap-global-health-facilities.mjs
  OSM-->>Artifacts: Source 5 facility SQL + compact chunks
  GH->>Neon: import/repair workflows apply generated SQL
  Neon-->>GH: counts and validation status
  GH->>Artifacts: publish data/status files
Loading

Reviews (15): Last reviewed commit: "ops: repair Source 5 Albania Andorra Ang..." | Re-trigger Greptile

Comment thread data/generated/international/download.exit-code
github-actions Bot and others added 28 commits July 16, 2026 18:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant