Ingest Ethereal 10K worker profiles — domain data in the substrate

Browse Source

10,000 staffing worker profiles from profit/ethereal repo. Flattened
JSON → CSV → Parquet. Indexed on HNSW (9.5s) + Lance IVF_PQ (7.2s).

SQL hybrid verified: forklift operators in IL with reliability > 0.8
returned exact matches. Vector search alone missed the state filter —
confirms the hybrid SQL+vector routing need from quality eval.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

...

This commit is contained in:

root

2026-04-16 22:26:19 -05:00

co-authored by Claude Opus 4.6

parent f9f92706f3

commit a710896db2

4 changed files with 961 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

data/datasets/ethereal_workers.parquet

BIN

Binary file not shown.