2 Commits

Include renames

Author	SHA1	Message	Date
rootandClaude Opus 4.6	8ca4ba5717	Observer KB: 477 pages from 8 ChatGPT PDFs indexed and searchable ... - Fixed Unicode crash in chunker (ligatures like fi causing byte boundary panic) - Chunker now works with char indices, not byte indices - 8 PDFs ingested: hybrid_ai_data_lake (133p), spark_vs_flink_iceberg (124p), code_sorting (70p), hybrid_indexing (69p), rust_in_tech_stack (49p), etc. - 477 chunks embedded via supervisor (43/sec) - HNSW index built in 0.44s - Search results <200ms, finding correct conversations by meaning - Tested: "S3 architecture", "CRM WordPress", "Rust vs Python" — all correct Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-27 22:53:27 -05:00
rootandClaude Opus 4.6	d61096e26f	100K embedding COMPLETE: 177/sec, 9.5 min, zero failures ... - Supervisor 4-pipeline: 100,000 chunks embedded successfully - Peak throughput: 177 chunks/sec (4.1x vs single-pipeline 43/sec) - Total time: 572s (9.5 minutes) - Storage: 315 MB Parquet - Brute-force search over 100K vectors: 4.5s - Index metadata registered: nomic-embed-text, 768d, build stats - Zero failures — supervisor retry handled all transient errors Previous attempt (single pipeline): failed at 97K after 38 min This attempt (supervisor): completed 100K in 9.5 min with retry Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-27 09:53:47 -05:00