Database connector: PostgreSQL → Parquet import

- POST /ingest/postgres/tables — list all tables in a database
- POST /ingest/postgres/import — import table → Parquet → catalog → queryable
- Auto type mapping: int2/4/8 → Int, float4/8 → Float64, bool → Boolean,
  text/varchar/jsonb/timestamp → Utf8 (safe default per ADR-010)
- Auto PII detection + lineage on import
- Empty password support for trust auth
- Tested: imported lab_trials (40 rows, 10 cols) and threat_intel (20 rows, 30 cols)
  from local knowledge_base Postgres database — immediately queryable

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

This commit is contained in:

root

2026-03-27 20:14:16 -05:00

co-authored by

Claude Opus 4.6

parent 294f3f6a49

commit 9992b5f135

10 changed files with 880 additions and 8 deletions

									
										Cargo.toml
									
		+1
		
												View File
												
				@@ -45,3 +45,4 @@ csv = "1"

				lopdf = "0.35"

				encoding_rs = "0.8"

				instant-distance = "0.6"

				tokio-postgres = { version = "0.7", features = ["with-serde_json-1", "with-chrono-0_4"] }