Phase 5: hardening — gRPC, observability, auth, config

- proto: lakehouse.proto with CatalogService, QueryService, StorageService, AiService
- proto crate: tonic-build codegen from proto definitions
- catalogd: gRPC CatalogService implementation
- gateway: dual HTTP (:3100) + gRPC (:3101) servers
- gateway: OpenTelemetry tracing with stdout exporter
- gateway: API key auth middleware (toggleable)
- shared: TOML config system with typed structs and defaults
- lakehouse.toml config file
- ADR-006 and ADR-007 documented

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
root
2026-03-27 06:37:07 -05:00
co-authored by Claude Opus 4.6
parent 50a8c8013f
commit 01373c0e45
23 changed files with 888 additions and 60 deletions
+6 -6
View File
@@ -49,10 +49,10 @@
**Gate: PASSED** — Browse datasets and query from browser at lakehouse.devop.live.
## Phase 5: Hardening
- [ ] 5.1 — Proto definitions
- [ ] 5.2 — Internal gRPC migration
- [ ] 5.3 — OpenTelemetry tracing
- [ ] 5.4 — Auth middleware
- [ ] 5.5 — Config-driven startup
- [x] 5.1 — Proto definitions (lakehouse.proto: CatalogService, QueryService, StorageService, AiService)
- [x] 5.2 — Internal gRPC: CatalogService on :3101, proto crate with tonic codegen
- [x] 5.3 — OpenTelemetry tracing: stdout exporter, configurable via lakehouse.toml
- [x] 5.4 — Auth middleware: X-API-Key header check, toggleable via config
- [x] 5.5 — Config-driven startup: lakehouse.toml (gateway, storage, catalog, sidecar, ai, auth, observability)
**Gate:** gRPC internals, traces, auth, restartable from repo + config.
**Gate: PASSED** — gRPC on :3101, OTel traces, auth ready, system starts from repo + lakehouse.toml.