profitandClaude Opus 4.7
ac01fffd9a
Architectural snapshot of the lakehouse codebase at the point where the
full matrix-driven agent loop with Mem0 versioning + deletion was
validated end-to-end.
WHAT THIS REPO IS
A clean single-commit snapshot of the lakehouse code. Heavy test data
(.parquet datasets, vector indexes) excluded — see REPLICATION.md for
regen path. Full lakehouse history at git.agentview.dev/profit/lakehouse.
WHAT WAS PROVEN
- Vector retrieval across multi-corpora matrix (chicago_permits + entity
briefs + sec_tickers + distilled procedural + llm_team runs)
- Observer hand-review (cloud + heuristic fallback) gating each candidate
- Local-model agent loop (qwen3.5:latest) with tool use + scratchpad
- Playbook seal on success → next-iter retrieval surfaces it as preamble
- Mem0 versioning + deletion in pathway_memory:
* UPSERT: ADD on new workflow, UPDATE bumps replay_count on identical
* REVISE: chains versions, parent.superseded_at + superseded_by stamped
* RETIRE: marks specific trace retired with reason, excluded from retrieval
* HISTORY: walks chain root→tip, cycle-safe
KEY DIRECTORIES
- crates/vectord/src/pathway_memory.rs — Mem0 ops live here
- crates/vectord/src/playbook_memory.rs — original Mem0 reference
- tests/agent_test/ — local-model agent harness + PRD + session archives
- scripts/dump_raw_corpus.sh — MinIO bucket dump (raw test corpus)
- scripts/vectorize_raw_corpus.ts — corpus → vector indexes
- scripts/analyze_chicago_contracts.ts — real inference pipeline
- scripts/seal_agent_playbook.ts — Mem0 upsert from agent traces
Replication: see REPLICATION.md for Debian 13 clean install + cloud-only
adaptation (no local Ollama).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
54 lines
1.6 KiB
Rust
54 lines
1.6 KiB
Rust
pub mod registry;
|
|
pub mod service;
|
|
|
|
use queryd::context::QueryEngine;
|
|
use arrow::json::writer::{JsonArray, Writer as JsonWriter};
|
|
use std::sync::Arc;
|
|
use truth::TruthStore;
|
|
|
|
/// State for the tool system.
|
|
#[derive(Clone)]
|
|
pub struct ToolState {
|
|
pub registry: registry::ToolRegistry,
|
|
pub query_fn: QueryExecutor,
|
|
/// SQL guard (shared with queryd). Mirrors the queryd /sql truth
|
|
/// gate from P42-002 (9cc0ceb) — tools also execute model-
|
|
/// originated SQL, need the same destructive-verb block.
|
|
pub truth: Arc<TruthStore>,
|
|
}
|
|
|
|
/// Wraps QueryEngine to provide a simple execute interface for tools.
|
|
#[derive(Clone)]
|
|
pub struct QueryExecutor {
|
|
engine: QueryEngine,
|
|
}
|
|
|
|
impl QueryExecutor {
|
|
pub fn new(engine: QueryEngine) -> Self {
|
|
Self { engine }
|
|
}
|
|
|
|
/// Execute SQL and return (rows as JSON, row count).
|
|
pub async fn execute(&self, sql: &str) -> Result<(serde_json::Value, usize), String> {
|
|
let batches = self.engine.query(sql).await?;
|
|
|
|
if batches.is_empty() {
|
|
return Ok((serde_json::Value::Array(vec![]), 0));
|
|
}
|
|
|
|
let mut buf = Vec::new();
|
|
let mut writer = JsonWriter::<_, JsonArray>::new(&mut buf);
|
|
for batch in &batches {
|
|
writer.write(batch).map_err(|e| format!("JSON write: {e}"))?;
|
|
}
|
|
writer.finish().map_err(|e| format!("JSON finish: {e}"))?;
|
|
drop(writer);
|
|
|
|
let rows: serde_json::Value = serde_json::from_slice(&buf)
|
|
.map_err(|e| format!("JSON parse: {e}"))?;
|
|
let count = rows.as_array().map(|a| a.len()).unwrap_or(0);
|
|
|
|
Ok((rows, count))
|
|
}
|
|
}
|