profit/lakehouse
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity

chore: add real content that was sitting untracked

Browse Source 
Surfaced by today's untracked-files audit. None of these are accidents —
multiple are referenced by name in CLAUDE.md and memory files but were
never added.

Categories:
- docs/PHASE_AUDIT_GUIDE.md (106 LOC) — Claude Code phase audit guidance
- ops/systemd/lakehouse-langfuse-bridge.service — Langfuse bridge unit
- package.json — top-level npm manifest
- scripts/e2e_pipeline_check.sh + production_smoke.sh — real test scripts
- reports/kimi/audit-last-week*.md — the "Two reports live" CLAUDE.md cites
- tests/multi-agent/scenarios/ — 44 staffing scenarios (cutover decision A)
- tests/multi-agent/playbooks/ — 102 playbook records
- tests/battery/, tests/agent_test/PRD.md, tests/real-world/* — real tests
- sidecar/sidecar/{lab_ui,pipeline_lab}.py — 888 LOC dev-only UIs that
  remain in service post-sidecar-drop (commit ba928b1 explicitly kept them)

Sensitivity check: scenarios use synthetic company names ("Heritage Foods",
"Cornerstone Fabrication"); audit reports describe code findings only;
no PII or secrets surfaced.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
root
2026-05-02 22:22:10 -05:00
co-authored by Claude Opus 4.7
parent 6e34ef7baf
commit 41b0a99ed2
788 changed files with 107142 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-47/checkpoints.jsonl
View File
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-47/dispatch.jsonl
View File
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-47/emails.md
+1
View File
@@ -0,0 +1 @@
# Client emails — Pioneer Assembly — Indianapolis Plant Expansion, 2026-05-03
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-47/prior_lessons.json
+80
View File
@@ -0,0 +1,80 @@
[
{
"date": "2026-05-05",
"client": "Midway Distribution",
"cities": "Indianapolis",
"states": "IN",
"events_total": 4,
"events_ok": 3,
"checkpoint_count": 2,
"model": "gpt-oss:20b",
"cloud": false,
"lesson": "** \nBefore running an expansion, pre‑fetch local Packer data (or fallback to the nearest city) and validate that the executor returns well‑formed JSON; this prevents the “Missing local Packer data” failure. \nWhen an emergency request arrives, immediately cross‑check the 16:00 schedule to ensure no worker is assigned twice, and correct any artifact errors in the scheduling logic that could cause double‑booking. \nImplement automated checks that flag duplicate assignments and missing data before the agent commits to a fill.",
"checkpoints": [
{
"after": "10:30",
"risk": "Missing local Packer data",
"hint": "Add Indianapolis Packer records to the index or fallback to nearest city; verify executor returns valid JSON before execution."
},
{
"after": "12:00",
"risk": "16:00 double-booking risk",
"hint": "Verify no worker is assigned twice for 16:00; fix artifact error in scheduling logic."
}
],
"created_at": "2026-04-21T02:04:50.585Z",
"file": "2026-05-05_Midway_Distribution_1776737090585.json"
},
{
"date": "2026-05-03",
"client": "Pioneer Assembly — Indianapolis Plant Expansion",
"cities": "Indianapolis",
"states": "IN",
"events_total": 5,
"events_ok": 5,
"checkpoint_count": 2,
"model": "gpt-oss:120b",
"cloud": true,
"lesson": "When scheduling multiple shifts for the same role in Indianapolis, pull the candidate roster for the upcoming shift before locking in the current one to catch any overlap. If the Indianapolis pool for Machine Operators looks thin, pre‑load Muncie, IN (≈60 mi) candidates and reserve them as the primary alternate before assigning any Indianapolis workers. Keep a backup list of qualified Assemblers (e.g., Maria L. Torres) ready to replace anyone flagged for double‑booking such as Jacob E. Bailey. Verify that all selected workers stay within the 60‑mile radius to secure the $5/hr local bonus.",
"checkpoints": [
{
"after": "11:00",
"risk": "Double‑booking risk for Machine Operators",
"hint": "For the next Machine Operator shift, pivot to Muncie, IN (~60 mi) to tap fresh pool and prevent double‑booking of the Indianapolis crew."
},
{
"after": "16:00",
"risk": "Potential double‑booking of Jacob E. Bailey",
"hint": "For the next Indianapolis Assembler shift, select another qualified worker (e.g., Maria L. Torres) to prevent double‑booking Jacob E. Bailey; stay within the 60 mi bonus radius."
}
],
"created_at": "2026-04-21T03:44:59.381Z",
"file": "2026-05-03_Pioneer_Assembly_—_Indianapolis_Plant_Expansion_1776743099381.json"
},
{
"date": "2026-04-30",
"client": "Pioneer Assembly — Indianapolis Plant Expansion",
"cities": "Indianapolis",
"states": "IN",
"events_total": 5,
"events_ok": 5,
"checkpoint_count": 2,
"model": "gpt-oss:120b",
"cloud": true,
"lesson": "When multiple shifts overlap in the same city, pull the required number of Machine Operators and Assemblers from the nearest alternate city (e.g., Muncie, IN ≈ 45 mi) before assigning any Indianapolis staff, keeping them within the $5/hr local‑bonus radius. Pre‑check each role’s turn count and reserve candidates from the alternate pool to avoid double‑booking individuals like Zachary Taylor. If a shift’s pool shows a gap ≥ 3, automatically queue the same‑role candidates from the alternate city for the next shift rather than re‑using the same workers. Maintain a live “used‑per‑city” ledger so the system flags potential double‑bookings before confirming fills.",
"checkpoints": [
{
"after": "11:00",
"risk": "Double‑booking risk for overlapping shifts",
"hint": "For next shift, source Machine Operators from Muncie, IN (≈45 mi) to stay within bonus radius and avoid double‑booked Indianapolis staff."
},
{
"after": "16:00",
"risk": "Potential double‑booking of Zachary Taylor",
"hint": "If the next shift needs an Assembler in Indianapolis, pull a candidate from Muncie, IN (≈45 mi) – still within bonus radius – to sidestep the double‑booking issue."
}
],
"created_at": "2026-04-21T03:37:30.970Z",
"file": "2026-04-30_Pioneer_Assembly_—_Indianapolis_Plant_Expansion_1776742650970.json"
}
]
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-47/report.md
+56
View File
@@ -0,0 +1,56 @@
# Scenario retrospective — Pioneer Assembly — Indianapolis Plant Expansion, 2026-05-03
Executor: `qwen2.5:latest` Reviewer: `qwen2.5:latest` Draft: `qwen2.5:latest` Overview(T3): `disabled`
Prior lessons loaded into executor context: **3** (from 2026-05-05, 2026-05-03, 2026-04-30)
## Events
| At | Kind | Role / Count | Pool | Fills | Turns | Dur(s) | Cites | Gaps |
|---|---|---|---|---|---|---|---|---|
| 07:30 | baseline_fill | Assembler × 6 | - | ✗ 0 | 0 | 6.9 | 0 | 1 |
| 09:30 | recurring | Quality Tech × 2 | - | ✗ 0 | 0 | 6.8 | 0 | 1 |
| 11:00 | expansion | Machine Operator × 5 | - | ✗ 0 | 0 | 8.0 | 0 | 1 |
| 14:00 | emergency | Machine Operator × 3 | - | ✗ 0 | 0 | 11.2 | 0 | 1 |
| 16:00 | misplacement | Assembler × 1 | - | ✗ 0 | 0 | 6.5 | 0 | 1 |
## Final roster
| Worker | Booked | Role | City, ST | Status |
|---|---|---|---|---|
## Gap signals
### drift_or_tool
- **07:30** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5","question":"6 Assembler in Indianapolis, IN","k":30},"rationale":"Initial search for Assemblers in Ind
- **09:30** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Quality Tech' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5","question":"recurring Quality Tech Indianapolis IN","k":40},"rationale":"Initial search for Quality
- **11:00** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75","question":"Machine Operator in Indianapolis, IN with hi
- **14:00** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.7","question":"Machine Operator Indianapolis IN available","k":60},"rationale":"Verify the top can
- **16:00** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5","question":"Assembler in Indianapolis, IN","k":20},"rationale":"Start searching for available Assemble
### write_through_audit
- _post-run_ — playbook_memory has 1788 entries (ran 5 events, expected ≥ 0 new entries from this run)
## Workers touched across the week
0 distinct workers made it through to a decision. Every one is accounted for below — no-shows flagged, rebookings noted, everyone visible.
| Worker ID | Name | Events | Outcome |
|---|---|---|---|
## Discovered patterns (meta-index)
What the system identified across semantically-similar past fills as each event ran:
- **07:30 baseline_fill** (Assembler): —
- **09:30 recurring** (Quality Tech): —
- **11:00 expansion** (Machine Operator): —
- **14:00 emergency** (Machine Operator): —
- **16:00 misplacement** (Assembler): —
## Narrative
- 0/5 events reached consensus.
- Final roster: 0 bookings across 0 distinct workers.
- Workers touched (booked, failed, or otherwise decided): 0.
- Playbook citations across the day: 0 (proof the feedback loop fired across events).
- Dropped events: 07:30 baseline_fill, 09:30 recurring, 11:00 expansion, 14:00 emergency, 16:00 misplacement.
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-47/results.json
+554
View File
@@ -0,0 +1,554 @@
[
{
"event": {
"kind": "baseline_fill",
"at": "07:30",
"role": "Assembler",
"count": 6,
"city": "Indianapolis",
"state": "IN",
"shift_start": "07:30 AM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-26, fill=paramount."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 6.91,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"6 Assembler in Indianapolis, IN\",\"k\":30},\"rationale\":\"Initial search for Assemblers in Ind",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"6 Assembler in Indianapolis, IN\",\"k\":30},\"rationale\":\"Initial search for Assemblers in Ind"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 380
},
"at": "2026-04-21T04:07:49.428Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 760
},
"at": "2026-04-21T04:07:51.042Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 1140
},
"at": "2026-04-21T04:07:52.632Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"6 Assembler in Indianapolis, IN\",\"k\":30},\"rationale\":\"Initial search for Assemblers in Ind",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"6 Assembler in Indianapolis, IN\",\"k\":30},\"rationale\":\"Initial search for Assemblers in Ind"
},
"at": "2026-04-21T04:07:54.240Z"
}
]
},
{
"event": {
"kind": "recurring",
"at": "09:30",
"role": "Quality Tech",
"count": 2,
"city": "Indianapolis",
"state": "IN",
"shift_start": "09:30 AM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-26, fill=paramount."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 6.802,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Quality Tech' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"recurring Quality Tech Indianapolis IN\",\"k\":40},\"rationale\":\"Initial search for Quality",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Quality Tech' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"recurring Quality Tech Indianapolis IN\",\"k\":40},\"rationale\":\"Initial search for Quality"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 380
},
"at": "2026-04-21T04:07:56.782Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 760
},
"at": "2026-04-21T04:07:58.393Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 1140
},
"at": "2026-04-21T04:07:59.963Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Quality Tech' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"recurring Quality Tech Indianapolis IN\",\"k\":40},\"rationale\":\"Initial search for Quality",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Quality Tech' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"recurring Quality Tech Indianapolis IN\",\"k\":40},\"rationale\":\"Initial search for Quality"
},
"at": "2026-04-21T04:08:01.543Z"
}
]
},
{
"event": {
"kind": "expansion",
"at": "11:00",
"role": "Machine Operator",
"count": 5,
"city": "Indianapolis",
"state": "IN",
"shift_start": "11:00 PM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-26, fill=paramount."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 8.012,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75\",\"question\":\"Machine Operator in Indianapolis, IN with hi",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75\",\"question\":\"Machine Operator in Indianapolis, IN with hi"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 478
},
"at": "2026-04-21T04:08:04.381Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 956
},
"at": "2026-04-21T04:08:06.272Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 1434
},
"at": "2026-04-21T04:08:08.158Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75\",\"question\":\"Machine Operator in Indianapolis, IN with hi",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75\",\"question\":\"Machine Operator in Indianapolis, IN with hi"
},
"at": "2026-04-21T04:08:10.055Z"
}
]
},
{
"event": {
"kind": "emergency",
"at": "14:00",
"role": "Machine Operator",
"count": 3,
"deadline": "16:00",
"city": "Indianapolis",
"state": "IN",
"shift_start": "14:00 PM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-26, fill=paramount."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 11.171,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.7\",\"question\":\"Machine Operator Indianapolis IN available\",\"k\":60},\"rationale\":\"Verify the top can",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.7\",\"question\":\"Machine Operator Indianapolis IN available\",\"k\":60},\"rationale\":\"Verify the top can"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "tool_call",
"content": {
"kind": "tool_call",
"tool": "hybrid_search",
"args": {
"index_name": "workers_500k_v1",
"sql_filter": "role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.7",
"question": "Machine Operator Indianapolis IN available",
"k": 60
},
"rationale": "Surface candidates for the Machine Operator role in Indianapolis, IN with high availability to meet the emergency requirement."
},
"at": "2026-04-21T04:08:12.629Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "tool_result",
"content": {
"question": "Machine Operator Indianapolis IN available",
"sql_filter": "role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.7",
"sql_matches": 657,
"vector_reranked": 60,
"method": "hybrid_sql_vector",
"answer": null,
"sources": [
{
"doc_id": "W500K-34233",
"chunk_text": "Alexander R. Evans — Machine Operator in Indianapolis, IN. Skills: 6S|CNC|EDM|assembly|batch processing|blueprint reading|lathe|line work|micrometer. Certs: OSHA-10|First Aid/CPR|MSDS. Archetype: flexible. Reliability: 0.87, Availability: 1.00",
"score": 0.8378304,
"sql_verified": true,
"playbook_boost": 0.25,
"playbook_citations": [
"pb-seed-b249552c3cd15b5e",
"pb-seed-fcf82664d2d9567b",
"pb-seed-4b7bc1f7f068bb9f",
"pb-seed-dbc5dd10ff21f254",
"pb-seed-dba50571839e693f",
"pb-seed-65de15df32e8e588"
]
},
{
"doc_id": "W500K-23524",
"chunk_text": "Angela U. Ward — Machine Operator in Indianapolis, IN. Skills: 6S|GD&T|assembly|conveyor ops|grinder|labeling|lathe|lean manufacturing|micrometer. Certs: OSHA-30. Archetype: flexible. Reliability: 0.80, Availability: 0.81",
"score": 0.816748,
"sql_verified": true,
"playbook_boost": 0.25,
"playbook_citations": [
"pb-seed-b5d8a51cb9df9a2a",
"pb-seed-2a6b072589433954",
"pb-seed-e70a39e9ce31d93b",
"pb-seed-ec790797c90d8b04",
"pb-seed-5180f6ed206973f1",
"pb-seed-b249552c3cd15b5e",
"pb-seed-fcf82664d2d9567b",
"pb-seed-4b7bc1f7f068bb9f",
"pb-seed-dbc5dd10ff21f254",
"pb-seed-dba50571839e693f",
"pb-seed-65de15df32e8e588"
]
},
{
"doc_id": "W500K-6479",
"chunk_text": "Christina Watson — Machine Operator in Indianapolis, IN. Skills: 6S|CNC|calipers|line work|micrometer|mill|press brake. Certs: OSHA-10. Archetype: leader. Reliability: 0.90, Availability: 0.92",
"score": 0.80805904,
"sql_verified": true,
"playbook_boost": 0.25,
"playbook_citations": [
"pb-seed-b5d8a51cb9df9a2a",
"pb-seed-2a6b072589433954",
"pb-seed-e70a39e9ce31d93b",
"pb-seed-ec790797c90d8b04",
"pb-seed-5180f6ed206973f1",
"pb-seed-11a4d8a8851b339e",
"pb-seed-b249552c3cd15b5e",
"pb-seed-fcf82664d2d9567b",
"pb-seed-4b7bc1f7f068bb9f",
"pb-seed-dbc5dd10ff21f254",
"pb-seed-dba50571839e693f",
"pb-seed-65de15df32e8e588"
]
},
{
"doc_id": "W500K-23467",
"chunk_text": "Alexander P. Turner — Machine Operator in Indianapolis, IN. Skills: EDM|GD&T|SPC|assembly|batch processing|blueprint reading|calipers|lathe|lean manufacturing|quality inspection. Certs: none. Archetype: reliable. Reliability: 0.81, Availability: 0.83",
"score": 0.8037054,
"sql_verified": true,
"playbook_boost": 0.25,
"playbook_citations": [
"pb-seed-b5d8a51cb9df9a2a",
"pb-seed-2a6b072589433954",
"pb-seed-e70a39e9ce31d93b",
"pb-seed-ec790797c90d8b04",
"pb-seed-5180f6ed206973f1",
"pb-seed-fcf82664d2d9567b",
"pb-seed-4b7bc1f7f068bb9f",
"pb-seed-dbc5dd10ff21f254",
"pb-seed-dba50571839e693f",
"pb-seed-65de15df32e8e588"
]
},
{
"doc_id": "W500K-20117",
"chunk_text": "Yuki T. Garcia — Machine Operator in Indianapolis, IN. Skills: 6S|EDM|batch processing|grinder|line work|micrometer|mill|quality inspection. Certs: none. Archetype: flexible. Reliability: 0.76, Availability: 0.86",
"score": 0.5867828,
"sql_verified": true
},
{
"doc_id": "W500K-46305",
"chunk_text": "Gregory Z. Morris — Machine Operator in Indianapolis, IN. Skills: 6S|EDM|GD&T|batch processing|calipers|conveyor ops|line work|micrometer|press brake|quality inspection. Certs: Forklift|Fire Safety. Archetype: reliable. Reliability: 0.80, Availability: 0.88",
"score": 0.58594686,
"sql_verified": true
},
{
"doc_id": "W500K-38277",
"chunk_text": "Mark F. Ramos — Machine Operator in Indianapolis, IN. Skills: EDM|GD&T|assembly|labeling|micrometer|mill|press brake. Certs: Hazmat. Archetype: reliable. Reliability: 0.82, Availability: 0.83",
"score": 0.58498377,
"sql_verified": true
},
{
"doc_id": "W500K-46825",
"chunk_text": "Michael Z. Brooks — Machine Operator in Indianapolis, IN. Skills: 6S|CNC|EDM|GD&T|line work|press brake. Certs: Forklift|First Aid/CPR. Archetype: reliable. Reliability: 0.91, Availability: 0.81",
"score": 0.58152616,
"sql_verified": true
},
{
"doc_id": "W500K-36355",
"chunk_text": "Carmen H. Jenkins — Machine Operator in Indianapolis, IN. Skills: CNC|GD&T|SPC|grinder|lathe|lean manufacturing|press brake. Certs: OSHA-30|Forklift. Archetype: communicator. Reliability: 0.66, Availability: 0.91",
"score": 0.5812015,
"sql_verified": true
},
{
"doc_id": "W500K-6747",
"chunk_text": "Patricia Wood — Machine Operator in Indianapolis, IN. Skills: 6S|CNC|GD&T|SPC|grinder|micrometer|press brake. Certs: Forklift|Order Picker. Archetype: reliable. Reliability: 0.83, Availability: 0.75",
"score": 0.5807513,
"sql_verified": true
},
{
"doc_id": "W500K-46670",
"chunk_text": "Dorothy A. Turner — Machine Operator in Indianapolis, IN. Skills: 6S|GD&T|assembly|labeling|lean manufacturing|line work|mill. Certs: OSHA-10. Archetype: erratic. Reliability: 0.27, Availability: 0.78",
"score": 0.5800839,
"sql_verified": true
},
{
"doc_id": "W500K-13456",
"chunk_text": "Zachary Jackson — Machine Operator in Indianapolis, IN. Skills: batch processing|conveyor ops|lean manufacturing|line work|micrometer|mill|quality inspection. Certs: OSHA-30|Forklift. Archetype: leader. Reliability: 0.87, Availability: 0.78",
"score": 0.5798079,
"sql_verified": true
},
{
"doc_id": "W500K-25473",
"chunk_text": "Gary T. Rivera — Machine Operator in Indianapolis, IN. Skills: assembly|blueprint reading|labeling|line work|mill|press brake|quality inspection. Certs: Lockout/Tagout. Archetype: leader. Reliability: 0.72, Availability: 0.91",
"score": 0.57850343,
"sql_verified": true
},
{
"doc_id": "W500K-18997",
"chunk_text": "Luis R. Long — Machine Operator in Indianapolis, IN. Skills: CNC|GD&T|batch processing|conveyor ops|grinder|line work|micrometer|mill|quality inspection. Certs: MSDS. Archetype: reliable. Reliability: 0.84, Availability: 0.74",
"score": 0.5780482,
"sql_verified": true
},
{
"doc_id": "W500K-34180",
"chunk_text": "Ivan Q. Robinson — Machine Operator in Indianapolis, IN. Skills: 6S|CNC|assembly|labeling|line work|mill. Certs: OSHA-10. Archetype: reliable. Reliability: 0.83, Availability: 0.83",
"score": 0.572749,
"sql_verified": true
},
{
"doc_id": "W500K-960",
"chunk_text": "Rosa Young — Machine Operator in Indianapolis, IN. Skills: GD&T|assembly|calipers|grinder|labeling|lathe|line work. Certs: none. Archetype: reliable. Reliability: 0.93, Availability: 0.83",
"score": 0.5727114,
"sql_verified": true
},
{
"doc_id": "W500K-45678",
"chunk_text": "Pamela W. Perry — Machine Operator in Indianapolis, IN. Skills: 6S|CNC|EDM|GD&T|assembly|batch processing|line work. Certs: Forklift|Confined Space. Archetype: leader. Reliability: 0.83, Availability: 0.75",
"score": 0.57117075,
"sql_verified": true
},
{
"doc_id": "W500K-12152",
"chunk_text": "Susan Taylor — Machine Operator in Indianapolis, IN. Skills: GD&T|calipers|labeling|line work|mill. Certs: Forklift. Archetype: flexible. Reliability: 0.72, Availability: 0.73",
"score": 0.5703949,
"sql_verified": true
},
{
"doc_id": "W500K-32459",
"chunk_text": "Donna L. Perez — Machine Operator in Indianapolis, IN. Skills: 6S|GD&T|batch processing|line work|micrometer|press brake. Certs: none. Archetype: reliable. Reliability: 0.81, Availability: 0.85",
"score": 0.5682502,
"sql_verified": true
},
{
"doc_id": "W500K-31015",
"chunk_text": "Priya X. Perry — Machine Operator in Indianapolis, IN. Skills: CNC|SPC|assembly|conveyor ops|press brake. Certs: OSHA-30|Forklift|First Aid/CPR|MSDS. Archetype: flexible. Reliability: 0.57, Availability: 0.86",
"score": 0.56630874,
"sql_verified": true
}
],
"duration_ms": 338,
"_trimmed": "40 more"
},
"at": "2026-04-21T04:08:12.970Z"
},
{
"turn": 1,
"role": "reviewer",
"model": "qwen2.5:latest",
"kind": "critique",
"content": {
"kind": "critique",
"verdict": "continue",
"notes": "Continue as planned, but ensure to verify at least one of the proposed candidates through SQL query."
},
"at": "2026-04-21T04:08:14.024Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 450
},
"at": "2026-04-21T04:08:16.567Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 900
},
"at": "2026-04-21T04:08:18.312Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 1350
},
"at": "2026-04-21T04:08:20.033Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.7\",\"question\":\"Machine Operator Indianapolis IN available\",\"k\":60},\"rationale\":\"Verify the top can",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Machine Operator' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.7\",\"question\":\"Machine Operator Indianapolis IN available\",\"k\":60},\"rationale\":\"Verify the top can"
},
"at": "2026-04-21T04:08:21.727Z"
}
]
},
{
"event": {
"kind": "misplacement",
"at": "16:00",
"role": "Assembler",
"count": 1,
"replaces_event": "07:30",
"city": "Indianapolis",
"state": "IN",
"shift_start": "16:00 PM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-26, fill=paramount."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 6.497,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Assembler in Indianapolis, IN\",\"k\":20},\"rationale\":\"Start searching for available Assemble",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Assembler in Indianapolis, IN\",\"k\":20},\"rationale\":\"Start searching for available Assemble"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 346
},
"at": "2026-04-21T04:08:24.204Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 692
},
"at": "2026-04-21T04:08:25.724Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 1038
},
"at": "2026-04-21T04:08:27.218Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Assembler in Indianapolis, IN\",\"k\":20},\"rationale\":\"Start searching for available Assemble",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Assembler' AND city = 'Indianapolis' AND state = 'IN' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Assembler in Indianapolis, IN\",\"k\":20},\"rationale\":\"Start searching for available Assemble"
},
"at": "2026-04-21T04:08:28.725Z"
}
]
}
]
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-47/roster.json
+1
View File
@@ -0,0 +1 @@
[]
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-47/sms.md
+1
View File
@@ -0,0 +1 @@
# SMS drafts — Pioneer Assembly — Indianapolis Plant Expansion, 2026-05-03