profit/lakehouse
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity

chore: add real content that was sitting untracked

Browse Source 
Surfaced by today's untracked-files audit. None of these are accidents —
multiple are referenced by name in CLAUDE.md and memory files but were
never added.

Categories:
- docs/PHASE_AUDIT_GUIDE.md (106 LOC) — Claude Code phase audit guidance
- ops/systemd/lakehouse-langfuse-bridge.service — Langfuse bridge unit
- package.json — top-level npm manifest
- scripts/e2e_pipeline_check.sh + production_smoke.sh — real test scripts
- reports/kimi/audit-last-week*.md — the "Two reports live" CLAUDE.md cites
- tests/multi-agent/scenarios/ — 44 staffing scenarios (cutover decision A)
- tests/multi-agent/playbooks/ — 102 playbook records
- tests/battery/, tests/agent_test/PRD.md, tests/real-world/* — real tests
- sidecar/sidecar/{lab_ui,pipeline_lab}.py — 888 LOC dev-only UIs that
  remain in service post-sidecar-drop (commit ba928b1 explicitly kept them)

Sensitivity check: scenarios use synthetic company names ("Heritage Foods",
"Cornerstone Fabrication"); audit reports describe code findings only;
no PII or secrets surfaced.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
root
2026-05-02 22:22:10 -05:00
co-authored by Claude Opus 4.7
parent 6e34ef7baf
commit 41b0a99ed2
788 changed files with 107142 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-07/checkpoints.jsonl
View File
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-07/dispatch.jsonl
View File
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-07/emails.md
+1
View File
@@ -0,0 +1 @@
# Client emails — Midway Distribution — Joliet DC Ramp, 2026-05-02
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-07/prior_lessons.json
+70
View File
@@ -0,0 +1,70 @@
[
{
"date": "2026-05-10",
"client": "Midway Distribution",
"cities": "Chicago",
"states": "IL",
"events_total": 3,
"events_ok": 2,
"checkpoint_count": 1,
"model": "gpt-oss:20b",
"cloud": false,
"lesson": "** \nBefore assigning a Packer to Chicago, verify the candidate’s current assignment and cross‑check drift logs for recent misplacements. Pre‑calibrate packing tools and load a backup Packer into the pool to avoid a single point of failure. If a drift risk is flagged, immediately relocate the Packer or switch to a verified alternate. Keep the pool count updated and ensure it matches the required number of roles before each event.",
"checkpoints": [
{
"after": "09:30",
"risk": "Packer drift risk persists",
"hint": "Verify Packer's Chicago assignment, review drift logs, recalibrate tools, and consider temporary relocation."
}
],
"created_at": "2026-04-21T02:14:12.176Z",
"file": "2026-05-10_Midway_Distribution_1776737652176.json"
},
{
"date": "2026-05-02",
"client": "Midway Distribution — Joliet DC Ramp",
"cities": "Joliet",
"states": "IL",
"events_total": 4,
"events_ok": 3,
"checkpoint_count": 2,
"model": "gpt-oss:120b",
"cloud": true,
"lesson": "When an expansion request for Pickers in Joliet hits a [ZERO‑SUPPLY] flag, immediately pivot to Crest Hill, IL (≈10 mi) – the corpus shows a pool of > 500 qualified Pickers there and it stays within the 50‑mi bonus radius. Before the shift starts, pull a shortlist of at least 4 Crest Hill candidates and lock them in, keeping the Joliet pool as a secondary fallback only for Warehouse Associates. Also verify each candidate’s existing assignments to prevent double‑booking (e.g., Joshua Taylor) before confirming any fill. If Crest Hill still lacks enough workers, broaden the search to nearby Chicago (≈45 mi) while staying within the local bonus zone.",
"checkpoints": [
{
"after": "12:30",
"risk": "Zero supply for Picker in Joliet",
"hint": "Pivot to Crest Hill, IL (≈10 mi) for Picker; pool likely >500. If still insufficient, broaden to Warehouse Associate in Joliet."
},
{
"after": "15:00",
"risk": "Potential double‑booking of Joshua Taylor",
"hint": "For the next Forklift Operator shift in Joliet, select a different qualified candidate from the pool; if none, pivot to Chicago, IL (≈45 mi) to remain within the 50 mi bonus radius."
}
],
"created_at": "2026-04-21T03:42:33.094Z",
"file": "2026-05-02_Midway_Distribution_—_Joliet_DC_Ramp_1776742953094.json"
},
{
"date": "2026-05-01",
"client": "Northland Logistics",
"cities": "Chicago",
"states": "IL",
"events_total": 2,
"events_ok": 2,
"checkpoint_count": 1,
"model": "gpt-oss:20b",
"cloud": false,
"lesson": "** \nBefore assigning the 15:00 baseline_fill, pre‑fetch the list of workers already allocated at 10:00 and cross‑check each candidate’s schedule to avoid double booking. Verify that every worker’s artifact includes a valid `f.reason` before finalizing the assignment. This ensures overlapping shifts are caught early and reduces rework.",
"checkpoints": [
{
"after": "10:00",
"risk": "Double booking of scheduled workers",
"hint": "Verify each worker's schedule before assigning to 15:00; handle artifact errors by ensuring f.reason exists."
}
],
"created_at": "2026-04-21T01:57:42.670Z",
"file": "2026-05-01_Northland_Logistics_1776736662670.json"
}
]
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-07/report.md
+53
View File
@@ -0,0 +1,53 @@
# Scenario retrospective — Midway Distribution — Joliet DC Ramp, 2026-05-02
Executor: `qwen2.5:latest` Reviewer: `qwen2.5:latest` Draft: `qwen2.5:latest` Overview(T3): `disabled`
Prior lessons loaded into executor context: **3** (from 2026-05-10, 2026-05-02, 2026-05-01)
## Events
| At | Kind | Role / Count | Pool | Fills | Turns | Dur(s) | Cites | Gaps |
|---|---|---|---|---|---|---|---|---|
| 07:00 | baseline_fill | Warehouse Associate × 5 | - | ✗ 0 | 0 | 7.5 | 0 | 1 |
| 10:00 | recurring | Forklift Operator × 3 | - | ✗ 0 | 0 | 8.0 | 0 | 1 |
| 12:30 | expansion | Picker × 4 | - | ✗ 0 | 0 | 12.5 | 0 | 1 |
| 15:00 | misplacement | Forklift Operator × 1 | - | ✗ 0 | 0 | 9.8 | 0 | 1 |
## Final roster
| Worker | Booked | Role | City, ST | Status |
|---|---|---|---|---|
## Gap signals
### drift_or_tool
- **07:00** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Warehouse Associate' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5","question":"Warehouse Associate Joliet, IL","k":40},"rationale":"Initiate the search for Warehouse
- **10:00** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5","question":"recurring forklift operator Joliet, IL","k":60},"rationale":"Initiate search for qualifi
- **12:30** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Picker' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75","question":"4 Pickers in Joliet, IL","k":20},"rationale":"Re-run the sea
- **15:00** — invalid JSON from executor: JSON Parse error: Expected '}' | raw: {"kind":"tool_call","tool":"hybrid_search","args":{"index_name":"workers_500k_v1","sql_filter":"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5","question":"Forklift Operator Joliet, IL","k":20},"rationale":"Verify the top candidate from the pre
### write_through_audit
- _post-run_ — playbook_memory has 1762 entries (ran 4 events, expected ≥ 0 new entries from this run)
## Workers touched across the week
0 distinct workers made it through to a decision. Every one is accounted for below — no-shows flagged, rebookings noted, everyone visible.
| Worker ID | Name | Events | Outcome |
|---|---|---|---|
## Discovered patterns (meta-index)
What the system identified across semantically-similar past fills as each event ran:
- **07:00 baseline_fill** (Warehouse Associate): —
- **10:00 recurring** (Forklift Operator): —
- **12:30 expansion** (Picker): —
- **15:00 misplacement** (Forklift Operator): —
## Narrative
- 0/4 events reached consensus.
- Final roster: 0 bookings across 0 distinct workers.
- Workers touched (booked, failed, or otherwise decided): 0.
- Playbook citations across the day: 0 (proof the feedback loop fired across events).
- Dropped events: 07:00 baseline_fill, 10:00 recurring, 12:30 expansion, 15:00 misplacement.
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-07/results.json
+630
View File
@@ -0,0 +1,630 @@
[
{
"event": {
"kind": "baseline_fill",
"at": "07:00",
"role": "Warehouse Associate",
"count": 5,
"city": "Joliet",
"state": "IL",
"shift_start": "07:00 AM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-12, fill=preferred."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 7.495,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Warehouse Associate' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Warehouse Associate Joliet, IL\",\"k\":40},\"rationale\":\"Initiate the search for Warehouse",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Warehouse Associate' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Warehouse Associate Joliet, IL\",\"k\":40},\"rationale\":\"Initiate the search for Warehouse"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 385
},
"at": "2026-04-21T04:07:09.598Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 770
},
"at": "2026-04-21T04:07:11.367Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 1155
},
"at": "2026-04-21T04:07:13.115Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Warehouse Associate' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Warehouse Associate Joliet, IL\",\"k\":40},\"rationale\":\"Initiate the search for Warehouse",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Warehouse Associate' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Warehouse Associate Joliet, IL\",\"k\":40},\"rationale\":\"Initiate the search for Warehouse"
},
"at": "2026-04-21T04:07:14.878Z"
}
]
},
{
"event": {
"kind": "recurring",
"at": "10:00",
"role": "Forklift Operator",
"count": 3,
"city": "Joliet",
"state": "IL",
"shift_start": "10:00 PM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-12, fill=preferred."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 7.969,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"recurring forklift operator Joliet, IL\",\"k\":60},\"rationale\":\"Initiate search for qualifi",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"recurring forklift operator Joliet, IL\",\"k\":60},\"rationale\":\"Initiate search for qualifi"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 412
},
"at": "2026-04-21T04:07:17.730Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 824
},
"at": "2026-04-21T04:07:19.616Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 1236
},
"at": "2026-04-21T04:07:21.480Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"recurring forklift operator Joliet, IL\",\"k\":60},\"rationale\":\"Initiate search for qualifi",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"recurring forklift operator Joliet, IL\",\"k\":60},\"rationale\":\"Initiate search for qualifi"
},
"at": "2026-04-21T04:07:23.349Z"
}
]
},
{
"event": {
"kind": "expansion",
"at": "12:30",
"role": "Picker",
"count": 4,
"city": "Joliet",
"state": "IL",
"shift_start": "12:30 PM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-12, fill=preferred."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 12.472,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Picker' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75\",\"question\":\"4 Pickers in Joliet, IL\",\"k\":20},\"rationale\":\"Re-run the sea",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Picker' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75\",\"question\":\"4 Pickers in Joliet, IL\",\"k\":20},\"rationale\":\"Re-run the sea"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "tool_call",
"content": {
"kind": "tool_call",
"tool": "hybrid_search",
"args": {
"index_name": "workers_500k_v1",
"sql_filter": "role = 'Picker' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75",
"question": "4 Pickers in Joliet, IL",
"k": 20
},
"rationale": "Initial search for qualified Pickers in Joliet, IL with high availability and reliability."
},
"at": "2026-04-21T04:07:26.131Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "tool_result",
"content": {
"question": "4 Pickers in Joliet, IL",
"sql_filter": "role = 'Picker' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75",
"sql_matches": 0,
"vector_reranked": 20,
"method": "vector_only",
"answer": null,
"sources": [
{
"doc_id": "W500K-21536",
"chunk_text": "Katherine I. King — Shipping Clerk in Kansas City, MO. Skills: Excel|RF scanner|bilingual|forklift|loading dock|packaging|training. Certs: Forklift|Reach Truck. Archetype: flexible. Reliability: 0.78, Availability: 0.88",
"score": 0.6678723,
"sql_verified": false
},
{
"doc_id": "W500K-34017",
"chunk_text": "Aaron J. Cruz — Maintenance Tech in Quincy, IL. Skills: Excel|PLC|SAP|hazmat|hydraulics|overhead crane. Certs: OSHA-10. Archetype: leader. Reliability: 0.71, Availability: 1.00",
"score": 0.66398835,
"sql_verified": false
},
{
"doc_id": "W500K-25879",
"chunk_text": "Eric J. Murphy — Material Handler in Springfield, MO. Skills: confined space|loading dock|overhead crane|pick-to-light|shipping|team lead|training. Certs: First Aid/CPR|ISO 9001. Archetype: reliable. Reliability: 0.75, Availability: 0.49",
"score": 0.657563,
"sql_verified": false
},
{
"doc_id": "W500K-31437",
"chunk_text": "Marcus D. Taylor — Maintenance Tech in Knoxville, TN. Skills: Excel|PLC|bilingual|electrical|hazmat|overhead crane|pneumatics|preventive maintenance. Certs: OSHA-30|ServSafe. Archetype: flexible. Reliability: 0.77, Availability: 0.81",
"score": 0.6575081,
"sql_verified": false
},
{
"doc_id": "W500K-15283",
"chunk_text": "Margaret V. Thomas — Assembler in Lexington, KY. Skills: CMM|SPC|conveyor ops|gauge R&R|inspection|lean manufacturing|nonconformance|quality inspection|root cause analysis. Certs: OSHA-10|OSHA-30|Hazmat|Lockout/Tagout. Archetype: communicator. Reliability: 0.75, Availability: 0.71",
"score": 0.65683407,
"sql_verified": false
},
{
"doc_id": "W500K-31718",
"chunk_text": "Cynthia Y. Adams — Forklift Operator in Nashville, TN. Skills: RF scanner|bilingual|confined space|first aid|forklift|inventory|loading dock|overhead crane|packaging|team lead. Certs: OSHA-10. Archetype: specialist. Reliability: 0.78, Availability: 0.76",
"score": 0.65660185,
"sql_verified": false
},
{
"doc_id": "W500K-26414",
"chunk_text": "Shirley Y. Roberts — Welder in Lansing, MI. Skills: CMMS|EDM|calipers|welding. Certs: First Aid/CPR|Reach Truck. Archetype: reliable. Reliability: 0.89, Availability: 0.42",
"score": 0.6558558,
"sql_verified": false
},
{
"doc_id": "W500K-36161",
"chunk_text": "Rachel V. Taylor — Assembler in Detroit, MI. Skills: 6S|batch processing|first article|labeling|line work|nonconformance|quality inspection. Certs: OSHA-30|Forklift. Archetype: flexible. Reliability: 0.63, Availability: 0.75",
"score": 0.65559876,
"sql_verified": false
},
{
"doc_id": "W500K-34494",
"chunk_text": "Kimberly S. James — Welder in Des Moines, IA. Skills: CMMS|EDM|GD&T|PLC|blueprint reading|calipers|mill|troubleshooting|welding. Certs: First Aid/CPR|Lockout/Tagout. Archetype: communicator. Reliability: 0.62, Availability: 0.62",
"score": 0.6553779,
"sql_verified": false
},
{
"doc_id": "W500K-33471",
"chunk_text": "Mary J. Jenkins — Shipping Clerk in Danville, IL. Skills: Excel|RF scanner|packaging|pick-to-light|receiving|shipping|team lead. Certs: OSHA-10|Forklift|ServSafe. Archetype: communicator. Reliability: 0.67, Availability: 0.75",
"score": 0.65532815,
"sql_verified": false
},
{
"doc_id": "W500K-3177",
"chunk_text": "Debra Brooks — Warehouse Associate in Lexington, KY. Skills: confined space|hazmat|inventory|loading dock|overhead crane|packaging|training. Certs: none. Archetype: improving. Reliability: 0.59, Availability: 0.62",
"score": 0.6551267,
"sql_verified": false
},
{
"doc_id": "W500K-11291",
"chunk_text": "Jeffrey Price — Production Worker in Cincinnati, OH. Skills: batch processing|confined space|conveyor ops|line work|overhead crane. Certs: Forklift|First Aid/CPR|Lockout/Tagout. Archetype: communicator. Reliability: 0.69, Availability: 0.59",
"score": 0.6547338,
"sql_verified": false
},
{
"doc_id": "W500K-750",
"chunk_text": "Christopher Scott — Material Handler in Akron, OH. Skills: RF scanner|SAP|first aid|overhead crane|receiving|shipping. Certs: Forklift|First Aid/CPR|Lockout/Tagout. Archetype: communicator. Reliability: 0.72, Availability: 0.74",
"score": 0.6546628,
"sql_verified": false
},
{
"doc_id": "W500K-17914",
"chunk_text": "Carol A. Jackson — Logistics Coordinator in Cleveland, OH. Skills: SAP|cold storage|confined space|first aid|loading dock|pick-to-light|team lead|training. Certs: OSHA-10|Forklift|First Aid/CPR|ServSafe|Fire Safety. Archetype: reliable. Reliability: 0.90, Availability: 0.94",
"score": 0.65423685,
"sql_verified": false
},
{
"doc_id": "W500K-34675",
"chunk_text": "Diane R. Ward — Assembler in Toledo, OH. Skills: assembly|batch processing|gauge R&R|inspection|nonconformance. Certs: OSHA-30|First Aid/CPR. Archetype: flexible. Reliability: 0.76, Availability: 0.80",
"score": 0.65415347,
"sql_verified": false
},
{
"doc_id": "W500K-24027",
"chunk_text": "Joseph D. Williams — Material Handler in Madison, WI. Skills: Excel|forklift|hazmat|loading dock|overhead crane|packaging|pallet jack. Certs: OSHA-30|Forklift. Archetype: reliable. Reliability: 0.83, Availability: 0.79",
"score": 0.654148,
"sql_verified": false
},
{
"doc_id": "W500K-40121",
"chunk_text": "Frank D. Ruiz — Packaging Operator in Cincinnati, OH. Skills: 6S|RF scanner|batch processing|conveyor ops|line work|loading dock|quality inspection. Certs: OSHA-10|First Aid/CPR. Archetype: reliable. Reliability: 0.88, Availability: 0.83",
"score": 0.65402013,
"sql_verified": false
},
{
"doc_id": "W500K-28270",
"chunk_text": "Olga I. Hughes — Warehouse Associate in Peoria, IL. Skills: confined space|inventory|loading dock|team lead|training. Certs: Forklift. Archetype: leader. Reliability: 0.78, Availability: 0.55",
"score": 0.6538595,
"sql_verified": false
},
{
"doc_id": "W500K-28759",
"chunk_text": "Fatima D. Scott — Material Handler in Evansville, IN. Skills: Excel|loading dock|overhead crane|packaging|pallet jack|team lead. Certs: OSHA-10|Reach Truck|MSDS. Archetype: flexible. Reliability: 0.74, Availability: 0.86",
"score": 0.6537685,
"sql_verified": false
},
{
"doc_id": "W500K-20898",
"chunk_text": "Linda U. Baker — Machine Operator in Green Bay, WI. Skills: CNC|EDM|batch processing|grinder|lean manufacturing|micrometer|mill. Certs: OSHA-10|Forklift|First Aid/CPR. Archetype: flexible. Reliability: 0.72, Availability: 0.59",
"score": 0.6537666,
"sql_verified": false
}
],
"duration_ms": 271
},
"at": "2026-04-21T04:07:26.405Z"
},
{
"turn": 1,
"role": "reviewer",
"model": "qwen2.5:latest",
"kind": "critique",
"content": {
"kind": "critique",
"verdict": "drift",
"notes": "The proposed candidates do not match the role 'Picker' or are not located in Joliet, IL. Please re-run the search with the correct filters: role = 'Picker', city = 'Joliet', state = 'IL', and ensure at least 4 qualified Pickers are selected."
},
"at": "2026-04-21T04:07:28.075Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 367
},
"at": "2026-04-21T04:07:30.729Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 734
},
"at": "2026-04-21T04:07:32.595Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 1105
},
"at": "2026-04-21T04:07:34.452Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Picker' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75\",\"question\":\"4 Pickers in Joliet, IL\",\"k\":20},\"rationale\":\"Re-run the sea",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Picker' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5 AND CAST(reliability AS DOUBLE) > 0.75\",\"question\":\"4 Pickers in Joliet, IL\",\"k\":20},\"rationale\":\"Re-run the sea"
},
"at": "2026-04-21T04:07:36.322Z"
}
]
},
{
"event": {
"kind": "misplacement",
"at": "15:00",
"role": "Forklift Operator",
"count": 1,
"replaces_event": "10:00",
"city": "Joliet",
"state": "IL",
"shift_start": "15:00 PM",
"scenario_note": "Staffed by Alex Rivera (trainee, 1mo). Contract deadline 2026-05-12, fill=preferred."
},
"ok": false,
"fills": [],
"turns": 0,
"duration_secs": 9.793,
"error": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Forklift Operator Joliet, IL\",\"k\":20},\"rationale\":\"Verify the top candidate from the pre",
"gap_signals": [
"drift_or_tool: invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Forklift Operator Joliet, IL\",\"k\":20},\"rationale\":\"Verify the top candidate from the pre"
],
"diagnostic_log": [
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "tool_call",
"content": {
"kind": "tool_call",
"tool": "hybrid_search",
"args": {
"index_name": "workers_500k_v1",
"sql_filter": "role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5",
"question": "Forklift Operator Joliet, IL",
"k": 20
},
"rationale": "Initial search for available Forklift Operators in Joliet, IL to fill the position."
},
"at": "2026-04-21T04:07:38.956Z"
},
{
"turn": 1,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "tool_result",
"content": {
"question": "Forklift Operator Joliet, IL",
"sql_filter": "role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5",
"sql_matches": 1178,
"vector_reranked": 20,
"method": "hybrid_sql_vector",
"answer": null,
"sources": [
{
"doc_id": "W500K-46701",
"chunk_text": "Lauren F. Adams — Forklift Operator in Joliet, IL. Skills: packaging|pallet jack|receiving|shipping|team lead|training. Certs: OSHA-10|Hazmat. Archetype: communicator. Reliability: 0.62, Availability: 0.54",
"score": 0.8781787,
"sql_verified": true,
"playbook_boost": 0.25,
"playbook_citations": [
"pb-seed-93fa5d957b98579e",
"pb-seed-8e5b7de2ee2e9c43",
"pb-seed-418fc3b2153d74de",
"pb-seed-84ca656bbdae2386"
]
},
{
"doc_id": "W500K-41031",
"chunk_text": "Joyce D. Reyes — Forklift Operator in Joliet, IL. Skills: Excel|confined space|hazmat|inventory|overhead crane|packaging|pallet jack|pick-to-light|shipping. Certs: none. Archetype: reliable. Reliability: 0.88, Availability: 0.70",
"score": 0.8727068,
"sql_verified": true,
"playbook_boost": 0.25,
"playbook_citations": [
"pb-seed-93fa5d957b98579e",
"pb-seed-8e5b7de2ee2e9c43",
"pb-seed-418fc3b2153d74de",
"pb-seed-84ca656bbdae2386"
]
},
{
"doc_id": "W500K-2372",
"chunk_text": "Joshua Taylor — Forklift Operator in Joliet, IL. Skills: RF scanner|bilingual|confined space|overhead crane|packaging|shipping. Certs: OSHA-10|Forklift. Archetype: reliable. Reliability: 0.80, Availability: 0.88",
"score": 0.84628904,
"sql_verified": true,
"playbook_boost": 0.25,
"playbook_citations": [
"pb-seed-93fa5d957b98579e",
"pb-seed-8e5b7de2ee2e9c43",
"pb-seed-418fc3b2153d74de",
"pb-seed-84ca656bbdae2386",
"pb-seed-e55b22922c0816f3",
"pb-seed-d0c65db6bf9b389b",
"pb-seed-b7e7ccbc68c01017",
"pb-seed-66c4e94f91c94e1a",
"pb-seed-095fa18610102c3b",
"pb-seed-fa246fef31bbe831"
]
},
{
"doc_id": "W500K-6584",
"chunk_text": "Sarah Davis — Forklift Operator in Joliet, IL. Skills: Excel|SAP|forklift|overhead crane|shipping. Certs: OSHA-30|Forklift|First Aid/CPR. Archetype: communicator. Reliability: 0.62, Availability: 0.76",
"score": 0.6713917,
"sql_verified": true
},
{
"doc_id": "W500K-29597",
"chunk_text": "Miguel J. Stewart — Forklift Operator in Joliet, IL. Skills: RF scanner|hazmat|pick-to-light|training. Certs: none. Archetype: flexible. Reliability: 0.71, Availability: 0.59",
"score": 0.662718,
"sql_verified": true
},
{
"doc_id": "W500K-29178",
"chunk_text": "Justin G. Cruz — Forklift Operator in Joliet, IL. Skills: SAP|first aid|hazmat|inventory|overhead crane|pallet jack|shipping. Certs: OSHA-10. Archetype: reliable. Reliability: 0.87, Availability: 0.56",
"score": 0.6563932,
"sql_verified": true
},
{
"doc_id": "W500K-35231",
"chunk_text": "Heather B. Kim — Forklift Operator in Joliet, IL. Skills: bilingual|confined space|first aid|packaging|pallet jack|receiving|team lead|training. Certs: OSHA-30. Archetype: leader. Reliability: 0.68, Availability: 0.63",
"score": 0.6527455,
"sql_verified": true
},
{
"doc_id": "W500K-7379",
"chunk_text": "Gary Foster — Forklift Operator in Joliet, IL. Skills: SAP|cold storage|confined space|forklift|overhead crane|packaging|pick-to-light. Certs: ServSafe|MSDS. Archetype: communicator. Reliability: 0.66, Availability: 0.60",
"score": 0.6454631,
"sql_verified": true
},
{
"doc_id": "W500K-2779",
"chunk_text": "Carlos Carter — Forklift Operator in Joliet, IL. Skills: Excel|SAP|bilingual|hazmat|pick-to-light|shipping|training. Certs: Lockout/Tagout. Archetype: flexible. Reliability: 0.79, Availability: 0.74",
"score": 0.6434298,
"sql_verified": true
},
{
"doc_id": "W500K-22938",
"chunk_text": "Heather G. Anderson — Forklift Operator in Joliet, IL. Skills: Excel|RF scanner|SAP|cold storage|first aid|loading dock|pallet jack|pick-to-light|training. Certs: OSHA-10|Reach Truck|Lockout/Tagout. Archetype: flexible. Reliability: 0.74, Availability: 0.65",
"score": 0.6386531,
"sql_verified": true
},
{
"doc_id": "W500K-7347",
"chunk_text": "Kyle James — Forklift Operator in Joliet, IL. Skills: RF scanner|SAP|cold storage|packaging|shipping|team lead. Certs: Forklift|First Aid/CPR|Order Picker. Archetype: flexible. Reliability: 0.79, Availability: 0.82",
"score": 0.6384795,
"sql_verified": true
},
{
"doc_id": "W500K-24977",
"chunk_text": "Elizabeth R. Miller — Forklift Operator in Joliet, IL. Skills: Excel|SAP|forklift|pick-to-light|receiving|shipping. Certs: OSHA-10|First Aid/CPR|Reach Truck. Archetype: reliable. Reliability: 0.85, Availability: 0.63",
"score": 0.6374727,
"sql_verified": true
},
{
"doc_id": "W500K-19541",
"chunk_text": "Fatima P. Parker — Forklift Operator in Joliet, IL. Skills: RF scanner|SAP|first aid|pallet jack. Certs: Forklift. Archetype: reliable. Reliability: 0.94, Availability: 0.74",
"score": 0.63650167,
"sql_verified": true
},
{
"doc_id": "W500K-28632",
"chunk_text": "Virginia G. Peterson — Forklift Operator in Joliet, IL. Skills: first aid|hazmat|inventory|overhead crane|shipping. Certs: Hazmat|MSDS. Archetype: communicator. Reliability: 0.62, Availability: 0.66",
"score": 0.63509697,
"sql_verified": true
},
{
"doc_id": "W500K-39515",
"chunk_text": "Debra V. James — Forklift Operator in Joliet, IL. Skills: RF scanner|bilingual|confined space|first aid|inventory|loading dock|pallet jack|shipping|team lead. Certs: none. Archetype: communicator. Reliability: 0.78, Availability: 0.68",
"score": 0.6348436,
"sql_verified": true
},
{
"doc_id": "W500K-27415",
"chunk_text": "Kelly L. Clark — Forklift Operator in Joliet, IL. Skills: RF scanner|confined space|forklift|hazmat. Certs: none. Archetype: leader. Reliability: 0.74, Availability: 0.74",
"score": 0.63438696,
"sql_verified": true
},
{
"doc_id": "W500K-27009",
"chunk_text": "Patrick V. Brown — Forklift Operator in Joliet, IL. Skills: Excel|RF scanner|SAP|cold storage|first aid|hazmat|shipping|team lead. Certs: OSHA-10|First Aid/CPR. Archetype: reliable. Reliability: 0.79, Availability: 0.78",
"score": 0.6341755,
"sql_verified": true
},
{
"doc_id": "W500K-33527",
"chunk_text": "Frank N. Richardson — Forklift Operator in Joliet, IL. Skills: Excel|RF scanner|SAP|bilingual|inventory|shipping|training. Certs: OSHA-10|First Aid/CPR|Reach Truck|Lockout/Tagout. Archetype: flexible. Reliability: 0.71, Availability: 0.75",
"score": 0.6321599,
"sql_verified": true
},
{
"doc_id": "W500K-176",
"chunk_text": "Rosa Thompson — Forklift Operator in Joliet, IL. Skills: bilingual|confined space|forklift|inventory|training. Certs: Lockout/Tagout. Archetype: communicator. Reliability: 0.72, Availability: 0.58",
"score": 0.6300581,
"sql_verified": true
},
{
"doc_id": "W500K-29744",
"chunk_text": "Anna A. Green — Forklift Operator in Joliet, IL. Skills: first aid|forklift|packaging|pick-to-light|training. Certs: Forklift|First Aid/CPR. Archetype: reliable. Reliability: 0.84, Availability: 0.55",
"score": 0.6286367,
"sql_verified": true
}
],
"duration_ms": 294
},
"at": "2026-04-21T04:07:39.251Z"
},
{
"turn": 1,
"role": "reviewer",
"model": "qwen2.5:latest",
"kind": "critique",
"content": {
"kind": "critique",
"verdict": "continue",
"notes": "Continue with verification of at least one candidate from Joliet, IL who is a Forklift Operator."
},
"at": "2026-04-21T04:07:40.346Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 1,
"combined_chars": 322
},
"at": "2026-04-21T04:07:42.691Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 2,
"combined_chars": 644
},
"at": "2026-04-21T04:07:44.268Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "note",
"content": {
"continuation": 3,
"combined_chars": 888
},
"at": "2026-04-21T04:07:45.451Z"
},
{
"turn": 2,
"role": "executor",
"model": "qwen2.5:latest",
"kind": "error",
"content": {
"message": "invalid JSON from executor: JSON Parse error: Expected '}' | raw: {\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Forklift Operator Joliet, IL\",\"k\":20},\"rationale\":\"Verify the top candidate from the pre",
"raw": "{\"kind\":\"tool_call\",\"tool\":\"hybrid_search\",\"args\":{\"index_name\":\"workers_500k_v1\",\"sql_filter\":\"role = 'Forklift Operator' AND city = 'Joliet' AND state = 'IL' AND CAST(availability AS DOUBLE) > 0.5\",\"question\":\"Forklift Operator Joliet, IL\",\"k\":20},\"rationale\":\"Verify the top candidate from the pre"
},
"at": "2026-04-21T04:07:46.614Z"
}
]
}
]
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-07/roster.json
+1
View File
@@ -0,0 +1 @@
[]
tests/multi-agent/playbooks/scenario-2026-04-21T04-07-07/sms.md
+1
View File
@@ -0,0 +1 @@
# SMS drafts — Midway Distribution — Joliet DC Ramp, 2026-05-02