chore: add real content that was sitting untracked
Surfaced by today's untracked-files audit. None of these are accidents —
multiple are referenced by name in CLAUDE.md and memory files but were
never added.
Categories:
- docs/PHASE_AUDIT_GUIDE.md (106 LOC) — Claude Code phase audit guidance
- ops/systemd/lakehouse-langfuse-bridge.service — Langfuse bridge unit
- package.json — top-level npm manifest
- scripts/e2e_pipeline_check.sh + production_smoke.sh — real test scripts
- reports/kimi/audit-last-week*.md — the "Two reports live" CLAUDE.md cites
- tests/multi-agent/scenarios/ — 44 staffing scenarios (cutover decision A)
- tests/multi-agent/playbooks/ — 102 playbook records
- tests/battery/, tests/agent_test/PRD.md, tests/real-world/* — real tests
- sidecar/sidecar/{lab_ui,pipeline_lab}.py — 888 LOC dev-only UIs that
remain in service post-sidecar-drop (commit ba928b1 explicitly kept them)
Sensitivity check: scenarios use synthetic company names ("Heritage Foods",
"Cornerstone Fabrication"); audit reports describe code findings only;
no PII or secrets surfaced.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
root
@@ -0,0 +1,2 @@
|
||||
{"at":"12:15","kind":"expansion","operation":"fill: Forklift Operator x5 in Toledo, OH","fills":[{"candidate_id":"W500K-37736","name":"Jennifer K. Robinson","reason":"Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."},{"candidate_id":"W500K-33961","name":"Kyle F. Brooks","reason":"Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."},{"candidate_id":"W500K-31297","name":"Jacob T. Diaz","reason":"Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."},{"candidate_id":"W500K-40884","name":"Jerry M. Jones","reason":"Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."},{"candidate_id":"W500K-37729","name":"Jeffrey D. Taylor","reason":"Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."}],"turns":7,"duration_secs":28.23,"pool_size":687,"playbook_citations":[],"discovered_pattern":"Across 25 similar past playbooks (10 workers examined) · recurring certifications: Forklift (40%), OSHA-10 (40%) · recurring skills: mill (40%) · archetype mostly: leader · reliability median 0.83 (range 0.66–0.96)"}
|
||||
{"at":"14:00","kind":"emergency","operation":"fill: Loader x4 in Toledo, OH","fills":[{"candidate_id":"W500K-15305","name":"Mary R. Richardson","reason":"Verified availability score of 0.988 via SQL and ranked highest among the candidates with an availability score greater than 0.7."},{"candidate_id":"W500K-12325","name":"Raj Torres","reason":"Ranked second among the candidates with an availability score greater than 0.7."},{"candidate_id":"W500K-16975","name":"Brian X. Price","reason":"Ranked third among the candidates with an availability score greater than 0.7."},{"candidate_id":"W500K-22851","name":"Fatima X. Gutierrez","reason":"Ranked fourth among the candidates with an availability score greater than 0.7."}],"turns":6,"duration_secs":22.25,"pool_size":380,"playbook_citations":[],"discovered_pattern":"Across 25 similar past playbooks (9 workers examined) · recurring certifications: Forklift (44%) · recurring skills: mill (44%) · archetype mostly: leader · reliability median 0.80 (range 0.66–0.96)"}
|
||||
@@ -0,0 +1,40 @@
|
||||
# Client emails — Riverfront Steel, 2026-04-21
|
||||
|
||||
## 12:15 expansion — Forklift Operator x5
|
||||
|
||||
Subject: 5 Workers Confirmed
|
||||
|
||||
Dear Riverfront Steel Team,
|
||||
|
||||
We are pleased to confirm that we have filled all five positions for Forklift Operators at your new warehouse location opening. The workers starting at 01:00 PM today are:
|
||||
|
||||
- Jennifer K. Robinson
|
||||
- Kyle F. Brooks
|
||||
- Jacob T. Diaz
|
||||
- Jerry M. Jones
|
||||
- Jeffrey D. Taylor
|
||||
|
||||
Each meets the criteria of being a Forklift Operator in Toledo, OH.
|
||||
|
||||
Best regards,
|
||||
Dispatch Team Lakehouse
|
||||
|
||||
## 14:00 emergency — Loader x4
|
||||
|
||||
Subject: 4 Loader Workers Confirmed
|
||||
|
||||
Dear Riverfront Steel Team,
|
||||
|
||||
I am pleased to confirm that we have filled all four loader positions as requested:
|
||||
|
||||
- Mary R. Richardson
|
||||
- Raj Torres
|
||||
- Brian X. Price
|
||||
- Fatima X. Gutierrez
|
||||
|
||||
All workers will start their shift at 04:00 PM today. Please note the walkoff incident requiring a replacement crew by 16:00 sharp.
|
||||
|
||||
Thank you for your trust in Lakehouse Dispatch.
|
||||
|
||||
Best regards,
|
||||
Dispatch Team
|
||||
@@ -0,0 +1,85 @@
|
||||
# Scenario retrospective — Riverfront Steel, 2026-04-21
|
||||
|
||||
Executor: `mistral:latest` Reviewer: `qwen2.5:latest` Draft: `qwen2.5:latest`
|
||||
|
||||
## Events
|
||||
|
||||
| At | Kind | Role / Count | Pool | Fills | Turns | Dur(s) | Cites | Gaps |
|
||||
|---|---|---|---|---|---|---|---|---|
|
||||
| 08:00 | baseline_fill | Warehouse Associate × 3 | - | ✗ 0 | 0 | 20.2 | 0 | 1 |
|
||||
| 10:30 | recurring | Machine Operator × 2 | - | ✗ 0 | 0 | 47.4 | 0 | 1 |
|
||||
| 12:15 | expansion | Forklift Operator × 5 | 687 | ✓ 5 | 7 | 28.2 | 0 | 4 |
|
||||
| 14:00 | emergency | Loader × 4 | 380 | ✓ 4 | 6 | 22.3 | 0 | 4 |
|
||||
| 15:45 | misplacement | Warehouse Associate × 1 | - | ✗ 0 | 0 | 52.5 | 0 | 1 |
|
||||
|
||||
## Final roster
|
||||
|
||||
| Worker | Booked | Role | City, ST | Status |
|
||||
|---|---|---|---|---|
|
||||
| undefined Jennifer K. Robinson | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||||
| undefined Kyle F. Brooks | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||||
| undefined Jacob T. Diaz | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||||
| undefined Jerry M. Jones | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||||
| undefined Jeffrey D. Taylor | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||||
| undefined Mary R. Richardson | 14:00 | Loader | Toledo, OH | confirmed |
|
||||
| undefined Raj Torres | 14:00 | Loader | Toledo, OH | confirmed |
|
||||
| undefined Brian X. Price | 14:00 | Loader | Toledo, OH | confirmed |
|
||||
| undefined Fatima X. Gutierrez | 14:00 | Loader | Toledo, OH | confirmed |
|
||||
|
||||
## Gap signals
|
||||
|
||||
### drift_or_tool
|
||||
- **08:00** — invalid JSON from executor: JSON Parse error: Invalid escape character ' | raw: {"kind":"plan","steps":["TOOL_CALL hybrid_search({'index_name':'workers_500k_v1','sql_filter':'role = \'Warehouse Associate\' AND city = \'Toledo\' AND state = \'OH\' AND CAST(availability AS DOUBLE) > 0.5','question':'reliable warehouse associate Toledo'})",
|
||||
"TOOL_CALL sql({'query':'SELECT worker_i
|
||||
- **10:30** — no consensus after 14 turns
|
||||
- **15:45** — no consensus after 14 turns
|
||||
|
||||
### double_book
|
||||
- **12:15** — undefined Kyle F. Brooks already booked for 12:15
|
||||
- **12:15** — undefined Jacob T. Diaz already booked for 12:15
|
||||
- **12:15** — undefined Jerry M. Jones already booked for 12:15
|
||||
- **12:15** — undefined Jeffrey D. Taylor already booked for 12:15
|
||||
- **14:00** — undefined Mary R. Richardson already booked for 12:15
|
||||
- **14:00** — undefined Raj Torres already booked for 12:15
|
||||
- **14:00** — undefined Brian X. Price already booked for 12:15
|
||||
- **14:00** — undefined Fatima X. Gutierrez already booked for 12:15
|
||||
|
||||
### fairness
|
||||
- _cross-event_ — Jennifer K. Robinson (undefined) booked 9 times today
|
||||
|
||||
### write_through_audit
|
||||
- _post-run_ — playbook_memory has 167 entries (ran 5 events, expected ≥ 2 new entries from this run)
|
||||
|
||||
## Workers touched across the week
|
||||
|
||||
9 distinct workers made it through to a decision. Every one is accounted for below — no-shows flagged, rebookings noted, everyone visible.
|
||||
|
||||
| Worker ID | Name | Events | Outcome |
|
||||
|---|---|---|---|
|
||||
| W500K-37736 | Jennifer K. Robinson | 12:15 expansion | booked |
|
||||
| W500K-33961 | Kyle F. Brooks | 12:15 expansion | booked |
|
||||
| W500K-31297 | Jacob T. Diaz | 12:15 expansion | booked |
|
||||
| W500K-40884 | Jerry M. Jones | 12:15 expansion | booked |
|
||||
| W500K-37729 | Jeffrey D. Taylor | 12:15 expansion | booked |
|
||||
| W500K-15305 | Mary R. Richardson | 14:00 emergency | booked |
|
||||
| W500K-12325 | Raj Torres | 14:00 emergency | booked |
|
||||
| W500K-16975 | Brian X. Price | 14:00 emergency | booked |
|
||||
| W500K-22851 | Fatima X. Gutierrez | 14:00 emergency | booked |
|
||||
|
||||
## Discovered patterns (meta-index)
|
||||
|
||||
What the system identified across semantically-similar past fills as each event ran:
|
||||
|
||||
- **08:00 baseline_fill** (Warehouse Associate): —
|
||||
- **10:30 recurring** (Machine Operator): —
|
||||
- **12:15 expansion** (Forklift Operator): Across 25 similar past playbooks (10 workers examined) · recurring certifications: Forklift (40%), OSHA-10 (40%) · recurring skills: mill (40%) · archetype mostly: leader · reliability median 0.83 (range 0.66–0.96)
|
||||
- **14:00 emergency** (Loader): Across 25 similar past playbooks (9 workers examined) · recurring certifications: Forklift (44%) · recurring skills: mill (44%) · archetype mostly: leader · reliability median 0.80 (range 0.66–0.96)
|
||||
- **15:45 misplacement** (Warehouse Associate): —
|
||||
|
||||
## Narrative
|
||||
|
||||
- 2/5 events reached consensus.
|
||||
- Final roster: 9 bookings across 1 distinct workers.
|
||||
- Workers touched (booked, failed, or otherwise decided): 9.
|
||||
- Playbook citations across the day: 0 (proof the feedback loop fired across events).
|
||||
- Dropped events: 08:00 baseline_fill, 10:30 recurring, 15:45 misplacement.
|
||||
@@ -0,0 +1,165 @@
|
||||
[
|
||||
{
|
||||
"event": {
|
||||
"kind": "baseline_fill",
|
||||
"at": "08:00",
|
||||
"role": "Warehouse Associate",
|
||||
"count": 3,
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"shift_start": "08:00 AM",
|
||||
"scenario_note": "Regular Monday morning shift, 8-hour."
|
||||
},
|
||||
"ok": false,
|
||||
"fills": [],
|
||||
"turns": 0,
|
||||
"duration_secs": 20.215,
|
||||
"error": "invalid JSON from executor: JSON Parse error: Invalid escape character ' | raw: {\"kind\":\"plan\",\"steps\":[\"TOOL_CALL hybrid_search({'index_name':'workers_500k_v1','sql_filter':'role = \\'Warehouse Associate\\' AND city = \\'Toledo\\' AND state = \\'OH\\' AND CAST(availability AS DOUBLE) > 0.5','question':'reliable warehouse associate Toledo'})\",\n\"TOOL_CALL sql({'query':'SELECT worker_i",
|
||||
"gap_signals": [
|
||||
"drift_or_tool: invalid JSON from executor: JSON Parse error: Invalid escape character ' | raw: {\"kind\":\"plan\",\"steps\":[\"TOOL_CALL hybrid_search({'index_name':'workers_500k_v1','sql_filter':'role = \\'Warehouse Associate\\' AND city = \\'Toledo\\' AND state = \\'OH\\' AND CAST(availability AS DOUBLE) > 0.5','question':'reliable warehouse associate Toledo'})\",\n\"TOOL_CALL sql({'query':'SELECT worker_i"
|
||||
]
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "recurring",
|
||||
"at": "10:30",
|
||||
"role": "Machine Operator",
|
||||
"count": 2,
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"shift_start": "11:00 AM",
|
||||
"scenario_note": "Recurring Tuesday/Thursday slot — prior workers may still be available."
|
||||
},
|
||||
"ok": false,
|
||||
"fills": [],
|
||||
"turns": 0,
|
||||
"duration_secs": 47.392,
|
||||
"error": "no consensus after 14 turns",
|
||||
"gap_signals": [
|
||||
"drift_or_tool: no consensus after 14 turns"
|
||||
]
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "expansion",
|
||||
"at": "12:15",
|
||||
"role": "Forklift Operator",
|
||||
"count": 5,
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"shift_start": "01:00 PM",
|
||||
"scenario_note": "New warehouse location opening, five-worker team needed."
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "W500K-37736",
|
||||
"name": "Jennifer K. Robinson",
|
||||
"reason": "Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-33961",
|
||||
"name": "Kyle F. Brooks",
|
||||
"reason": "Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-31297",
|
||||
"name": "Jacob T. Diaz",
|
||||
"reason": "Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-40884",
|
||||
"name": "Jerry M. Jones",
|
||||
"reason": "Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-37729",
|
||||
"name": "Jeffrey D. Taylor",
|
||||
"reason": "Meets the criteria of being a Forklift Operator in Toledo, OH with availability and reliability above the specified thresholds."
|
||||
}
|
||||
],
|
||||
"turns": 7,
|
||||
"duration_secs": 28.23,
|
||||
"gap_signals": [
|
||||
"double_book: undefined Kyle F. Brooks already booked for 12:15",
|
||||
"double_book: undefined Jacob T. Diaz already booked for 12:15",
|
||||
"double_book: undefined Jerry M. Jones already booked for 12:15",
|
||||
"double_book: undefined Jeffrey D. Taylor already booked for 12:15"
|
||||
],
|
||||
"sources_first_score": 0.6336688,
|
||||
"sources_last_score": 0.55183524,
|
||||
"pool_size": 687,
|
||||
"playbook_citations": [],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (10 workers examined) · recurring certifications: Forklift (40%), OSHA-10 (40%) · recurring skills: mill (40%) · archetype mostly: leader · reliability median 0.83 (range 0.66–0.96)"
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "emergency",
|
||||
"at": "14:00",
|
||||
"role": "Loader",
|
||||
"count": 4,
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"shift_start": "04:00 PM same day",
|
||||
"deadline": "16:00",
|
||||
"scenario_note": "Walkoff incident — replacement crew needed by 16:00 sharp."
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "W500K-15305",
|
||||
"name": "Mary R. Richardson",
|
||||
"reason": "Verified availability score of 0.988 via SQL and ranked highest among the candidates with an availability score greater than 0.7."
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-12325",
|
||||
"name": "Raj Torres",
|
||||
"reason": "Ranked second among the candidates with an availability score greater than 0.7."
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-16975",
|
||||
"name": "Brian X. Price",
|
||||
"reason": "Ranked third among the candidates with an availability score greater than 0.7."
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-22851",
|
||||
"name": "Fatima X. Gutierrez",
|
||||
"reason": "Ranked fourth among the candidates with an availability score greater than 0.7."
|
||||
}
|
||||
],
|
||||
"turns": 6,
|
||||
"duration_secs": 22.25,
|
||||
"gap_signals": [
|
||||
"double_book: undefined Mary R. Richardson already booked for 12:15",
|
||||
"double_book: undefined Raj Torres already booked for 12:15",
|
||||
"double_book: undefined Brian X. Price already booked for 12:15",
|
||||
"double_book: undefined Fatima X. Gutierrez already booked for 12:15"
|
||||
],
|
||||
"sources_first_score": 0.73792297,
|
||||
"sources_last_score": 0.7001053,
|
||||
"pool_size": 380,
|
||||
"playbook_citations": [],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (9 workers examined) · recurring certifications: Forklift (44%) · recurring skills: mill (44%) · archetype mostly: leader · reliability median 0.80 (range 0.66–0.96)"
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "misplacement",
|
||||
"at": "15:45",
|
||||
"role": "Warehouse Associate",
|
||||
"count": 1,
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"shift_start": "remainder of 08:00 shift",
|
||||
"scenario_note": "One worker from the 08:00 fill didn't show; rebuild the gap.",
|
||||
"replaces_event": "08:00"
|
||||
},
|
||||
"ok": false,
|
||||
"fills": [],
|
||||
"turns": 0,
|
||||
"duration_secs": 52.523,
|
||||
"error": "no consensus after 14 turns",
|
||||
"gap_signals": [
|
||||
"drift_or_tool: no consensus after 14 turns"
|
||||
]
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1,74 @@
|
||||
[
|
||||
{
|
||||
"name": "Jennifer K. Robinson",
|
||||
"booked_for": "12:15",
|
||||
"role": "Forklift Operator",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Kyle F. Brooks",
|
||||
"booked_for": "12:15",
|
||||
"role": "Forklift Operator",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Jacob T. Diaz",
|
||||
"booked_for": "12:15",
|
||||
"role": "Forklift Operator",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Jerry M. Jones",
|
||||
"booked_for": "12:15",
|
||||
"role": "Forklift Operator",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Jeffrey D. Taylor",
|
||||
"booked_for": "12:15",
|
||||
"role": "Forklift Operator",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Mary R. Richardson",
|
||||
"booked_for": "14:00",
|
||||
"role": "Loader",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Raj Torres",
|
||||
"booked_for": "14:00",
|
||||
"role": "Loader",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Brian X. Price",
|
||||
"booked_for": "14:00",
|
||||
"role": "Loader",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Fatima X. Gutierrez",
|
||||
"booked_for": "14:00",
|
||||
"role": "Loader",
|
||||
"city": "Toledo",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1,46 @@
|
||||
# SMS drafts — Riverfront Steel, 2026-04-21
|
||||
|
||||
## 12:15 expansion — Forklift Operator x5 in Toledo, OH
|
||||
|
||||
TO: Jennifer K. Robinson
|
||||
Confirming your shift as a Forklift Operator at Riverfront Steel's new warehouse in Toledo, OH starting 1:00 PM.
|
||||
|
||||
---
|
||||
|
||||
TO: Kyle F. Brooks
|
||||
Your shift as a Forklift Operator at the new Toledo, OH warehouse starts at 1:00 PM today.
|
||||
|
||||
---
|
||||
|
||||
TO: Jacob T. Diaz
|
||||
Confirm your shift as a Forklift Operator at Riverfront Steel's new Toledo, OH location starting at 1:00 PM.
|
||||
|
||||
---
|
||||
|
||||
TO: Jerry M. Jones
|
||||
Your shift as a Forklift Operator at the new Toledo, OH warehouse starts at 1:00 PM today.
|
||||
|
||||
---
|
||||
|
||||
TO: Jeffrey D. Taylor
|
||||
Confirming your shift as a Forklift Operator at Riverfront Steel's new warehouse in Toledo, OH starting 1:00 PM.
|
||||
|
||||
## 14:00 emergency — Loader x4 in Toledo, OH
|
||||
|
||||
TO: Mary R. Richardson
|
||||
Confirming your shift start at 4 PM today as a replacement. See you at Toledo, OH.
|
||||
|
||||
---
|
||||
|
||||
TO: Raj Torres
|
||||
Replacing shift starting now at 4 PM. Toledo, OH.
|
||||
|
||||
---
|
||||
|
||||
TO: Brian X. Price
|
||||
You're on at 4 PM replacing the crew. Toledo, OH.
|
||||
|
||||
---
|
||||
|
||||
TO: Fatima X. Gutierrez
|
||||
Confirming your walkoff shift start at 4 PM today. Toledo, OH.
|
||||
Reference in New Issue
Block a user