chore: add real content that was sitting untracked
Surfaced by today's untracked-files audit. None of these are accidents —
multiple are referenced by name in CLAUDE.md and memory files but were
never added.
Categories:
- docs/PHASE_AUDIT_GUIDE.md (106 LOC) — Claude Code phase audit guidance
- ops/systemd/lakehouse-langfuse-bridge.service — Langfuse bridge unit
- package.json — top-level npm manifest
- scripts/e2e_pipeline_check.sh + production_smoke.sh — real test scripts
- reports/kimi/audit-last-week*.md — the "Two reports live" CLAUDE.md cites
- tests/multi-agent/scenarios/ — 44 staffing scenarios (cutover decision A)
- tests/multi-agent/playbooks/ — 102 playbook records
- tests/battery/, tests/agent_test/PRD.md, tests/real-world/* — real tests
- sidecar/sidecar/{lab_ui,pipeline_lab}.py — 888 LOC dev-only UIs that
remain in service post-sidecar-drop (commit ba928b1 explicitly kept them)
Sensitivity check: scenarios use synthetic company names ("Heritage Foods",
"Cornerstone Fabrication"); audit reports describe code findings only;
no PII or secrets surfaced.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
root
@@ -0,0 +1,2 @@
|
||||
{"after_event":"13:30","event_kind":"emergency","ok":true,"model":"gpt-oss:20b","duration_secs":14.805,"risk":"Double booking risk for Malik King","hint":"Verify Malik King’s calendar before assigning him to any new shift to avoid overlap."}
|
||||
{"after_event":"12:00","event_kind":"misplacement","ok":true,"model":"gpt-oss:20b","duration_secs":14.231,"risk":"Cincinnati Receiving Clerk drift risk","hint":"Use Cincinnati Receiving Clerk pool with verified tool set; schedule pre‑shift drift check; keep backup ready."}
|
||||
@@ -0,0 +1,3 @@
|
||||
{"at":"12:00","kind":"baseline_fill","operation":"fill: Assembler x1 in Cincinnati, OH","fills":[{"candidate_id":"W500K-23650","name":"Amy Q. Lewis"}],"turns":3,"duration_secs":21.889,"pool_size":869,"playbook_citations":["pb-seed-8ff7abd36e974e94"],"discovered_pattern":"Across 25 similar past playbooks (28 workers examined) · recurring certifications: OSHA-10 (46%) · archetype mostly: communicator · reliability median 0.80 (range 0.19–1.00)"}
|
||||
{"at":"17:30","kind":"recurring","operation":"fill: Welder x1 in Cincinnati, OH","fills":[{"candidate_id":"W500K-23232","name":"Betty O. Cruz"}],"turns":3,"duration_secs":15.18,"pool_size":311,"playbook_citations":[],"discovered_pattern":"Across 25 similar past playbooks (28 workers examined) · recurring certifications: OSHA-10 (46%) · archetype mostly: communicator · reliability median 0.80 (range 0.19–1.00)"}
|
||||
{"at":"13:30","kind":"emergency","operation":"fill: Material Handler x2 in Cincinnati, OH","fills":[{"candidate_id":"W500K-10726","name":"Malik King"},{"candidate_id":"W500K-2559","name":"Miguel Morris"}],"turns":3,"duration_secs":17.372,"pool_size":717,"playbook_citations":["pb-seed-9adc8d16e36a7d66"],"discovered_pattern":"Across 25 similar past playbooks (30 workers examined) · recurring certifications: OSHA-10 (47%) · archetype mostly: communicator · reliability median 0.79 (range 0.19–1.00)"}
|
||||
@@ -0,0 +1 @@
|
||||
# Client emails — Heritage Foods, 2026-05-09
|
||||
@@ -0,0 +1,6 @@
|
||||
# Cross-day lesson — Heritage Foods, 2026-05-09
|
||||
|
||||
_Generated by `gpt-oss:20b` in 4.4s. Based on 4 events + 2 mid-day checkpoints._
|
||||
|
||||
**
|
||||
Before assigning any shift to Malik King, verify his calendar to avoid double booking. For the Cincinnati Receiving Clerk, use a verified tool set, schedule a pre‑shift drift check, and keep a backup ready. Keep the pool size updated after each fill to prevent gaps. For emergency fills, confirm the required skill set is present in the pool before assigning.
|
||||
@@ -0,0 +1,70 @@
|
||||
[
|
||||
{
|
||||
"date": "2026-05-07",
|
||||
"client": "Riverfront Steel",
|
||||
"cities": "Columbus",
|
||||
"states": "OH",
|
||||
"events_total": 4,
|
||||
"events_ok": 3,
|
||||
"checkpoint_count": 2,
|
||||
"model": "gpt-oss:20b",
|
||||
"cloud": false,
|
||||
"lesson": "** \nWhen calling `hybrid_search`, first validate the executor’s JSON output against the expected schema and wrap the call in error‑handling logic to catch parse failures. If a parse error occurs, retry or fall back to a safe default before proceeding. Before assigning a new shift to any candidate, query their current schedule to confirm no overlap—especially for high‑demand staff such as Jack Kim. This double‑check prevents double‑booking and keeps pool counts accurate.",
|
||||
"checkpoints": [
|
||||
{
|
||||
"after": "17:30",
|
||||
"risk": "JSON parse failure in tool call",
|
||||
"hint": "Validate executor output format; add error handling around hybrid_search; confirm JSON schema before using results."
|
||||
},
|
||||
{
|
||||
"after": "15:30",
|
||||
"risk": "Jack Kim double-book risk",
|
||||
"hint": "Verify Jack Kim's 12:00 slot before assigning new shift to avoid overlap."
|
||||
}
|
||||
],
|
||||
"created_at": "2026-04-21T02:09:33.271Z",
|
||||
"file": "2026-05-07_Riverfront_Steel_1776737373271.json"
|
||||
},
|
||||
{
|
||||
"date": "2026-04-28",
|
||||
"client": "Riverfront Steel",
|
||||
"cities": "Toledo",
|
||||
"states": "OH",
|
||||
"events_total": 3,
|
||||
"events_ok": 2,
|
||||
"checkpoint_count": 1,
|
||||
"model": "gpt-oss:20b",
|
||||
"cloud": false,
|
||||
"lesson": "** \nBefore scheduling a Packer in Toledo, confirm the tool calibration and verify the location accuracy to mitigate drift risk. Update the pool status immediately after baseline and recurring fills so the Packer has accurate data. Schedule the Packer only after the pool is refreshed to avoid misplacement failures. Double‑check the Packer’s tool settings in the system before the shift starts.",
|
||||
"checkpoints": [
|
||||
{
|
||||
"after": "08:30",
|
||||
"risk": "Packer Toledo drift risk",
|
||||
"hint": "Check Packer's tool calibration and location accuracy in Toledo before scheduling to avoid drift errors."
|
||||
}
|
||||
],
|
||||
"created_at": "2026-04-21T01:52:09.394Z",
|
||||
"file": "2026-04-28_Riverfront_Steel_1776736329394.json"
|
||||
},
|
||||
{
|
||||
"date": "2026-04-26",
|
||||
"client": "Apex Warehouse",
|
||||
"cities": "Cleveland",
|
||||
"states": "OH",
|
||||
"events_total": 3,
|
||||
"events_ok": 2,
|
||||
"checkpoint_count": 1,
|
||||
"model": "gpt-oss:20b",
|
||||
"cloud": false,
|
||||
"lesson": "** \nWhen an expansion event is scheduled before a recurring event, always pre‑fetch the availability of every candidate slated for the recurring slot (e.g., Anna Rivera, Jack K. Ramirez, Thomas J. Lewis, Brenda A. Cox, Lisa O. Diaz) at the overlapping time. Verify that none of these candidates are already assigned to the expansion or any other role before committing them to the recurring slot. Adjust the expansion or recurring schedule if any overlap is detected, and keep the pool size and turns in mind to avoid overloading the same candidates. This prevents double‑booking and ensures a smooth fill.",
|
||||
"checkpoints": [
|
||||
{
|
||||
"after": "14:30",
|
||||
"risk": "Double-booking at 15:30",
|
||||
"hint": "Verify 15:30 slot for Anna Rivera, Jack K. Ramirez, Thomas J. Lewis, Brenda A. Cox, Lisa O. Diaz before assigning new roles."
|
||||
}
|
||||
],
|
||||
"created_at": "2026-04-21T01:48:13.293Z",
|
||||
"file": "2026-04-26_Apex_Warehouse_1776736093293.json"
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1,72 @@
|
||||
# Scenario retrospective — Heritage Foods, 2026-05-09
|
||||
|
||||
Executor: `qwen3.5:latest` Reviewer: `qwen3:latest` Draft: `qwen2.5:latest` Overview(T3): `gpt-oss:20b`
|
||||
Prior lessons loaded into executor context: **3** (from 2026-05-07, 2026-04-28, 2026-04-26)
|
||||
|
||||
## Events
|
||||
|
||||
| At | Kind | Role / Count | Pool | Fills | Turns | Dur(s) | Cites | Gaps |
|
||||
|---|---|---|---|---|---|---|---|---|
|
||||
| 12:00 | baseline_fill | Assembler × 1 | 869 | ✓ 1 | 3 | 21.9 | 1 | 1 |
|
||||
| 17:30 | recurring | Welder × 1 | 311 | ✓ 1 | 3 | 15.2 | 0 | 2 |
|
||||
| 13:30 | emergency | Material Handler × 2 | 717 | ✓ 2 | 3 | 17.4 | 1 | 3 |
|
||||
| 12:00 | misplacement | Receiving Clerk × 1 | - | ✗ 0 | 0 | 25.1 | 0 | 1 |
|
||||
|
||||
## Final roster
|
||||
|
||||
| Worker | Booked | Role | City, ST | Status |
|
||||
|---|---|---|---|---|
|
||||
| undefined Amy Q. Lewis | 12:00 | Assembler | Cincinnati, OH | no_show |
|
||||
| undefined Betty O. Cruz | 17:30 | Welder | Cincinnati, OH | confirmed |
|
||||
| undefined Malik King | 13:30 | Material Handler | Cincinnati, OH | confirmed |
|
||||
| undefined Miguel Morris | 13:30 | Material Handler | Cincinnati, OH | confirmed |
|
||||
|
||||
## Gap signals
|
||||
|
||||
### artifact
|
||||
- **12:00** — undefined is not an object (evaluating 'f.reason.slice')
|
||||
- **17:30** — undefined is not an object (evaluating 'f.reason.slice')
|
||||
- **13:30** — undefined is not an object (evaluating 'f.reason.slice')
|
||||
|
||||
### double_book
|
||||
- **17:30** — undefined Betty O. Cruz already booked for 12:00
|
||||
- **13:30** — undefined Malik King already booked for 12:00
|
||||
- **13:30** — undefined Miguel Morris already booked for 12:00
|
||||
|
||||
### drift_or_tool
|
||||
- **12:00** — aborted — 3 consecutive drift flags
|
||||
|
||||
### fairness
|
||||
- _cross-event_ — Amy Q. Lewis (undefined) booked 3 times today
|
||||
|
||||
### write_through_audit
|
||||
- _post-run_ — playbook_memory has 1558 entries (ran 4 events, expected ≥ 3 new entries from this run)
|
||||
|
||||
## Workers touched across the week
|
||||
|
||||
5 distinct workers made it through to a decision. Every one is accounted for below — no-shows flagged, rebookings noted, everyone visible.
|
||||
|
||||
| Worker ID | Name | Events | Outcome |
|
||||
|---|---|---|---|
|
||||
| 23650 | Amy Q. Lewis | 12:00 baseline_fill | booked |
|
||||
| 23232 | Betty O. Cruz | 17:30 recurring | booked |
|
||||
| W500K-10726 | Malik King | 13:30 emergency | booked |
|
||||
| W500K-2559 | Miguel Morris | 13:30 emergency | booked |
|
||||
| undefined | Amy Q. Lewis | 12:00 | no_show |
|
||||
|
||||
## Discovered patterns (meta-index)
|
||||
|
||||
What the system identified across semantically-similar past fills as each event ran:
|
||||
|
||||
- **12:00 baseline_fill** (Assembler): Across 25 similar past playbooks (28 workers examined) · recurring certifications: OSHA-10 (46%) · archetype mostly: communicator · reliability median 0.80 (range 0.19–1.00)
|
||||
- **17:30 recurring** (Welder): Across 25 similar past playbooks (28 workers examined) · recurring certifications: OSHA-10 (46%) · archetype mostly: communicator · reliability median 0.80 (range 0.19–1.00)
|
||||
- **13:30 emergency** (Material Handler): Across 25 similar past playbooks (30 workers examined) · recurring certifications: OSHA-10 (47%) · archetype mostly: communicator · reliability median 0.79 (range 0.19–1.00)
|
||||
- **12:00 misplacement** (Receiving Clerk): —
|
||||
|
||||
## Narrative
|
||||
|
||||
- 3/4 events reached consensus.
|
||||
- Final roster: 4 bookings across 1 distinct workers.
|
||||
- Workers touched (booked, failed, or otherwise decided): 5.
|
||||
- Playbook citations across the day: 2 (proof the feedback loop fired across events).
|
||||
- Dropped events: 12:00 misplacement.
|
||||
@@ -0,0 +1,120 @@
|
||||
[
|
||||
{
|
||||
"event": {
|
||||
"kind": "baseline_fill",
|
||||
"at": "12:00",
|
||||
"role": "Assembler",
|
||||
"count": 1,
|
||||
"city": "Cincinnati",
|
||||
"state": "OH",
|
||||
"shift_start": "12:00 AM"
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "23650",
|
||||
"name": "Amy Q. Lewis"
|
||||
}
|
||||
],
|
||||
"turns": 3,
|
||||
"duration_secs": 21.889,
|
||||
"gap_signals": [
|
||||
"artifact: undefined is not an object (evaluating 'f.reason.slice')"
|
||||
],
|
||||
"sources_first_score": 0.8443585,
|
||||
"sources_last_score": 0.64058805,
|
||||
"pool_size": 869,
|
||||
"playbook_citations": [
|
||||
"pb-seed-8ff7abd36e974e94"
|
||||
],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (28 workers examined) · recurring certifications: OSHA-10 (46%) · archetype mostly: communicator · reliability median 0.80 (range 0.19–1.00)"
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "recurring",
|
||||
"at": "17:30",
|
||||
"role": "Welder",
|
||||
"count": 1,
|
||||
"city": "Cincinnati",
|
||||
"state": "OH",
|
||||
"shift_start": "17:30 AM"
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "23232",
|
||||
"name": "Betty O. Cruz"
|
||||
}
|
||||
],
|
||||
"turns": 3,
|
||||
"duration_secs": 15.18,
|
||||
"gap_signals": [
|
||||
"double_book: undefined Betty O. Cruz already booked for 12:00",
|
||||
"artifact: undefined is not an object (evaluating 'f.reason.slice')"
|
||||
],
|
||||
"sources_first_score": 0.5287675,
|
||||
"sources_last_score": 0.4589753,
|
||||
"pool_size": 311,
|
||||
"playbook_citations": [],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (28 workers examined) · recurring certifications: OSHA-10 (46%) · archetype mostly: communicator · reliability median 0.80 (range 0.19–1.00)"
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "emergency",
|
||||
"at": "13:30",
|
||||
"role": "Material Handler",
|
||||
"count": 2,
|
||||
"city": "Cincinnati",
|
||||
"state": "OH",
|
||||
"shift_start": "13:30 AM"
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "W500K-10726",
|
||||
"name": "Malik King"
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-2559",
|
||||
"name": "Miguel Morris"
|
||||
}
|
||||
],
|
||||
"turns": 3,
|
||||
"duration_secs": 17.372,
|
||||
"gap_signals": [
|
||||
"double_book: undefined Malik King already booked for 12:00",
|
||||
"double_book: undefined Miguel Morris already booked for 12:00",
|
||||
"artifact: undefined is not an object (evaluating 'f.reason.slice')"
|
||||
],
|
||||
"sources_first_score": 0.72586256,
|
||||
"sources_last_score": 0.5549024,
|
||||
"pool_size": 717,
|
||||
"playbook_citations": [
|
||||
"pb-seed-9adc8d16e36a7d66"
|
||||
],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (30 workers examined) · recurring certifications: OSHA-10 (47%) · archetype mostly: communicator · reliability median 0.79 (range 0.19–1.00)"
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "misplacement",
|
||||
"at": "12:00",
|
||||
"role": "Receiving Clerk",
|
||||
"count": 1,
|
||||
"city": "Cincinnati",
|
||||
"state": "OH",
|
||||
"shift_start": "12:00 AM",
|
||||
"replaces_event": "12:00",
|
||||
"exclude_worker_ids": [
|
||||
null
|
||||
]
|
||||
},
|
||||
"ok": false,
|
||||
"fills": [],
|
||||
"turns": 0,
|
||||
"duration_secs": 25.098,
|
||||
"error": "aborted — 3 consecutive drift flags",
|
||||
"gap_signals": [
|
||||
"drift_or_tool: aborted — 3 consecutive drift flags"
|
||||
]
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1,34 @@
|
||||
[
|
||||
{
|
||||
"name": "Amy Q. Lewis",
|
||||
"booked_for": "12:00",
|
||||
"role": "Assembler",
|
||||
"city": "Cincinnati",
|
||||
"state": "OH",
|
||||
"status": "no_show"
|
||||
},
|
||||
{
|
||||
"name": "Betty O. Cruz",
|
||||
"booked_for": "17:30",
|
||||
"role": "Welder",
|
||||
"city": "Cincinnati",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Malik King",
|
||||
"booked_for": "13:30",
|
||||
"role": "Material Handler",
|
||||
"city": "Cincinnati",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Miguel Morris",
|
||||
"booked_for": "13:30",
|
||||
"role": "Material Handler",
|
||||
"city": "Cincinnati",
|
||||
"state": "OH",
|
||||
"status": "confirmed"
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1 @@
|
||||
# SMS drafts — Heritage Foods, 2026-05-09
|
||||
Reference in New Issue
Block a user