chore: add real content that was sitting untracked
Surfaced by today's untracked-files audit. None of these are accidents —
multiple are referenced by name in CLAUDE.md and memory files but were
never added.
Categories:
- docs/PHASE_AUDIT_GUIDE.md (106 LOC) — Claude Code phase audit guidance
- ops/systemd/lakehouse-langfuse-bridge.service — Langfuse bridge unit
- package.json — top-level npm manifest
- scripts/e2e_pipeline_check.sh + production_smoke.sh — real test scripts
- reports/kimi/audit-last-week*.md — the "Two reports live" CLAUDE.md cites
- tests/multi-agent/scenarios/ — 44 staffing scenarios (cutover decision A)
- tests/multi-agent/playbooks/ — 102 playbook records
- tests/battery/, tests/agent_test/PRD.md, tests/real-world/* — real tests
- sidecar/sidecar/{lab_ui,pipeline_lab}.py — 888 LOC dev-only UIs that
remain in service post-sidecar-drop (commit ba928b1 explicitly kept them)
Sensitivity check: scenarios use synthetic company names ("Heritage Foods",
"Cornerstone Fabrication"); audit reports describe code findings only;
no PII or secrets surfaced.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,2 @@
|
||||
{"after_event":"10:00","event_kind":"emergency","ok":true,"model":"gpt-oss:20b","duration_secs":25.091,"risk":"Double booking risk: Sharon, Gregory","hint":"Confirm Sharon Hughes and Gregory T. Roberts are not booked at 14:00, and review the f.reason.slice error in the playbook."}
|
||||
{"after_event":"14:30","event_kind":"misplacement","ok":true,"model":"gpt-oss:20b","duration_secs":15.125,"risk":"Dorothy D. Robinson double-book","hint":"Verify Dorothy D. Robinson's schedule, avoid double-booking, and confirm f.reason is defined before assignment."}
|
||||
@@ -0,0 +1,4 @@
|
||||
{"at":"14:00","kind":"baseline_fill","operation":"fill: Quality Tech x1 in Indianapolis, IN","fills":[{"candidate_id":"W500K-41658","name":"Frank G. Roberts"}],"turns":3,"duration_secs":21.763,"pool_size":697,"playbook_citations":[],"discovered_pattern":"Across 25 similar past playbooks (23 workers examined) · recurring certifications: OSHA-10 (43%) · archetype mostly: communicator · reliability median 0.81 (range 0.59–1.00)"}
|
||||
{"at":"12:30","kind":"recurring","operation":"fill: Shipping Clerk x1 in Indianapolis, IN","fills":[{"candidate_id":"W500K-45606","name":"Kathleen C. Phillips"}],"turns":3,"duration_secs":15.243,"pool_size":556,"playbook_citations":[],"discovered_pattern":"Across 25 similar past playbooks (24 workers examined) · recurring certifications: OSHA-10 (42%) · archetype mostly: communicator · reliability median 0.81 (range 0.59–1.00)"}
|
||||
{"at":"10:00","kind":"emergency","operation":"fill: Welder x2 in Indianapolis, IN","fills":[{"candidate_id":"W500K-4163","name":"Sharon Hughes"},{"candidate_id":"W500K-34365","name":"Gregory T. Roberts"}],"turns":2,"duration_secs":10.836,"pool_size":224,"playbook_citations":[],"discovered_pattern":"Across 25 similar past playbooks (22 workers examined) · recurring certifications: OSHA-10 (45%) · archetype mostly: flexible · reliability median 0.82 (range 0.59–1.00)"}
|
||||
{"at":"14:30","kind":"misplacement","operation":"fill: Material Handler x1 in Indianapolis, IN","fills":[{"candidate_id":"W500K-27381","name":"Dorothy D. Robinson"}],"turns":3,"duration_secs":21.904,"pool_size":1075,"playbook_citations":[],"discovered_pattern":"Across 25 similar past playbooks (27 workers examined) · recurring certifications: OSHA-10 (48%) · archetype mostly: communicator · reliability median 0.80 (range 0.59–1.00)"}
|
||||
@@ -0,0 +1 @@
|
||||
# Client emails — Northland Logistics, 2026-04-29
|
||||
@@ -0,0 +1,6 @@
|
||||
# Cross-day lesson — Northland Logistics, 2026-04-29
|
||||
|
||||
_Generated by `gpt-oss:20b` in 5.3s. Based on 4 events + 2 mid-day checkpoints._
|
||||
|
||||
**
|
||||
After an emergency or misplacement event, immediately re‑validate all affected candidate schedules. Pre‑fetch the availability of Sharon Hughes, Gregory T. Roberts, and Dorothy D. Robinson for the remaining slots before assigning them. Ensure the playbook’s `f.reason` is defined and sliced correctly before any assignment to prevent double‑booking. This step eliminates the risk flagged in the checkpoints.
|
||||
@@ -0,0 +1,28 @@
|
||||
[
|
||||
{
|
||||
"date": "2026-04-21",
|
||||
"client": "Heritage Foods",
|
||||
"cities": "Indianapolis",
|
||||
"states": "IN",
|
||||
"events_total": 5,
|
||||
"events_ok": 3,
|
||||
"checkpoint_count": 2,
|
||||
"model": "gpt-oss:20b",
|
||||
"cloud": false,
|
||||
"lesson": "** \nBefore starting any expansion or recurring fill, verify the candidate pool size and skill availability; if the pool is unknown or insufficient, postpone the run. For Packer roles, perform a quick tool calibration check and confirm drift thresholds to avoid drift risk. Always cross‑check each candidate’s calendar—especially high‑volume staff like Susan X. Ruiz—to prevent double bookings. Update the booking system to flag conflicts automatically. These steps will reduce failures and keep the schedule on track.",
|
||||
"checkpoints": [
|
||||
{
|
||||
"after": "09:30",
|
||||
"risk": "Packer drift risk in Indianapolis",
|
||||
"hint": "Verify tool calibration and drift thresholds before next Packer expansion in Indianapolis."
|
||||
},
|
||||
{
|
||||
"after": "12:00",
|
||||
"risk": "Susan X. Ruiz double-booked",
|
||||
"hint": "Verify Susan X. Ruiz’s schedule before assigning; ensure no overlapping shifts; update booking system to flag conflicts."
|
||||
}
|
||||
],
|
||||
"created_at": "2026-04-21T01:33:53.135Z",
|
||||
"file": "2026-04-21_Heritage_Foods_1776735233135.json"
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1,72 @@
|
||||
# Scenario retrospective — Northland Logistics, 2026-04-29
|
||||
|
||||
Executor: `qwen3.5:latest` Reviewer: `qwen3:latest` Draft: `qwen2.5:latest` Overview(T3): `gpt-oss:20b`
|
||||
Prior lessons loaded into executor context: **1** (from 2026-04-21)
|
||||
|
||||
## Events
|
||||
|
||||
| At | Kind | Role / Count | Pool | Fills | Turns | Dur(s) | Cites | Gaps |
|
||||
|---|---|---|---|---|---|---|---|---|
|
||||
| 14:00 | baseline_fill | Quality Tech × 1 | 697 | ✓ 1 | 3 | 21.8 | 0 | 1 |
|
||||
| 12:30 | recurring | Shipping Clerk × 1 | 556 | ✓ 1 | 3 | 15.2 | 0 | 2 |
|
||||
| 10:00 | emergency | Welder × 2 | 224 | ✓ 2 | 2 | 10.8 | 0 | 3 |
|
||||
| 14:30 | misplacement | Material Handler × 1 | 1075 | ✓ 1 | 3 | 21.9 | 0 | 2 |
|
||||
|
||||
## Final roster
|
||||
|
||||
| Worker | Booked | Role | City, ST | Status |
|
||||
|---|---|---|---|---|
|
||||
| undefined Frank G. Roberts | 14:00 | Quality Tech | Indianapolis, IN | no_show |
|
||||
| undefined Kathleen C. Phillips | 12:30 | Shipping Clerk | Indianapolis, IN | confirmed |
|
||||
| undefined Sharon Hughes | 10:00 | Welder | Indianapolis, IN | confirmed |
|
||||
| undefined Gregory T. Roberts | 10:00 | Welder | Indianapolis, IN | confirmed |
|
||||
| undefined Dorothy D. Robinson | 14:30 | Material Handler | Indianapolis, IN | confirmed |
|
||||
|
||||
## Gap signals
|
||||
|
||||
### artifact
|
||||
- **14:00** — undefined is not an object (evaluating 'f.reason.slice')
|
||||
- **12:30** — undefined is not an object (evaluating 'f.reason.slice')
|
||||
- **10:00** — undefined is not an object (evaluating 'f.reason.slice')
|
||||
- **14:30** — undefined is not an object (evaluating 'f.reason.slice')
|
||||
|
||||
### double_book
|
||||
- **12:30** — undefined Kathleen C. Phillips already booked for 14:00
|
||||
- **10:00** — undefined Sharon Hughes already booked for 14:00
|
||||
- **10:00** — undefined Gregory T. Roberts already booked for 14:00
|
||||
- **14:30** — undefined Dorothy D. Robinson already booked for 12:30
|
||||
|
||||
### fairness
|
||||
- _cross-event_ — Frank G. Roberts (undefined) booked 4 times today
|
||||
|
||||
### write_through_audit
|
||||
- _post-run_ — playbook_memory has 1539 entries (ran 4 events, expected ≥ 4 new entries from this run)
|
||||
|
||||
## Workers touched across the week
|
||||
|
||||
6 distinct workers made it through to a decision. Every one is accounted for below — no-shows flagged, rebookings noted, everyone visible.
|
||||
|
||||
| Worker ID | Name | Events | Outcome |
|
||||
|---|---|---|---|
|
||||
| 41658 | Frank G. Roberts | 14:00 baseline_fill | booked |
|
||||
| 45606 | Kathleen C. Phillips | 12:30 recurring | booked |
|
||||
| W500K-4163 | Sharon Hughes | 10:00 emergency | booked |
|
||||
| W500K-34365 | Gregory T. Roberts | 10:00 emergency | booked |
|
||||
| 27381 | Dorothy D. Robinson | 14:30 misplacement | booked |
|
||||
| undefined | Frank G. Roberts | 14:00 | no_show |
|
||||
|
||||
## Discovered patterns (meta-index)
|
||||
|
||||
What the system identified across semantically-similar past fills as each event ran:
|
||||
|
||||
- **14:00 baseline_fill** (Quality Tech): Across 25 similar past playbooks (23 workers examined) · recurring certifications: OSHA-10 (43%) · archetype mostly: communicator · reliability median 0.81 (range 0.59–1.00)
|
||||
- **12:30 recurring** (Shipping Clerk): Across 25 similar past playbooks (24 workers examined) · recurring certifications: OSHA-10 (42%) · archetype mostly: communicator · reliability median 0.81 (range 0.59–1.00)
|
||||
- **10:00 emergency** (Welder): Across 25 similar past playbooks (22 workers examined) · recurring certifications: OSHA-10 (45%) · archetype mostly: flexible · reliability median 0.82 (range 0.59–1.00)
|
||||
- **14:30 misplacement** (Material Handler): Across 25 similar past playbooks (27 workers examined) · recurring certifications: OSHA-10 (48%) · archetype mostly: communicator · reliability median 0.80 (range 0.59–1.00)
|
||||
|
||||
## Narrative
|
||||
|
||||
- 4/4 events reached consensus.
|
||||
- Final roster: 5 bookings across 1 distinct workers.
|
||||
- Workers touched (booked, failed, or otherwise decided): 6.
|
||||
- Playbook citations across the day: 0 (proof the feedback loop fired across events).
|
||||
@@ -0,0 +1,126 @@
|
||||
[
|
||||
{
|
||||
"event": {
|
||||
"kind": "baseline_fill",
|
||||
"at": "14:00",
|
||||
"role": "Quality Tech",
|
||||
"count": 1,
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"shift_start": "14:00 AM"
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "41658",
|
||||
"name": "Frank G. Roberts"
|
||||
}
|
||||
],
|
||||
"turns": 3,
|
||||
"duration_secs": 21.763,
|
||||
"gap_signals": [
|
||||
"artifact: undefined is not an object (evaluating 'f.reason.slice')"
|
||||
],
|
||||
"sources_first_score": 0.594647,
|
||||
"sources_last_score": 0.5321216,
|
||||
"pool_size": 697,
|
||||
"playbook_citations": [],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (23 workers examined) · recurring certifications: OSHA-10 (43%) · archetype mostly: communicator · reliability median 0.81 (range 0.59–1.00)"
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "recurring",
|
||||
"at": "12:30",
|
||||
"role": "Shipping Clerk",
|
||||
"count": 1,
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"shift_start": "12:30 AM"
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "45606",
|
||||
"name": "Kathleen C. Phillips"
|
||||
}
|
||||
],
|
||||
"turns": 3,
|
||||
"duration_secs": 15.243,
|
||||
"gap_signals": [
|
||||
"double_book: undefined Kathleen C. Phillips already booked for 14:00",
|
||||
"artifact: undefined is not an object (evaluating 'f.reason.slice')"
|
||||
],
|
||||
"sources_first_score": 0.5120479,
|
||||
"sources_last_score": 0.45563343,
|
||||
"pool_size": 556,
|
||||
"playbook_citations": [],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (24 workers examined) · recurring certifications: OSHA-10 (42%) · archetype mostly: communicator · reliability median 0.81 (range 0.59–1.00)"
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "emergency",
|
||||
"at": "10:00",
|
||||
"role": "Welder",
|
||||
"count": 2,
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"shift_start": "10:00 AM"
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "W500K-4163",
|
||||
"name": "Sharon Hughes"
|
||||
},
|
||||
{
|
||||
"candidate_id": "W500K-34365",
|
||||
"name": "Gregory T. Roberts"
|
||||
}
|
||||
],
|
||||
"turns": 2,
|
||||
"duration_secs": 10.836,
|
||||
"gap_signals": [
|
||||
"double_book: undefined Sharon Hughes already booked for 14:00",
|
||||
"double_book: undefined Gregory T. Roberts already booked for 14:00",
|
||||
"artifact: undefined is not an object (evaluating 'f.reason.slice')"
|
||||
],
|
||||
"sources_first_score": 0.61833745,
|
||||
"sources_last_score": 0.48441836,
|
||||
"pool_size": 224,
|
||||
"playbook_citations": [],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (22 workers examined) · recurring certifications: OSHA-10 (45%) · archetype mostly: flexible · reliability median 0.82 (range 0.59–1.00)"
|
||||
},
|
||||
{
|
||||
"event": {
|
||||
"kind": "misplacement",
|
||||
"at": "14:30",
|
||||
"role": "Material Handler",
|
||||
"count": 1,
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"shift_start": "14:30 AM",
|
||||
"replaces_event": "14:00",
|
||||
"exclude_worker_ids": [
|
||||
null
|
||||
]
|
||||
},
|
||||
"ok": true,
|
||||
"fills": [
|
||||
{
|
||||
"candidate_id": "27381",
|
||||
"name": "Dorothy D. Robinson"
|
||||
}
|
||||
],
|
||||
"turns": 3,
|
||||
"duration_secs": 21.904,
|
||||
"gap_signals": [
|
||||
"double_book: undefined Dorothy D. Robinson already booked for 12:30",
|
||||
"artifact: undefined is not an object (evaluating 'f.reason.slice')"
|
||||
],
|
||||
"sources_first_score": 0.83142674,
|
||||
"sources_last_score": 0.7047336,
|
||||
"pool_size": 1075,
|
||||
"playbook_citations": [],
|
||||
"discovered_pattern": "Across 25 similar past playbooks (27 workers examined) · recurring certifications: OSHA-10 (48%) · archetype mostly: communicator · reliability median 0.80 (range 0.59–1.00)"
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1,42 @@
|
||||
[
|
||||
{
|
||||
"name": "Frank G. Roberts",
|
||||
"booked_for": "14:00",
|
||||
"role": "Quality Tech",
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"status": "no_show"
|
||||
},
|
||||
{
|
||||
"name": "Kathleen C. Phillips",
|
||||
"booked_for": "12:30",
|
||||
"role": "Shipping Clerk",
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Sharon Hughes",
|
||||
"booked_for": "10:00",
|
||||
"role": "Welder",
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Gregory T. Roberts",
|
||||
"booked_for": "10:00",
|
||||
"role": "Welder",
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"status": "confirmed"
|
||||
},
|
||||
{
|
||||
"name": "Dorothy D. Robinson",
|
||||
"booked_for": "14:30",
|
||||
"role": "Material Handler",
|
||||
"city": "Indianapolis",
|
||||
"state": "IN",
|
||||
"status": "confirmed"
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1 @@
|
||||
# SMS drafts — Northland Logistics, 2026-04-29
|
||||
Reference in New Issue
Block a user