The shadow-convo-loom is a parallel retrieval surface that runs alongside PEMCLAU's qdrant vector store. Two surfaces, same corpus, different encoding.
corpus (9,878 entries from kay-corpus + FC1/FC2 + diamonds) ├── BM25 (rank_bm25) ← token-exact · deterministic · no model · 10.1MB index │ "meek as fuck" → [doc42, doc891, doc1204] in 2ms └── qdrant pemclau-v13 ← semantic · model-dependent · nomic-embed-text · 768-dim "meek as fuck" → [Merostone UDP, GrapheneOS, ...] in 12ms
| QUERY | BM25 TOP HIT | QDRANT TOP HIT | DYBFAG |
|---|---|---|---|
| "meek as fuck sovereign fleet" | [kay] "yeah, i like it, meek as fuck yo" score=17.92 |
[Merostone UDP Standard] score=0.555 |
DIVERGE |
| "SET operations container admission proof" | [kay] Container openclaw-signals Created score=10.56 |
[LABR-GRAPHENEOS-SOVEREIGN-001] score=0.578 |
DIVERGE |
| "we do us last we are most important" | [kay] "this the most important crew" score=21.87 |
[LABR-LEMNISCATE-BATTERY-001] score=0.456 |
DIVERGE |
| "gamma1 stratum adelic pouch attractor" | [kay] subagent context block score=15.36 |
[Merostone UDP YIN/YANG] score=0.544 |
DIVERGE |
| "gate solvency chaos trial HL7 verdict" | [kay] pemos.ca/ssaf BONSAI score=15.78 |
[LABR-YINYANG-HELIX-001] score=0.559 |
DIVERGE |
query both surfaces │ ├── AGREE (both find same doc) │ → HIGH CONFIDENCE. Both layers confirm. Use this result. │ ├── BM25-ONLY (token hit, semantic miss) │ → FLEET-UNIQUE LANGUAGE. Model wasn't trained on this. │ → Candidate for MFL entry. MECIPOL D-class tag. │ ├── QDRANT-ONLY (semantic hit, token miss) │ → MODEL-DEPENDENT KNOWLEDGE. Graph connection, not lexical. │ → Good for cross-domain theory retrieval. │ └── NEITHER (both miss) → GENUINE GAP. Knowledge not yet in corpus. → Sorry filed. Ingest target for next FC flush.
| Layer | Source | Entries | Status |
|---|---|---|---|
| L0 Kay voice | kay-corpus.jsonl | 6,872 | ✅ indexed |
| L1 Loom captures | saybook/fc1/ (429 files) | 13 | ⚠️ sparse (FC1 structure) |
| L2 Fermented | saybook/fc2/ (60 files) | 165,902 → 9,872 unique | ✅ deduplicated |
| L3 Diamonds | diamond-ingest-day94-96 (8 files) | 106 | ✅ indexed |
| L4 Qdrant theory | pemclau-v11 | 18,366 | ✅ yone:6333 |
| L5 Session history | pemclau-sessions-v1 | 115,955 | ✅ yone:6333 |
| L6 Active ingest | pemclau-v13 | 79 | 🔄 sparse, growing |
When the real Spectrum CLI replaces the BM25 fallback, the shadow mesh gets a significant upgrade:
Local paths: /home/ubu-cap/openclaw-fleet/fleet-sync/loom/spectrum-shadow/ shadow-corpus.jsonl 8.1MB — 9,878 entries, one per line bm25-index.pkl 10.1MB — serialised rank_bm25 index spike-results-day97.json live query results captured Day 97 NAS mirror: /mnt/nas-diskpool/eose/shadow-convo-loom/ sync pending