Skip to content

docs(adr): ESP32-S3 micro-LLM research spike + flash-resident weight streaming (ADR-322/328) - #1680

Open
Esbroro wants to merge 2 commits into
ruvnet:mainfrom
Esbroro:feat/adr-322-esp32-micro-llm-research
Open

docs(adr): ESP32-S3 micro-LLM research spike + flash-resident weight streaming (ADR-322/328)#1680
Esbroro wants to merge 2 commits into
ruvnet:mainfrom
Esbroro:feat/adr-322-esp32-micro-llm-research

Conversation

@Esbroro

@Esbroro Esbroro commented Aug 22, 2026

Copy link
Copy Markdown

Summary

Recovers and lands a bounded research spike into on-device micro-LLM inference on ESP32-S3, originally drafted 2026-08-16 on an unmerged branch that fell behind main.

  • ADR-322 (renumbered from ADR-324): ESP32-S3 micro-LLM inference is a bounded, optional research spike on dedicated companion hardware — and explicitly a non-goal for production CSI node firmware. No LLM code, weights, or partition changes enter firmware/esp32-csi-node/ under this ADR. All external performance numbers stay CLAIMED until reproduced on RuView silicon with a witness log.
  • ADR-328 (renumbered from ADR-325): a design investigation into flash-resident, memory-mapped, quantized weight storage for RuView's own future edge models (e.g. an on-node presence classifier) — decoupled from any LLM ambition. Design/benchmarking only; no partition or wire change without a follow-up MEASURED ADR.
  • docs/research/esp32-micro-llm-inference.md: companion research doc with sources, technique analysis, and fleet fit-analysis backing both ADRs.

Renumbering

The branch was authored as ADR-324/ADR-325, but by the time it was picked back up main had assigned ADR-324 through ADR-327 to unrelated work (off-axis perspective demo, Cognitum Spaces). Renumbered to the next free slots — ADR-322 (an observed gap in the index) and ADR-328 (next free after ADR-327) — fixed all internal cross-references, and indexed both in docs/adr/README.md. Decision content is unchanged from the original commit; both remain Status: Proposed.

Non-goals reiterated

  • No firmware changes.
  • No model weights committed.
  • No production partition map changes.

🤖 Generated with claude-flow

claude and others added 2 commits August 22, 2026 19:04
Adds a source-cited research survey of the 2026 ESP32-S3 micro-LLM
demonstrations (slvDev esp32-ai, DaveBben esp32-llm, llama2.c, Gemma-3n
Per-Layer Embeddings) with all external numbers tagged CLAIMED, plus:

- ADR-324: micro-LLM inference is a bounded research spike on dedicated
  16MB-flash companion hardware and an explicit production non-goal for
  CSI node firmware (flash-impossible on the 8MB/4MB fleet, core/PSRAM
  contention with sensing, no task capability at TinyStories scale).
- ADR-325: design investigation into flash-resident memory-mapped
  quantized weight streaming for RuView's own edge models, with a
  measured-benchmark-first gate and provenance requirements.

No firmware, partition, or wire changes; documentation only.

Co-Authored-By: claude-flow <ruv@ruv.net>
Claude-Session: https://claude.ai/code/session_01KCYFXcPDG6yTCxwefb6iy6
The research spike (ADR-324) and flash-resident weight streaming (ADR-325)
ADRs were authored on 2026-08-16 on a branch that fell behind main. By the
time it's picked back up, ADR-324 through ADR-327 were assigned to unrelated
work (off-axis perspective demo, Cognitum Spaces). Renumber to the next free
slots: ADR-322 (an observed gap) and ADR-328 (next after ADR-327), fix
internal cross-references, and index both in docs/adr/README.md.

Both ADRs remain Status: Proposed, unreviewed content unchanged.

Co-Authored-By: claude-flow <ruv@ruv.net>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants