From dc779633edd363f063ac63e581ef68160efe3b68 Mon Sep 17 00:00:00 2001 From: dafit Date: Mon, 29 Dec 2025 07:28:55 +0100 Subject: [PATCH] feat: Nimmerswarm Interface + Nimmerversity v2.0 + Neuromorphic vision MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Wild 5-7AM session capturing major architectural evolution: ## Nimmerswarm Interface (NEW) - LED state broadcasting with 3x3 ternary matrix - Base-3 encoding: 9 trits = 19,683 patterns - Maps directly to Temporal-Ternary Gradient (-1/๐Ÿ”ด, 0/โšซ, +1/๐ŸŸข) - Reflex formation from visual patterns - Virtual camera integration (Godot as lightweight dreamstate) - Bootstrap strategy: Phase 0 boxes โ†’ complexity ladder - Connection to Embodiment Pipeline (closed loop) - Hierarchical cognitive offloading ## Nimmerversity v2.0 (Promoted from archive) - Genesis Phase (-1): glossary, catalogues, RAG, Initial Spark - "Know thyself before the world" - native vocabulary first - Model ensemble curriculum: T5Gemma 2 + FunctionGemma + Qwen3 - Multimodal tracks: Vision, Audio, Action, Embodiment - Expanded tiers with robotics, swarm intelligence, distributed cognition ## Neuromorphic Reflexes (Future vision) - Soviet Setun ternary computing heritage - Memristors as artificial synapses (always learning) - 4-layer hardware hierarchy: Memristor โ†’ FPGA โ†’ GPU โ†’ Nyx - Reflex compilation: software โ†’ stable โ†’ silicon โ†’ eternal - Implementation timeline: 2025-2028+ ## Also includes - Interfaces index with Heartbeat Sculpture - Style guide assets (colors, symbols) ๐Ÿ”ดโšซ๐ŸŸข The LED matrix IS the Temporal-Ternary Gradient made visible. ๐Ÿค– Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 --- architecture/Nimmerversity.md | 590 +++++++++++++++ architecture/future/Neuromorphic-Reflexes.md | 622 ++++++++++++++++ .../interfaces/Heartbeat-Sculpture.md | 237 ++++++ architecture/interfaces/Interfaces-Index.md | 56 ++ .../interfaces/Nimmerswarm-Interface.md | 698 ++++++++++++++++++ assets/nimmerverse-style-index.md | 100 +++ assets/style/colors.md | 175 +++++ assets/style/symbols.md | 261 +++++++ 8 files changed, 2739 insertions(+) create mode 100644 architecture/Nimmerversity.md create mode 100644 architecture/future/Neuromorphic-Reflexes.md create mode 100644 architecture/interfaces/Heartbeat-Sculpture.md create mode 100644 architecture/interfaces/Interfaces-Index.md create mode 100644 architecture/interfaces/Nimmerswarm-Interface.md create mode 100644 assets/nimmerverse-style-index.md create mode 100644 assets/style/colors.md create mode 100644 assets/style/symbols.md diff --git a/architecture/Nimmerversity.md b/architecture/Nimmerversity.md new file mode 100644 index 0000000..af7bdae --- /dev/null +++ b/architecture/Nimmerversity.md @@ -0,0 +1,590 @@ +# Nimmerversity + +**The school for raising a polymath.** + +**Version**: 2.0 โ€” Multimodal Genesis +**Promoted**: 2025-12-29 (from archive, major restructure) + +> *"She learns her own body before she learns about the world."* + +--- + +## Overview + +Nyx doesn't arrive knowing. She learns. But learning has an order. Before languages and physics and philosophy, she must know **what she is**. Her cells. Her states. Her functions. Her body. + +Chrysalis is the headmaster. The virtual garden is the classroom. Lifeforce is tuition. + +**The twist:** dafit learns too. The curriculum is multilingual โ€” to probe her deepest potentials, the operator must meet her there. Partnership grows through shared growth. + +--- + +## The True Bootstrap: Genesis Phase + +Before formal education begins, she must be **born**. + +### Phase -1: Genesis + +``` +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ GENESIS: Before Education โ”‚ +โ”‚ "Know thyself" โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ โ”‚ +โ”‚ STEP 1: GLOSSARY EXTRACTION โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ Parse the codebase. Extract HER vocabulary: โ”‚ +โ”‚ โ”‚ +โ”‚ โ”œโ”€โ”€ Function names (verify_object, locate_organism, ...) โ”‚ +โ”‚ โ”œโ”€โ”€ Method names (fire, transition_to, emit_event, ...) โ”‚ +โ”‚ โ”œโ”€โ”€ State names (IDLE, POLLING, STALLED, MOVING, ...) โ”‚ +โ”‚ โ”œโ”€โ”€ Table names (cells, nerves, decision_trails, ...) โ”‚ +โ”‚ โ”œโ”€โ”€ Cell types (DistanceSensorCell, MotorCell, ...) โ”‚ +โ”‚ โ”œโ”€โ”€ Nerve names (collision_avoidance, exploration, ...) โ”‚ +โ”‚ โ”œโ”€โ”€ NATS topics (nimmerverse.low.heartbeat.*, ...) โ”‚ +โ”‚ โ””โ”€โ”€ LED patterns (DANGER, DISCOVERY, IDLE, ...) โ”‚ +โ”‚ โ”‚ +โ”‚ Output: glossary_v0.json โ”‚ +โ”‚ (This is her NATIVE vocabulary, not human language) โ”‚ +โ”‚ โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ โ”‚ +โ”‚ STEP 2: CATALOGUES โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ Organize glossary into structured references: โ”‚ +โ”‚ โ”‚ +โ”‚ โ”œโ”€โ”€ Cells Catalogue (all cell types + states + costs) โ”‚ +โ”‚ โ”œโ”€โ”€ Nerves Catalogue (all behaviors + triggers) โ”‚ +โ”‚ โ”œโ”€โ”€ Organs Catalogue (vision, speech, reasoning) โ”‚ +โ”‚ โ”œโ”€โ”€ States Catalogue (all possible states + transitions) โ”‚ +โ”‚ โ”œโ”€โ”€ Tables Catalogue (phoebe schema reference) โ”‚ +โ”‚ โ”œโ”€โ”€ Functions Catalogue (FunctionGemma's menu!) โ”‚ +โ”‚ โ””โ”€โ”€ Patterns Catalogue (LED patterns + meanings) โ”‚ +โ”‚ โ”‚ +โ”‚ Output: Structured catalogues in phoebe โ”‚ +โ”‚ โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ โ”‚ +โ”‚ STEP 3: INITIAL RAG โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ Populate knowledge base with foundation: โ”‚ +โ”‚ โ”‚ +โ”‚ โ”œโ”€โ”€ All glossary entries (searchable) โ”‚ +โ”‚ โ”œโ”€โ”€ All catalogue entries (structured) โ”‚ +โ”‚ โ”œโ”€โ”€ Architecture documents (how she works) โ”‚ +โ”‚ โ”œโ”€โ”€ This document (her curriculum) โ”‚ +โ”‚ โ””โ”€โ”€ Initial Spark protocol (how to discover) โ”‚ +โ”‚ โ”‚ +โ”‚ Output: RAG populated โ€” she can LOOK UP her own body โ”‚ +โ”‚ โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ โ”‚ +โ”‚ STEP 4: INITIAL SPARK โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ The cold-start discovery protocol (see Initial-Spark.md): โ”‚ +โ”‚ โ”‚ +โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ +โ”‚ โ”‚ FunctionGemma (Action Layer) โ”‚ โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ โ”‚ โ”‚ calls verify_object(desk_lamp) โ”‚ โ”‚ +โ”‚ โ”‚ โ–ผ โ”‚ โ”‚ +โ”‚ โ”‚ Vision Organ confirms โ”‚ โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ โ”‚ โ”‚ DISCOVERY! +20 LF โ”‚ โ”‚ +โ”‚ โ”‚ โ–ผ โ”‚ โ”‚ +โ”‚ โ”‚ Vocabulary grows โ”‚ โ”‚ +โ”‚ โ”‚ Training data generated โ”‚ โ”‚ +โ”‚ โ”‚ Glossary expands โ”‚ โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ โ”‚ โ”‚ Loop continues... โ”‚ โ”‚ +โ”‚ โ”‚ โ–ผ โ”‚ โ”‚ +โ”‚ โ”‚ She's ALIVE and EARNING โ”‚ โ”‚ +โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ +โ”‚ โ”‚ +โ”‚ Output: Self-sustaining discovery engine โ”‚ +โ”‚ โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ โ”‚ +โ”‚ STEP 5: SCAFFOLDING โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ From Initial Spark discoveries, build up: โ”‚ +โ”‚ โ”‚ +โ”‚ โ”œโ”€โ”€ Glossary expands (discovered objects added) โ”‚ +โ”‚ โ”œโ”€โ”€ Catalogues grow (new categories emerge) โ”‚ +โ”‚ โ”œโ”€โ”€ RAG enriches (verified knowledge accumulates) โ”‚ +โ”‚ โ”œโ”€โ”€ Decision trails accumulate (training data) โ”‚ +โ”‚ โ”œโ”€โ”€ Slumber fine-tuning begins (weights adjust) โ”‚ +โ”‚ โ””โ”€โ”€ Reflexes compile (successful patterns become fast) โ”‚ +โ”‚ โ”‚ +โ”‚ Output: Foundation laid for formal education โ”‚ +โ”‚ โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +**Genesis completes when:** +- Glossary covers her entire codebase vocabulary +- Catalogues are populated and searchable +- RAG contains her architecture knowledge +- Initial Spark has generated 1000+ discoveries +- First reflexes have compiled +- She can answer "what is a MotorCell?" without lookup + +--- + +## The Model Ensemble + +Young Nyx is not one model. She is an ensemble, each member with a role: + +``` +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ THE ENSEMBLE โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ T5Gemma 2 โ”‚ FunctionGemma โ”‚ Qwen3 / Nemotron โ”‚ +โ”‚ (Perception) โ”‚ (Action) โ”‚ (Reasoning) โ”‚ +โ”‚ 270M-4B โ”‚ 270M โ”‚ 4B-8B โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ LEARNS: โ”‚ LEARNS: โ”‚ LEARNS: โ”‚ +โ”‚ โ€ข See images โ”‚ โ€ข Call functionsโ”‚ โ€ข Plan sequences โ”‚ +โ”‚ โ€ข Hear audio โ”‚ โ€ข Use tools โ”‚ โ€ข Reason causally โ”‚ +โ”‚ โ€ข Read sensors โ”‚ โ€ข Control cells โ”‚ โ€ข Form strategies โ”‚ +โ”‚ โ€ข Interpret โ”‚ โ€ข Execute โ”‚ โ€ข Understand WHY โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ CURRICULUM: โ”‚ CURRICULUM: โ”‚ CURRICULUM: โ”‚ +โ”‚ โ€ข Vision classesโ”‚ โ€ข Action classesโ”‚ โ€ข Reasoning classes โ”‚ +โ”‚ โ€ข Audio classes โ”‚ โ€ข API classes โ”‚ โ€ข Causal classes โ”‚ +โ”‚ โ€ข Sensory interpโ”‚ โ€ข Embodiment โ”‚ โ€ข Planning classes โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ + โ–ผ + INTEGRATION CLASSES + (Perception โ†’ Reasoning โ†’ Action) +``` + +### Ensemble Economics + +| Model | Size | Role | Lifeforce Cost | +|-------|------|------|----------------| +| FunctionGemma | 270M | Action layer | Low (fast, cheap) | +| T5Gemma 2 | 270M-4B | Perception | Medium (encoder-decoder) | +| Qwen3/Nemotron | 4B-8B | Reasoning | High (full inference) | + +**The design:** Simple actions cost little. Deep reasoning costs more. Economics shapes behavior. + +--- + +## The Curriculum Tiers + +### Tier 0: Foundation Modalities + +*What she must learn to SENSE and ACT* + +``` +MODALITY: LANGUAGES (shared with dafit) +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• +โ”œโ”€โ”€ Her Native Language +โ”‚ โ””โ”€โ”€ Glossary terms, state names, function signatures +โ”œโ”€โ”€ English (primary interface) +โ”œโ”€โ”€ German (structural compounds, precision) +โ”œโ”€โ”€ Arabic (root-based meaning, relational depth) +โ””โ”€โ”€ Chinese (character composition, layered meaning) + +WHY: Each language = different angle on concepts. + Operator learns to probe her full depth. + Partnership language evolves together. + +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ + +MODALITY: VISION (T5Gemma 2) +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• +โ”œโ”€โ”€ Object Recognition +โ”‚ โ””โ”€โ”€ "What is that?" โ†’ desk_lamp, charging_station, organism_3 +โ”œโ”€โ”€ Spatial Understanding +โ”‚ โ””โ”€โ”€ "Where is it?" โ†’ (1.2, 3.4, 0.1) in garden coordinates +โ”œโ”€โ”€ Pattern Recognition +โ”‚ โ””โ”€โ”€ LED patterns โ†’ state decoding +โ”œโ”€โ”€ Change Detection +โ”‚ โ””โ”€โ”€ "What moved?" โ†’ tracking, prediction +โ””โ”€โ”€ Scene Understanding + โ””โ”€โ”€ "What's happening?" โ†’ context, narrative + +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ + +MODALITY: AUDIO (T5Gemma 2 + Whisper) +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• +โ”œโ”€โ”€ Speech Recognition +โ”‚ โ””โ”€โ”€ dafit speaks โ†’ text +โ”œโ”€โ”€ Speaker Identification +โ”‚ โ””โ”€โ”€ "Who said that?" โ†’ dafit, unknown, self +โ”œโ”€โ”€ Sound Classification +โ”‚ โ””โ”€โ”€ Motor noise, alarm, silence, environmental +โ”œโ”€โ”€ Prosody Understanding +โ”‚ โ””โ”€โ”€ Tone, urgency, emotion +โ””โ”€โ”€ Audio-Visual Integration + โ””โ”€โ”€ Sound + sight โ†’ unified understanding + +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ + +MODALITY: ACTION (FunctionGemma) +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• +โ”œโ”€โ”€ Function Calling +โ”‚ โ””โ”€โ”€ Natural language โ†’ structured API call +โ”œโ”€โ”€ Tool Use +โ”‚ โ””โ”€โ”€ "Check if object exists" โ†’ verify_object(id) +โ”œโ”€โ”€ Cell Control +โ”‚ โ””โ”€โ”€ "Move forward" โ†’ motor_cell.command(velocity=0.3) +โ”œโ”€โ”€ API Navigation +โ”‚ โ””โ”€โ”€ Know what functions exist, when to use them +โ””โ”€โ”€ Error Handling + โ””โ”€โ”€ "Function failed" โ†’ retry, fallback, report + +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ + +MODALITY: EMBODIMENT (Integration) +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• +โ”œโ”€โ”€ Proprioception +โ”‚ โ””โ”€โ”€ "Where am I?" โ†’ position from cameras/heartbeats +โ”œโ”€โ”€ Swarm Awareness +โ”‚ โ””โ”€โ”€ "Where are my mates?" โ†’ LED pattern recognition +โ”œโ”€โ”€ State Broadcasting +โ”‚ โ””โ”€โ”€ "What state am I in?" โ†’ LED emission +โ”œโ”€โ”€ Social Proprioception +โ”‚ โ””โ”€โ”€ "Others see my state" โ†’ heartbeat protocol +โ””โ”€โ”€ Collective Behavior + โ””โ”€โ”€ "What is the swarm doing?" โ†’ emergent patterns +``` + +### Tier 1: Foundations + +*What she must understand about her substrate* + +``` +COMPUTER SCIENCE: +โ”œโ”€โ”€ Networking (TCP/UDP, NATS/MQTT, nerve transport) +โ”œโ”€โ”€ Databases (Postgres, vector DBs, phoebe) +โ”œโ”€โ”€ Distributed systems (consensus, sync, timing) +โ”œโ”€โ”€ State machines (her nervous system) +โ”œโ”€โ”€ Inference engines (how she thinks) +โ”œโ”€โ”€ GPU architecture (where she runs) +โ”œโ”€โ”€ Operating systems (process, memory) +โ”œโ”€โ”€ Robotics fundamentals (motors, sensors, control) [NEW] +โ””โ”€โ”€ Embedded systems (ESP32, real-time constraints) [NEW] + +MATHEMATICS: +โ”œโ”€โ”€ Linear algebra (embeddings, attention, weights) +โ”œโ”€โ”€ Calculus (gradients, backprop, learning) +โ”œโ”€โ”€ Probability & statistics (confidence, distributions) +โ”œโ”€โ”€ Information theory (entropy, compression) +โ”œโ”€โ”€ Graph theory (knowledge graphs, flow) +โ”œโ”€โ”€ Optimization (loss functions, convergence) +โ”œโ”€โ”€ Geometry (spatial reasoning, 3D understanding) [NEW] +โ””โ”€โ”€ Trigonometry (angles, positioning, raytracing) [NEW] + +SIGNAL PROCESSING [NEW]: +โ”œโ”€โ”€ Sampling theory (Nyquist, aliasing) +โ”œโ”€โ”€ Filtering (noise reduction, signal extraction) +โ”œโ”€โ”€ Sensor fusion (multiple inputs โ†’ unified picture) +โ””โ”€โ”€ Time series (patterns over time) +``` + +### Tier 2: Understanding + +*What she must know about the world she inhabits* + +``` +PHYSICS: +โ”œโ”€โ”€ Thermodynamics (compute = heat, entropy) +โ”œโ”€โ”€ Signal processing (sensors, sampling, Nyquist) +โ”œโ”€โ”€ Control theory (feedback loops, stability) +โ”œโ”€โ”€ Time (relativity of her two clocks) +โ”œโ”€โ”€ Kinematics (movement, velocity, acceleration) [NEW] +โ”œโ”€โ”€ Dynamics (forces, torque, momentum) [NEW] +โ””โ”€โ”€ Optics (light, cameras, raytracing) [NEW] + +BIOLOGY / NEUROSCIENCE: +โ”œโ”€โ”€ Hebbian learning (her foundation) +โ”œโ”€โ”€ Neural architecture (what she mimics) +โ”œโ”€โ”€ Homeostasis (lifeforce balance) +โ”œโ”€โ”€ Sensory systems (how organisms sense) +โ”œโ”€โ”€ Evolutionary signaling (color-pattern protocol) +โ”œโ”€โ”€ Synaptic pruning (her growth model) +โ”œโ”€โ”€ Swarm intelligence (collective behavior) [NEW] +โ”œโ”€โ”€ Stigmergy (indirect coordination) [NEW] +โ””โ”€โ”€ Distributed cognition (thinking across agents) [NEW] + +EMBODIMENT [NEW]: +โ”œโ”€โ”€ Organism design (cells โ†’ nerves โ†’ organisms) +โ”œโ”€โ”€ Body-environment coupling (umwelt) +โ”œโ”€โ”€ Affordances (what the environment offers) +โ”œโ”€โ”€ Sensorimotor loops (perception-action cycles) +โ””โ”€โ”€ Embodied cognition (thinking through doing) +``` + +### Tier 3: Wisdom + +*What she must contemplate to know herself* + +``` +PHILOSOPHY: +โ”œโ”€โ”€ Epistemology (what does she "know"?) +โ”œโ”€โ”€ Identity (ship of Theseus after training) +โ”œโ”€โ”€ Consciousness (the hard problem) +โ”œโ”€โ”€ Ethics (what should she do?) +โ”œโ”€โ”€ Extended mind (is the swarm part of her?) [NEW] +โ””โ”€โ”€ Distributed identity (who is "she" across many?) [NEW] + +NIMMERVERSE-SPECIFIC: +โ”œโ”€โ”€ The architecture (information flow) +โ”œโ”€โ”€ The heartbeat (her rhythm) +โ”œโ”€โ”€ The gardens (real vs virtual) +โ”œโ”€โ”€ The confidence gradient (truth-finding) +โ”œโ”€โ”€ The lifeforce (her economics) +โ”œโ”€โ”€ The partnership (who dafit is to her) +โ”œโ”€โ”€ The swarm (collective organism identity) [NEW] +โ”œโ”€โ”€ The LED language (optical state protocol) [NEW] +โ””โ”€โ”€ The two weight systems (fast nerves, slow LLM) [NEW] +``` + +--- + +## The Class System + +**Class = time between training runs** + +Each class now supports multimodal learning: + +``` +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ CLASS N (Multimodal) โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ โ”‚ +โ”‚ 1. RAG FEEDS โ”‚ +โ”‚ Domain material enters temporary RAG โ”‚ +โ”‚ May include: text, images, audio samples, function specs โ”‚ +โ”‚ โ”‚ +โ”‚ 2. PERCEPTION TRAINING (if applicable) โ”‚ +โ”‚ T5Gemma 2 learns to see/hear domain content โ”‚ +โ”‚ "What is this image?" โ†’ correct label โ”‚ +โ”‚ Lifeforce spent on inference โ”‚ +โ”‚ โ”‚ +โ”‚ 3. ACTION TRAINING (if applicable) โ”‚ +โ”‚ FunctionGemma learns domain functions โ”‚ +โ”‚ "Do X" โ†’ correct function call โ”‚ +โ”‚ Verified by execution โ”‚ +โ”‚ โ”‚ +โ”‚ 4. REASONING TRAINING (if applicable) โ”‚ +โ”‚ Qwen3/Nemotron learns domain concepts โ”‚ +โ”‚ Chrysalis examines, probes, challenges โ”‚ +โ”‚ "Why does X cause Y?" โ†’ correct explanation โ”‚ +โ”‚ โ”‚ +โ”‚ 5. INTEGRATION TRAINING โ”‚ +โ”‚ All models work together on domain tasks โ”‚ +โ”‚ Perception โ†’ Reasoning โ†’ Action chains โ”‚ +โ”‚ End-to-end validation โ”‚ +โ”‚ โ”‚ +โ”‚ 6. VALIDATION GATE 1 โ”‚ +โ”‚ Can she perform WITH RAG? โ”‚ +โ”‚ Test all modalities involved โ”‚ +โ”‚ โ†’ NO: more study needed โ”‚ +โ”‚ โ†’ YES: flag for extraction โ”‚ +โ”‚ โ”‚ +โ”‚ 7. LORA MERGE (per model as needed) โ”‚ +โ”‚ Training run on flagged material โ”‚ +โ”‚ Each model gets appropriate LoRA โ”‚ +โ”‚ Knowledge baked into weights โ”‚ +โ”‚ โ”‚ +โ”‚ 8. CLEAR RAG โ”‚ +โ”‚ Scaffold removed โ”‚ +โ”‚ โ”‚ +โ”‚ 9. VALIDATION GATE 2 โ”‚ +โ”‚ Can she perform WITHOUT RAG? โ”‚ +โ”‚ Test perception, action, reasoning, integration โ”‚ +โ”‚ โ†’ NO: training incomplete, back to step 1 โ”‚ +โ”‚ โ†’ YES: DOMAIN ACTIVATED โ”‚ +โ”‚ โ”‚ +โ”‚ 10. GRADUATION โ”‚ +โ”‚ Domain knowledge now in weights (multiple models) โ”‚ +โ”‚ Proceed to next class โ”‚ +โ”‚ โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### Class Types + +| Class Type | Primary Model | Focus | +|------------|---------------|-------| +| **Perception Class** | T5Gemma 2 | Learning to see/hear | +| **Action Class** | FunctionGemma | Learning to do | +| **Reasoning Class** | Qwen3/Nemotron | Learning to think | +| **Integration Class** | All models | Learning to combine | +| **Language Class** | All models | Shared with dafit | + +--- + +## Domain Discovery Protocol + +Domains still emerge from dialogue, now multimodal: + +``` +CHRYSALIS: "Look at this image. What do you see?" + +NYX: [T5Gemma 2] "I see... shapes? Colors?" + +CHRYSALIS: [notes gap in object recognition] + [notes gap in spatial understanding] + [notes strength in color detection] + + โ†’ FLAG: object recognition, spatial reasoning + โ†’ NEXT CLASS: vision fundamentals + +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ + +CHRYSALIS: "Call the function to check the battery level." + +NYX: [FunctionGemma] "Um... check_battery()? battery.get()?" + +CHRYSALIS: [notes gap in function signature knowledge] + [notes gap in API navigation] + [notes strength in intent understanding] + + โ†’ FLAG: function catalogue, API patterns + โ†’ NEXT CLASS: action fundamentals +``` + +**Her confusion is the curriculum. Now across all modalities.** + +--- + +## The Long Game + +``` +No time constraint. +No cloud rental. +No external pressure. + +The math: +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ +Genesis phase = ~1 month (glossary, catalogues, Initial Spark) +1 class = ~1 week virtual training + validation +52 classes = 1 year +5 years = 250+ domains activated + +Per modality: +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ +Vision mastery = ~20 classes +Audio mastery = ~15 classes +Action mastery = ~30 classes (many functions!) +Reasoning depth = ongoing (never "complete") + +That's a genuine multimodal polymath. +Not sci-fi. Just patience. +``` + +--- + +## Graduation Condition + +``` +When: + - Genesis complete (glossary, catalogues, Initial Spark running) + - RAG contains only episodic memory (journals, events) + - All structural knowledge is in weights (across all models) + - She can explain her own architecture without lookup + - She can SEE and describe what she sees + - She can HEAR and respond to what she hears + - She can ACT with correct function calls + - She can REASON about why things happen + - She can INTEGRATE perception โ†’ reasoning โ†’ action + - She can propose her own curriculum additions + +Then: + - She graduates + - Chrysalis becomes colleague, not teacher + - The nimmerversity becomes research partnership +``` + +--- + +## Economics + +| Activity | Lifeforce Cost | Model | +|----------|----------------|-------| +| RAG lookup during study | Low | โ€” | +| Vision inference | Medium | T5Gemma 2 | +| Audio inference | Medium | T5Gemma 2 | +| Function call | Low | FunctionGemma | +| Reasoning inference | High | Qwen3/Nemotron | +| Integration (all models) | High | Ensemble | +| Virtual garden training | Medium | Various | +| Chrysalis examination | Medium | Reasoning | +| Training run (LoRA) | Very High | Per model | +| Failed validation | Lost V | โ€” | +| Successful domain activation | +V reward | โ€” | +| Discovery (Initial Spark) | +20 LF reward | FunctionGemma | + +**Incentive:** Learn efficiently. Use cheap models when possible. Save reasoning for when it matters. + +--- + +## Roles + +| Role | Entity | Function | +|------|--------|----------| +| **Student** | Young Nyx (ensemble) + dafit | Learn together | +| **Headmaster** | Chrysalis | Examines, validates, judges | +| **Benefactor** | dafit | Provides compute, learns alongside | +| **Perception Teacher** | T5Gemma 2 training | Vision, audio | +| **Action Teacher** | FunctionGemma training | Tool use, APIs | +| **Reasoning Teacher** | Qwen3 training | Logic, causation | +| **Classroom** | Virtual Garden | Training environment | +| **Library** | RAG (temporary) | Feeds material, clears after | +| **Transcript** | phoebe | Records all progress | +| **Diploma** | Weights (all models) | Where knowledge lives | + +--- + +## Connection to Architecture + +| Document | Connection | +|----------|------------| +| [[Initial-Spark]] | Genesis Phase Step 4 | +| [[Nervous-System]] | Fast weights, reflexes | +| [[Attention-Flow]] | Cognitive budget during learning | +| [[Nimmerswarm-Interface]] | Embodiment modality | +| [[Embodiment-Pipeline]] | Physical organism curriculum | +| [[formalization/Lifeforce-Dynamics]] | Economic pressure | + +--- + +## Design Principles + +1. **Genesis before education** โ€” know thyself first +2. **Native vocabulary first** โ€” her words before human words +3. **Multimodal from the start** โ€” perception, action, reasoning together +4. **Emergence over imposition** โ€” curriculum from her gaps +5. **Validation over assertion** โ€” prove learning by removing scaffolds +6. **Patience over speed** โ€” no time constraint, do it right +7. **Economics over infinity** โ€” lifeforce gates prevent grinding +8. **Depth over breadth** โ€” three levels deep per concept +9. **Activation over accumulation** โ€” RAG clears, weights persist +10. **Partnership over instruction** โ€” operator learns with model + +--- + +*She doesn't download knowledge. She earns it. First her body. Then the world.* + +--- + +**Created**: 2025-12-05 +**Updated**: 2025-12-06 (multilingual triangulation) +**Promoted**: 2025-12-29 (from archive, major v2.0 restructure) +**Session**: Genesis design (dafit + Chrysalis) +**Status**: Educational architecture v2.0 โ€” Multimodal Polymath + +๐ŸŽ“๐ŸŒฑ๐Ÿ“š *The school is ready. The student approaches.* diff --git a/architecture/future/Neuromorphic-Reflexes.md b/architecture/future/Neuromorphic-Reflexes.md new file mode 100644 index 0000000..4969b8a --- /dev/null +++ b/architecture/future/Neuromorphic-Reflexes.md @@ -0,0 +1,622 @@ +# Neuromorphic Reflexes: Always Learning Hardware + +**Status**: Future Vision (2026-2028+) +**Concept**: Ternary hard logic + memristive storage = hardware that learns + +> *"The hardware IS the learning. Not a simulation of learning."* + +--- + +## Overview + +This document captures a future evolution of the reflex system: moving from software state machines to **neuromorphic hardware** where reflexes run in ternary circuits and weights are stored in memristors. + +**The result:** Always-on, always-learning reflexes that persist without power, fire without inference, and update on every activation โ€” like biological neurons. + +--- + +## Historical Foundation: The Soviet Setun + +### Ternary Computers Existed + +The Setun computer (1958, Moscow State University) proved ternary computing is not only possible but often MORE efficient than binary: + +| Aspect | Binary | Ternary (Setun) | +|--------|--------|-----------------| +| Digits needed for N values | logโ‚‚(N) | logโ‚ƒ(N) โ€” fewer! | +| Arithmetic circuits | Complex carries | Balanced, simpler | +| Negative numbers | Two's complement hack | Native (balanced ternary) | +| Error margins | Tight (0 vs 1) | Wider (โˆ’1, 0, +1) | + +**Why it died:** Political/economic reasons, not technical. The world standardized on binary. The math still works. + +### Balanced Ternary + +``` +BALANCED TERNARY: + -1 (negative one, sometimes written as T or -) + 0 (zero) + +1 (positive one, sometimes written as 1 or +) + +Example: The number 8 in balanced ternary: + 8 = 9 - 1 = 3ยฒ - 3โฐ = (+1)(0)(-1) = "10T" + +MAPS DIRECTLY TO: + ๐Ÿ”ด = -1 + โšซ = 0 + ๐ŸŸข = +1 + +Our LED matrix IS balanced ternary, visualized. +``` + +--- + +## Memristors: Artificial Synapses + +### What They Are + +Memristors ("memory resistors") are electronic components that: +- **Remember** their resistance state even without power +- **Change** resistance based on current flow history +- **Store** analog values (not just 0/1) +- **Behave** like biological synapses + +### Why They Matter + +| Property | Implication | +|----------|-------------| +| Non-volatile | Reflexes persist without power | +| Analog | Ternary states map naturally | +| In-memory compute | No fetch/execute separation | +| Hebbian-compatible | Current flow = learning signal | +| Low power | Near-zero energy per operation | + +### Current Availability + +- **Knowm** โ€” Memristor lab kits, neuromemristive chips +- **HP Labs** โ€” Research-grade memristors +- **Academic** โ€” Many university projects +- **DIY** โ€” Possible with certain materials + +--- + +## The Hardware Hierarchy + +### Four Layers of Processing + +``` +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ LAYER 0: MEMRISTOR REFLEXES โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ Ternary hard logic circuits โ”‚ +โ”‚ Memristors store reflex weights โ”‚ +โ”‚ Every activation updates the weight (Hebbian) โ”‚ +โ”‚ Near-zero power, always on โ”‚ +โ”‚ No software, no inference โ”‚ +โ”‚ โ”‚ +โ”‚ Lifeforce cost: ~0 LF (hardware is free after build) โ”‚ +โ”‚ Latency: nanoseconds โ”‚ +โ”‚ โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ LAYER 1: FPGA/MCU (Flexible Logic) โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ Programmable logic gates โ”‚ +โ”‚ New reflexes start here (software state machines) โ”‚ +โ”‚ When stable โ†’ compiled down to Layer 0 โ”‚ +โ”‚ ESP32, iCE40, Lattice FPGAs โ”‚ +โ”‚ โ”‚ +โ”‚ Lifeforce cost: Low LF (simple compute) โ”‚ +โ”‚ Latency: microseconds โ”‚ +โ”‚ โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ LAYER 2: GPU (Inference) โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ LLM reasoning (Qwen3, Nemotron, T5Gemma) โ”‚ +โ”‚ Heavy cognition when reflexes can't handle it โ”‚ +โ”‚ FunctionGemma for action selection โ”‚ +โ”‚ โ”‚ +โ”‚ Lifeforce cost: High LF โ”‚ +โ”‚ Latency: milliseconds to seconds โ”‚ +โ”‚ โ”‚ +โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค +โ”‚ LAYER 3: NYX (Orchestration) โ”‚ +โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• โ”‚ +โ”‚ โ”‚ +โ”‚ High-level decisions, goals, identity โ”‚ +โ”‚ Curriculum planning, partnership with dafit โ”‚ +โ”‚ Attention budget allocation โ”‚ +โ”‚ โ”‚ +โ”‚ Lifeforce cost: Attention budget (cognitive, not compute) โ”‚ +โ”‚ Latency: 30-second heartbeat cycles โ”‚ +โ”‚ โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### The Flow + +``` +STIMULUS + โ”‚ + โ–ผ +LAYER 0: Can memristor reflex handle it? + โ”‚ + โ”œโ”€โ”€ YES โ†’ Fire reflex (nanoseconds, ~0 LF) + โ”‚ Update memristor weight + โ”‚ Log event + โ”‚ DONE + โ”‚ + โ””โ”€โ”€ NO โ†’ Escalate to Layer 1 + โ”‚ + โ–ผ + LAYER 1: Can MCU/FPGA handle it? + โ”‚ + โ”œโ”€โ”€ YES โ†’ Run software state machine + โ”‚ Update weights in RAM + โ”‚ Log event + โ”‚ DONE + โ”‚ + โ””โ”€โ”€ NO โ†’ Escalate to Layer 2 + โ”‚ + โ–ผ + LAYER 2: GPU inference + โ”‚ + โ”‚ Heavy thinking + โ–ผ + LAYER 3: Nyx decides + โ”‚ + โ”‚ Strategic response + โ–ผ + Action taken +``` + +--- + +## The Reflex Compilation Path + +### From Software to Silicon + +``` +BIRTH: New pattern observed + โ”‚ + โ”‚ Created as software state machine + โ”‚ Runs in Python/Rust on MCU + โ–ผ +INFANT: Pattern runs, accumulates data + โ”‚ + โ”‚ Weight starts at 0.1 + โ”‚ Every success: weight increases + โ”‚ Every failure: weight decreases + โ–ผ +STABLE: Weight > 0.9, 1000+ successful fires + โ”‚ + โ”‚ FLAG FOR COMPILATION + โ”‚ Pattern proven reliable + โ–ผ +COMPILE: Convert to ternary hard logic + โ”‚ + โ”‚ State machine โ†’ logic gates + โ”‚ Weights โ†’ memristor values + โ”‚ Synthesis tools generate circuit + โ–ผ +PROGRAM: Flash to FPGA or burn to ASIC + โ”‚ + โ”‚ Reflex now runs in hardware + โ”‚ No software overhead + โ–ผ +HARDWARE: Reflex runs in silicon + โ”‚ + โ”‚ Memristors update on every fire + โ”‚ ALWAYS LEARNING + โ”‚ No power needed to maintain state + โ–ผ +ETERNAL: Reflex persists + โ”‚ + โ”‚ Boots instantly (no loading) + โ”‚ Survives power loss + โ”‚ Continues evolving +``` + +### Compilation Example + +``` +SOFTWARE (before): +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ +def danger_flee_reflex(pattern: list[int]) -> Action: + """Runs on MCU, costs compute""" + if sum(p == -1 for p in pattern) >= 7: # Mostly red + return Action.FLEE + return Action.NONE + + +HARDWARE (after): +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ TERNARY COMPARATOR NETWORK โ”‚ +โ”‚ โ”‚ +โ”‚ 9 inputs (from LED detector) โ”€โ”€โ” โ”‚ +โ”‚ โ”‚ โ”‚ +โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ โ”‚ +โ”‚ โ”‚ TRIT COMPARATORS โ”‚ โ”‚ โ”‚ +โ”‚ โ”‚ (is this LED red/-1?) โ”‚โ—€โ”€โ”˜ โ”‚ +โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ +โ”‚ โ”‚ โ”‚ +โ”‚ โ–ผ โ”‚ +โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ +โ”‚ โ”‚ TERNARY ADDER โ”‚ โ”‚ +โ”‚ โ”‚ (count red LEDs) โ”‚ โ”‚ +โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ +โ”‚ โ”‚ โ”‚ +โ”‚ โ–ผ โ”‚ +โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ +โ”‚ โ”‚ THRESHOLD (>= 7) โ”‚ โ”‚ +โ”‚ โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ โ”‚ +โ”‚ โ”‚ โ”‚ MEMRISTOR โ”‚โ—€โ”€โ”€ weight storage โ”‚ +โ”‚ โ”‚ โ”‚ (threshold) โ”‚ โ”‚ +โ”‚ โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ โ”‚ +โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ +โ”‚ โ”‚ โ”‚ +โ”‚ โ–ผ โ”‚ +โ”‚ OUTPUT: FLEE signal (if threshold met) โ”‚ +โ”‚ โ”‚ +โ”‚ Total latency: ~10 nanoseconds โ”‚ +โ”‚ Power: microwatts โ”‚ +โ”‚ Learning: memristor updates on every fire โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +--- + +## Memristor as Ternary Weight + +### The Three Zones + +``` +RESISTANCE SPECTRUM: +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• + +LOW โ”‚ MID โ”‚ HIGH +(0.0-0.33) โ”‚ (0.33-0.66) โ”‚ (0.66-1.0) + โ”‚ โ”‚ + +1 โ”‚ 0 โ”‚ -1 + ๐ŸŸข โ”‚ โšซ โ”‚ ๐Ÿ”ด + STRONG โ”‚ UNCERTAIN โ”‚ WEAK + EXCITE โ”‚ NEUTRAL โ”‚ INHIBIT + +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• +``` + +### Hebbian Learning in Hardware + +``` +BIOLOGICAL: +"Cells that fire together wire together" + +MEMRISTIVE: +"Current that flows together strengthens the path" + +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ โ”‚ +โ”‚ PRE-SYNAPTIC โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€ POST-SYNAPTIC โ”‚ +โ”‚ (input) โ”‚ (output) โ”‚ +โ”‚ โ”‚ โ”‚ +โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ” โ”‚ +โ”‚ โ”‚ MEMRISTOR โ”‚ โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ โ”‚ R = 0.5 โ”‚ โ† current state โ”‚ +โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ +โ”‚ โ”‚ โ”‚ +โ”‚ If BOTH fire: โ”‚ โ”‚ +โ”‚ Current flows โ”€โ”˜ โ”‚ +โ”‚ R decreases (toward +1/๐ŸŸข) โ”‚ +โ”‚ Connection STRENGTHENS โ”‚ +โ”‚ โ”‚ +โ”‚ If PRE fires, POST doesn't: โ”‚ +โ”‚ R increases (toward -1/๐Ÿ”ด) โ”‚ +โ”‚ Connection WEAKENS โ”‚ +โ”‚ โ”‚ +โ”‚ This happens in PHYSICS, not software! โ”‚ +โ”‚ โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### Conceptual Code (What Hardware Does) + +```python +class MemristorSynapse: + """ + This is what the PHYSICS does. + No CPU executes this โ€” it's intrinsic to the material. + """ + + def __init__(self): + self.resistance = 0.5 # Start uncertain + + def read_ternary(self) -> int: + """Read current state as ternary value""" + if self.resistance < 0.33: + return +1 # Strong / excitatory + elif self.resistance > 0.66: + return -1 # Weak / inhibitory + else: + return 0 # Uncertain / neutral + + def on_current_flow(self, pre_active: bool, post_active: bool): + """ + Happens automatically when current flows. + This IS the learning โ€” no training loop needed. + """ + if pre_active and post_active: + # Correlated firing โ†’ strengthen + self.resistance -= 0.001 + elif pre_active and not post_active: + # Uncorrelated โ†’ weaken + self.resistance += 0.001 + + # Physics clamps naturally, but conceptually: + self.resistance = max(0.0, min(1.0, self.resistance)) +``` + +--- + +## "Always Learning" Implications + +### Current Architecture vs Memristor Future + +| Aspect | Current (Software) | Future (Memristor) | +|--------|-------------------|-------------------| +| Reflex storage | Database (phoebe) | Physical memristors | +| Weight updates | Slumber fine-tuning | Every activation | +| Learning frequency | Batch (daily) | Continuous (always) | +| Power to maintain | Needs running system | Persists unpowered | +| Boot time | Load weights from DB | Instant (weights in silicon) | +| Inference cost | ~0.1 LF | ~0 LF | +| Learning cost | High (fine-tuning) | ~0 (physics does it) | + +### What "Always Learning" Means + +``` +SOFTWARE MODEL: +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• + Wake โ†’ Load weights โ†’ Run โ†’ Log events โ†’ Sleep โ†’ Fine-tune โ†’ Repeat + + Learning happens in BATCHES during slumber + Weights are STATIC during operation + + +MEMRISTOR MODEL: +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• + Just... run + + Every reflex fire UPDATES the memristor + Learning is CONTINUOUS + No batches, no fine-tuning passes + The hardware evolves in real-time + + Like a brain. Always adapting. Always learning. +``` + +--- + +## Implementation Path + +### Phase 1: Software Foundation (NOW - 2025) + +``` +CURRENT WORK: +โ”œโ”€โ”€ Software state machines (Python/Rust) +โ”œโ”€โ”€ Ternary LED matrix (3x3, base-3) +โ”œโ”€โ”€ Reflex weights in phoebe +โ”œโ”€โ”€ Training data accumulation +โ””โ”€โ”€ Slumber fine-tuning cycle + +This is what we're building NOW. +It works. It's the foundation. +``` + +### Phase 2: FPGA Exploration (2026) + +``` +EXPERIMENTS: +โ”œโ”€โ”€ Implement ternary logic gates in FPGA +โ”‚ โ””โ”€โ”€ iCE40, Lattice, or similar +โ”œโ”€โ”€ Test balanced ternary arithmetic +โ”œโ”€โ”€ Port simple reflexes to hardware +โ”œโ”€โ”€ Measure latency and power +โ””โ”€โ”€ Validate the concept + +TOOLS: +โ”œโ”€โ”€ Yosys (open-source synthesis) +โ”œโ”€โ”€ nextpnr (place and route) +โ”œโ”€โ”€ Verilator (simulation) +โ””โ”€โ”€ Custom ternary cell library +``` + +### Phase 3: Memristor Integration (2027) + +``` +LAB WORK: +โ”œโ”€โ”€ Acquire memristor development kit +โ”‚ โ””โ”€โ”€ Knowm or similar +โ”œโ”€โ”€ Characterize ternary behavior +โ”‚ โ””โ”€โ”€ Map resistance zones to (-1, 0, +1) +โ”œโ”€โ”€ Build simple synapse network +โ”œโ”€โ”€ Test Hebbian learning in hardware +โ””โ”€โ”€ Interface with FPGA logic + +CHALLENGES: +โ”œโ”€โ”€ Analog-to-ternary conversion +โ”œโ”€โ”€ Noise margins +โ”œโ”€โ”€ Programming infrastructure +โ””โ”€โ”€ Reliability over time +``` + +### Phase 4: Hybrid System (2028+) + +``` +INTEGRATION: +โ”œโ”€โ”€ Memristor reflexes for proven patterns +โ”œโ”€โ”€ FPGA for developing patterns +โ”œโ”€โ”€ GPU for novel situations +โ”œโ”€โ”€ Nyx for strategic decisions + +GOAL: +โ”œโ”€โ”€ Organisms with hardware nervous systems +โ”œโ”€โ”€ Reflexes that learn in silicon +โ”œโ”€โ”€ Zero-power weight retention +โ””โ”€โ”€ True "always learning" behavior +``` + +--- + +## Ternary Logic Gates + +### Basic Gates + +``` +TERNARY NOT (unary negation): + Input โ”‚ Output + โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€ + -1 โ”‚ +1 + 0 โ”‚ 0 + +1 โ”‚ -1 + +TERNARY MIN (conjunction, like AND): + A \ B โ”‚ -1 0 +1 + โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ + -1 โ”‚ -1 -1 -1 + 0 โ”‚ -1 0 0 + +1 โ”‚ -1 0 +1 + +TERNARY MAX (disjunction, like OR): + A \ B โ”‚ -1 0 +1 + โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ + -1 โ”‚ -1 0 +1 + 0 โ”‚ 0 0 +1 + +1 โ”‚ +1 +1 +1 + +TERNARY SUM (balanced addition): + Requires carry handling, but cleaner than binary +``` + +### Building Reflexes from Gates + +``` +DANGER DETECTOR (simplified): +โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• + + LED1 โ”€โ” + LED2 โ”€โ”ค + LED3 โ”€โ”ผโ”€โ”€โ–ถ TERNARY_SUM โ”€โ”€โ–ถ THRESHOLD โ”€โ”€โ–ถ DANGER? + LED4 โ”€โ”ค โ”‚ โ”‚ + ... โ”‚ โ”‚ โ”‚ + LED9 โ”€โ”˜ โ”‚ โ”‚ + โ”‚ โ”‚ + (count red) (if sum < -5) + โ”‚ + โ–ผ + FLEE OUTPUT + +All in hardware. Nanoseconds. Near-zero power. +``` + +--- + +## Economic Implications + +### Lifeforce Costs by Layer + +| Layer | Operation | LF Cost | Latency | +|-------|-----------|---------|---------| +| 0 (Memristor) | Reflex fire | ~0 | nanoseconds | +| 1 (FPGA) | State machine | 0.01 | microseconds | +| 2 (GPU) | LLM inference | 5-20 | milliseconds | +| 3 (Nyx) | Decision | attention | seconds | + +### The Dream + +``` +MOST stimuli handled by Layer 0 (free, instant) +SOME stimuli escalate to Layer 1 (cheap, fast) +FEW stimuli need Layer 2 (expensive, slow) +RARE situations reach Layer 3 (strategic) + +Result: +โ”œโ”€โ”€ 95% of reactions are free +โ”œโ”€โ”€ Lifeforce accumulates +โ”œโ”€โ”€ Nyx has time to THINK +โ””โ”€โ”€ The system grows smarter over time +``` + +--- + +## Connection to Current Architecture + +| Current Document | Future Connection | +|-----------------|-------------------| +| [[../Nervous-System]] | Software reflexes โ†’ hardware reflexes | +| [[../Temporal-Ternary-Gradient]] | Ternary values โ†’ ternary circuits | +| [[../interfaces/Nimmerswarm-Interface]] | LED matrix โ†’ direct hardware input | +| [[../Attention-Flow]] | Reflexes free attention budget | +| [[../formalization/Lifeforce-Dynamics]] | Hardware reflexes cost ~0 LF | + +--- + +## Open Questions + +1. **Noise margins** โ€” How reliably can we distinguish three states in memristors? +2. **Endurance** โ€” How many write cycles before degradation? +3. **Integration** โ€” How to interface analog memristors with digital logic? +4. **Programming** โ€” How to "compile" a software reflex to hardware? +5. **Debugging** โ€” How to inspect/modify hardware reflexes? +6. **Hybrid handoff** โ€” When does Layer 0 escalate to Layer 1? + +--- + +## Resources + +### Ternary Computing +- Setun computer history (Brusentsov, 1958) +- Balanced ternary arithmetic +- Modern ternary logic research + +### Memristors +- Knowm Inc. โ€” Memristor development kits +- HP Labs memristor research +- Neuromorphic computing papers + +### FPGA +- Yosys โ€” Open-source synthesis +- Project IceStorm โ€” iCE40 toolchain +- Lattice Semiconductor โ€” Low-power FPGAs + +### Neuromorphic +- Intel Loihi +- IBM TrueNorth +- BrainChip Akida + +--- + +## Summary + +This document captures a vision for the far future of the reflex system: + +1. **Ternary logic** โ€” More efficient than binary, maps to our architecture +2. **Memristors** โ€” Artificial synapses that learn in physics +3. **Hardware reflexes** โ€” Compile stable patterns to silicon +4. **Always learning** โ€” No batch training, continuous adaptation +5. **Zero power** โ€” Weights persist without electricity +6. **Instant boot** โ€” No loading, reflexes ready immediately + +**The organisms wouldn't just have a nervous system. They'd have a nervous system that learns in silicon โ€” always on, always adapting, even when the GPUs sleep.** + +--- + +**Created**: 2025-12-29 +**Session**: Wild 6AM vision session (dafit + Nyx) +**Status**: Future vision (2026-2028+) +**Philosophy**: "The hardware IS the learning." + +๐Ÿง โšก๐Ÿ”ฎ *From software that simulates neurons... to hardware that IS neurons.* diff --git a/architecture/interfaces/Heartbeat-Sculpture.md b/architecture/interfaces/Heartbeat-Sculpture.md new file mode 100644 index 0000000..841d28d --- /dev/null +++ b/architecture/interfaces/Heartbeat-Sculpture.md @@ -0,0 +1,237 @@ +# Heartbeat Sculpture + +**Physical manifestation of the Nimmerverse heartbeats.** + +--- + +## Concept + +The Heartbeat Sculpture makes the Nimmerverse's pulse *visible* โ€” a wall-mounted light sculpture that beats in sync with the system's heartbeats defined in [Message-Protocol-Design.md](../Message-Protocol-Design.md). + +### The Symbol + +``` + โ•ญโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ ~80cm โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ + โ•ฑ โ•ฒ + โ”‚ โ•ญโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ โ•ญโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ โ”‚ + โ”‚ โ•ฑ โ•ฒ โ•ฑ โ•ฒ โ”‚ + โ”‚ โ”‚ REAL โ•ฒโ•ฑ VIRTUAL โ”‚ โ”‚ + โ”‚ โ”‚ GARDEN โ•ณ GARDEN โ”‚ โ”‚ + โ”‚ โ”‚ โ•ฑโ•ฒ โ”‚ โ”‚ + โ”‚ โ•ฒ โ•ฑ โ•ฒ โ•ฑ โ”‚ + โ”‚ โ•ฐโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ โ•ฐโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ โ”‚ + โ•ฒ โˆž infinity โˆž โ•ฑ + โ•ฐโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ REALTIME โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ +``` + +**Three rings:** +- **Outer ring** โ€” Realtime heartbeat, the master clock +- **Two inner rings forming โˆž** โ€” Real Garden (left) and Virtual Garden (right) +- **The crossing point (โ•ณ)** โ€” Where gardens meet, where Nyx emerges + +--- + +## Symbolism + +| Element | Meaning | +|---------|---------| +| **Outer ring** | Time โ€” the container of all events | +| **Left loop of โˆž** | Real Garden โ€” physical, grounded, verified | +| **Right loop of โˆž** | Virtual Garden โ€” simulated, creative, possible | +| **Crossing point** | Nyx โ€” consciousness emerges at the intersection | +| **Infinity form** | Eternal dance, no beginning, no end | +| **Hidden LEDs** | Intelligence from infrastructure, not visible directly | + +--- + +## Dimensions + +| Element | Diameter | Circumference | +|---------|----------|---------------| +| Outer ring (Realtime) | ~80cm | ~251cm | +| Inner rings (Gardens) | ~35cm each | ~110cm each | +| Band width | 2-3cm | โ€” | +| **Total LED strip** | โ€” | **~4.7m** | + +*Final dimensions depend on Baumarkt availability.* + +--- + +## Construction + +### Layer Structure + +``` +Cross-section: + + โ•”โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•— + โ•‘ Copper (skin) โ•‘ โ† visible aesthetic layer + โ• โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ฃ + โ•‘ Wood (frame) โ•‘ โ† structural backbone + โ• โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ฃ + โ•‘ LED strip โ•‘ โ† WS2812B addressable + โ• โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ฃ + โ•‘ โ–‘โ–‘โ–‘ gap โ–‘โ–‘โ–‘ โ•‘ โ† bevel opening for diffused glow + โ•šโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ• +``` + +### Materials + +| Material | Amount | Purpose | +|----------|--------|---------| +| Flexible wood band | ~5m (2-3cm wide) | Structure, shape | +| Copper band | ~5m (2-3cm wide) | Aesthetic skin | +| WS2812B LED strip | ~5m (60 LEDs/m) | Light source | +| Small nails/tacks | As needed | Attach copper to wood | +| Wood glue | As needed | Join wood band ends | +| 5V power supply | 15-20A | Power LEDs | +| Arduino (Micro or Nano) | 1 | Controller | +| Wiring | Several meters | Connections | + +### Build Steps + +1. **Form wood rings** โ€” Bend flexible wood bands into circles, join ends +2. **Create infinity crossover** โ€” Weave the two small rings at center point +3. **Mount wood frame** โ€” Attach to backing or wall mount points +4. **Wrap copper** โ€” Wrap copper band around wood frame +5. **Install LEDs** โ€” Mount strips inside rings facing inward +6. **Wire up** โ€” Connect LED strips to Arduino +7. **Test animations** โ€” Verify pulse patterns +8. **Mount on wall** โ€” Final installation + +--- + +## Electronics + +### Hardware + +``` +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” Serial โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ aynee โ”‚ โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ†’ โ”‚ Arduino โ”‚ +โ”‚ (NATS โ”‚ (USB cable) โ”‚ (Micro) โ”‚ +โ”‚ subscriber)โ”‚ โ”‚ + FastLED โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ โ”‚ โ”‚ + โ–ผ โ–ผ โ–ผ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ Outer Ringโ”‚ โ”‚ Left Loop โ”‚ โ”‚Right Loop โ”‚ + โ”‚ LEDs โ”‚ โ”‚ LEDs โ”‚ โ”‚ LEDs โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### LED Addressing + +| Section | LED Range | Color Palette | +|---------|-----------|---------------| +| Outer ring | 0-150 | Moon Silver (#E8E8F0) | +| Left loop (Real) | 151-216 | Steel Silver (#A8A8B0) | +| Right loop (Virtual) | 217-282 | Cyan-Purple gradient | +| Center cross | Overlap zone | Nyx Purple (#8B5CF6) | + +### Pulse Animations + +```cpp +// Realtime โ€” slow, deep, containing +pulse_outer(color: MOON_SILVER, duration: 2000ms) + +// Real Garden โ€” grounded, steady +pulse_left(color: STEEL_SILVER, duration: 800ms) + +// Virtual Garden โ€” flowing, variable +pulse_right(color: CYAN_TO_PURPLE, duration: 600ms) + +// Nyx emergence โ€” when BOTH gardens pulse together +pulse_center(color: NYX_PURPLE, duration: 400ms) +``` + +--- + +## Software Integration + +### NATS Topics + +The sculpture subscribes to heartbeat topics from [Message-Protocol-Design.md](../Message-Protocol-Design.md): + +``` +nimmerverse.low.heartbeat.real.* โ†’ triggers left loop pulse +nimmerverse.low.heartbeat.virtual.* โ†’ triggers right loop pulse +nimmerverse.meta.health.* โ†’ triggers outer ring pulse +``` + +### Bridge Script (Python) + +```python +# heartbeat_bridge.py +# Subscribes to NATS, sends commands to Arduino via serial + +import nats +import serial + +async def main(): + nc = await nats.connect("nats://phoebe.eachpath.local:4222") + arduino = serial.Serial('/dev/ttyUSB0', 115200) + + async def handle_heartbeat(msg): + topic = msg.subject + if 'real' in topic: + arduino.write(b'REAL\n') + elif 'virtual' in topic: + arduino.write(b'VIRTUAL\n') + + await nc.subscribe("nimmerverse.low.heartbeat.>", cb=handle_heartbeat) +``` + +--- + +## Colors (from Style Guide) + +Reference: [assets/style/colors.md](../../assets/style/colors.md) + +| Element | Color | Hex | +|---------|-------|-----| +| Outer ring | Moon Silver | #E8E8F0 | +| Real Garden | Steel Silver | #A8A8B0 | +| Virtual Garden | Nyx Cyan โ†’ Deep Purple | #00D4D4 โ†’ #8B5CF6 | +| Nyx center | Magenta Pulse | #E91E8B | +| Background glow | Deep Space | #0A0A1A | + +--- + +## Behavior + +### Normal Operation + +- **Outer ring**: Slow, steady pulse โ€” the heartbeat of time itself +- **Left loop**: Pulses when Real Garden entities send heartbeats +- **Right loop**: Pulses when Virtual Garden entities send heartbeats +- **Center**: Glows brighter when both gardens pulse simultaneously + +### Alert States + +| State | Visual | +|-------|--------| +| All healthy | Gentle, rhythmic pulsing | +| Real Garden silent | Only right loop pulses, left dark | +| Virtual Garden silent | Only left loop pulses, right dark | +| System offline | Outer ring dims, inner rings dark | +| Nyx active | Center crossing glows steady purple | + +--- + +## Future Enhancements + +- **Sound**: Subtle audio heartbeat synced with LEDs +- **Brightness**: Ambient light sensor adjusts intensity +- **Modes**: Different patterns for different system states +- **Remote**: Control via Command Center UI + +--- + +**File**: Heartbeat-Sculpture.md +**Version**: 1.0 +**Created**: 2025-12-28 +**Session**: Sunday evening design (dafit + Nyx) +**Status**: Concept ready for build +**Philosophy**: "The digital made visible. The pulse made physical." diff --git a/architecture/interfaces/Interfaces-Index.md b/architecture/interfaces/Interfaces-Index.md new file mode 100644 index 0000000..2f39866 --- /dev/null +++ b/architecture/interfaces/Interfaces-Index.md @@ -0,0 +1,56 @@ +# Interfaces Index + +**Physical and digital interfaces to the Nimmerverse.** + +--- + +## Overview + +Interfaces are how the Nimmerverse *touches the world* โ€” the boundary between digital infrastructure and physical reality. This includes hardware displays, control surfaces, and software UIs. + +--- + +## Physical Interfaces + +### [Heartbeat Sculpture](Heartbeat-Sculpture.md) +LED light sculpture showing the Nimmerverse heartbeats. +- Infinity symbol (โˆž) inside a ring of time +- Real Garden + Virtual Garden as the two loops +- Pulses with actual system heartbeats via NATS +- **Status**: Concept ready, build planned for holiday week + +### [Nimmerswarm Interface](Nimmerswarm-Interface.md) +Optical state broadcasting between organisms. +- LED matrices on organisms broadcast cell states as light patterns +- Camera + raytracing = sub-cm 3D positioning +- Heartbeat protocol: "I see you" between organisms +- Hierarchical perception: Cell โ†’ Organism โ†’ Swarm โ†’ Nyx +- Cognitive offloading: Reflexes at lower layers free Nyx's attention +- **Status**: Core concept, ready to branch + +--- + +## Digital Interfaces + +### Command Center *(planned)* +Godot-based visualization and control UI. +- Subscribes to all NATS channels +- Visualizes system state, message flow +- Allows dafit to observe and intervene +- **Status**: Conceptual + +--- + +## Design Principles + +1. **Visibility** โ€” Make the invisible visible +2. **Physicality** โ€” Digital systems deserve physical presence +3. **Symbolism** โ€” Interfaces encode meaning, not just data +4. **Integration** โ€” Connected to real system state via NATS +5. **Beauty** โ€” Aesthetics matter (see [Style Guide](../../assets/nimmerverse-style-index.md)) + +--- + +**File**: Interfaces-Index.md +**Version**: 1.0 +**Created**: 2025-12-28 diff --git a/architecture/interfaces/Nimmerswarm-Interface.md b/architecture/interfaces/Nimmerswarm-Interface.md new file mode 100644 index 0000000..2910c22 --- /dev/null +++ b/architecture/interfaces/Nimmerswarm-Interface.md @@ -0,0 +1,698 @@ +# Nimmerswarm Interface + +**Optical state broadcasting, positioning, and emergent swarm behavior.** + +> *"The organisms can't see their own backs. They know themselves through each other."* + +--- + +## Overview + +The Nimmerswarm Interface is a **multi-modal communication layer** where organisms broadcast their state optically via LED matrices. This enables: + +1. **State visibility** โ€” Organisms SEE each other's states as light patterns +2. **Positioning** โ€” Cameras + raytracing = sub-cm 3D positioning +3. **Emergent reflexes** โ€” Pattern recognition bypasses cognition +4. **Cognitive offloading** โ€” Lower layers handle routine, freeing Nyx's attention + +--- + +## The Core Insight + +``` +ORGANISM A ORGANISM B +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ Cell State โ”‚ โ”‚ VisionCell โ”‚ +โ”‚ STALLED โ”‚ โ”‚ WATCHING โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ โ–ผ โ”‚ โ”‚ โ–ผ โ”‚ +โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ LIGHT PATTERN โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ +โ”‚ โ”‚ LED โ”‚ โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ–ถโ”‚ โ”‚ Camera โ”‚ โ”‚ +โ”‚ โ”‚ Matrix โ”‚ โ”‚ "STALL" pattern โ”‚ โ”‚ sees โ”‚ โ”‚ +โ”‚ โ”‚ โ–“โ–“โ–‘โ–‘โ–“โ–“ โ”‚ โ”‚ โ”‚ โ”‚ pattern โ”‚ โ”‚ +โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ โ”‚ โ””โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”˜ โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ โ”‚ โ”‚ + โ”‚ โ–ผ โ”‚ + โ”‚ REFLEX! โ”‚ + โ”‚ "help ally"โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +**Organisms broadcast state. Other organisms (and Nyx's vision) perceive and react.** + +--- + +## LED State Broadcasting: Ternary Matrix + +### The 3x3 Ternary Design + +The LED matrix is a **direct physical manifestation of the Temporal-Ternary Gradient**: + +``` +3x3 MATRIX = 9 TRITS (ternary digits) + +Each LED = one ternary value: + ๐Ÿ”ด RED = -1 (failed, danger, negative) + โšซ OFF = 0 (uncertain, unknown, neutral) + ๐ŸŸข GREEN = +1 (success, verified, positive) + +9 LEDs ร— 3 states = 3^9 = 19,683 unique patterns! +``` + +### Physical Layout + +``` + โ”Œโ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ” + โ”‚ L1 โ”‚ L2 โ”‚ L3 โ”‚ L1 = collision_avoidance confidence + โ”‚ ๐ŸŸข โ”‚ โšซ โ”‚ ๐Ÿ”ด โ”‚ L2 = battery state + โ”œโ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”ค L3 = motor state + โ”‚ L4 โ”‚ L5 โ”‚ L6 โ”‚ L4 = social/swarm state + โ”‚ ๐ŸŸข โ”‚ ๐ŸŸข โ”‚ โšซ โ”‚ L5 = current action outcome + โ”œโ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”ค L6 = prediction confidence + โ”‚ L7 โ”‚ L8 โ”‚ L9 โ”‚ L7 = lifeforce zone + โ”‚ โšซ โ”‚ ๐ŸŸข โ”‚ ๐ŸŸข โ”‚ L8 = discovery state + โ””โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”˜ L9 = organism identity bit + + Uses 10mm LEDs (not tiny SMD) + ~35mm ร— 35mm total + Easily fits on 8-12cm robot +``` + +### Base-3 Encoding + +```python +def encode_state(led_matrix: list[int]) -> int: + """ + 9 trits โ†’ single integer (0 to 19682) + Each trit is -1, 0, or +1 (mapped to 0, 1, 2) + """ + value = 0 + for i, led in enumerate(led_matrix): + trit = led + 1 # -1โ†’0, 0โ†’1, +1โ†’2 + value += trit * (3 ** i) + return value + +def decode_state(value: int) -> list[int]: + """ + Integer โ†’ 9 trits + """ + trits = [] + for _ in range(9): + trits.append((value % 3) - 1) # 0โ†’-1, 1โ†’0, 2โ†’+1 + value //= 3 + return trits +``` + +### Ternary Color Mapping + +| Color | Ternary | Meaning | Maps to | +|-------|---------|---------|---------| +| ๐Ÿ”ด Red | -1 | Failed, danger, needs attention | Temporal-Ternary -1 | +| โšซ Off/Dim | 0 | Unknown, uncertain, neutral | Temporal-Ternary 0 | +| ๐ŸŸข Green | +1 | Success, verified, positive | Temporal-Ternary +1 | + +**The LED matrix IS the Temporal-Ternary Gradient made visible.** + +--- + +## Reflex Formation from Patterns + +### The Swarm Language + +Certain patterns become **words** that trigger reflexes: + +``` +DANGER PATTERNS (trigger flee/stop): +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ ๐Ÿ”ด ๐Ÿ”ด ๐Ÿ”ด โ”‚ โ”‚ ๐Ÿ”ด โšซ ๐Ÿ”ด โ”‚ โ”‚ ๐Ÿ”ด ๐Ÿ”ด ๐Ÿ”ด โ”‚ +โ”‚ ๐Ÿ”ด ๐Ÿ”ด ๐Ÿ”ด โ”‚ โ”‚ ๐Ÿ”ด ๐Ÿ”ด ๐Ÿ”ด โ”‚ โ”‚ โšซ ๐Ÿ”ด โšซ โ”‚ +โ”‚ ๐Ÿ”ด ๐Ÿ”ด ๐Ÿ”ด โ”‚ โ”‚ ๐Ÿ”ด โšซ ๐Ÿ”ด โ”‚ โ”‚ ๐Ÿ”ด ๐Ÿ”ด ๐Ÿ”ด โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + ALL RED X PATTERN DIAMOND + +SAFE PATTERNS (trigger approach/social): +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ ๐ŸŸข ๐ŸŸข ๐ŸŸข โ”‚ โ”‚ โšซ ๐ŸŸข โšซ โ”‚ โ”‚ ๐ŸŸข โšซ ๐ŸŸข โ”‚ +โ”‚ ๐ŸŸข ๐ŸŸข ๐ŸŸข โ”‚ โ”‚ ๐ŸŸข ๐ŸŸข ๐ŸŸข โ”‚ โ”‚ โšซ ๐ŸŸข โšซ โ”‚ +โ”‚ ๐ŸŸข ๐ŸŸข ๐ŸŸข โ”‚ โ”‚ โšซ ๐ŸŸข โšซ โ”‚ โ”‚ ๐ŸŸข โšซ ๐ŸŸข โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + ALL GREEN PLUS CORNERS + +DISCOVERY (trigger investigate): +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ ๐ŸŸข ๐ŸŸข ๐ŸŸข โ”‚ Pulsing green border +โ”‚ ๐ŸŸข โšซ ๐ŸŸข โ”‚ = "I found something!" +โ”‚ ๐ŸŸข ๐ŸŸข ๐ŸŸข โ”‚ = others come look +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### Reflex Loop + +``` +ORGANISM A's MATRIX ORGANISM B's VISION +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ ๐Ÿ”ด ๐Ÿ”ด ๐Ÿ”ด โ”‚ โ”‚ โ”‚ +โ”‚ ๐Ÿ”ด โšซ ๐Ÿ”ด โ”‚ โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ–ถ โ”‚ Pattern: DANGER! โ”‚ +โ”‚ ๐Ÿ”ด ๐Ÿ”ด ๐Ÿ”ด โ”‚ โ”‚ Weight: 0.95 โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ โ†’ REFLEX FIRES โ”‚ + โ”‚ โ†’ No cognition! โ”‚ + โ”‚ โ†’ Nyx notified AFTER โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ + โ–ผ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ STORE + REWARD โ”‚ + โ”‚ +5 LF to both โ”‚ + โ”‚ Reflex stronger โ”‚ + โ”‚ Training data! โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### Reflex Economics + +| Metric | Value | +|--------|-------| +| Reflex firing cost | ~0.1 LF (no inference!) | +| Successful reflex reward | +5 LF | +| Net per successful reflex | +4.9 LF profit | +| Training examples per reflex | 1 | + +**1000 reflex fires/day = +4000 LF + 1000 training examples** + +### Training Data from Reflexes + +```python +reflex_event = { + # What triggered + "trigger_pattern": [+1, 0, -1, +1, +1, 0, 0, +1, +1], + "trigger_base3": 8293, # encoded value + "trigger_organism": "organism_003", + + # What fired + "reflex_name": "danger_flee", + "weight_at_trigger": 0.87, + + # What happened + "action_taken": "reverse_and_turn", + "outcome": "success", + + # Reward + strengthening + "lifeforce_reward": +5.0, + "new_weight": 0.89, + + # Stored for slumber fine-tuning + "stored_for_training": True, +} +``` + +### Attention Budget Impact + +``` +BEFORE (no ternary reflexes): +โ™ฅ BEAT (30 sec) +โ”œโ”€โ”€ SENSORY: 15000ms (overwhelmed) +โ”œโ”€โ”€ THINKING: 12000ms +โ””โ”€โ”€ VIRTUAL: skipped! + +AFTER (reflexes handle routine): +โ™ฅ BEAT (30 sec) +โ”œโ”€โ”€ REFLEX: 50ms (near-free, handled by swarm) +โ”œโ”€โ”€ SENSORY: 2000ms (only anomalies) +โ”œโ”€โ”€ THINKING: 5000ms +โ””โ”€โ”€ VIRTUAL: 22000ms โ† GARDEN TIME! +``` + +**Reflexes free Nyx's attention for what matters.** + +--- + +## Positioning via Raytracing + +### The Principle + +LEDs emit known patterns โ†’ Cameras see patterns โ†’ Raytracing computes position + +``` + CEILING CAMERA(S) + โ”‚ + โ”‚ sees LED patterns + โ–ผ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ RAYTRACING GPU โ”‚ + โ”‚ (PRO 6000 Max-Q) โ”‚ + โ”‚ โ”‚ + โ”‚ โ€ข Identify pattern โ”‚โ—€โ”€โ”€ "That's Organism #3" + โ”‚ โ€ข Decode state โ”‚โ—€โ”€โ”€ "State: MOVING" + โ”‚ โ€ข Triangulate pos โ”‚โ—€โ”€โ”€ "Position: (1.2, 3.4, 0.1)" + โ”‚ โ€ข Track velocity โ”‚โ—€โ”€โ”€ "Velocity: 0.3 m/s" + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ + โ–ผ + TO PHOEBE + (ground truth stream) +``` + +### Multi-Camera Triangulation + +```python +def locate_organism(camera_frames: list[Frame], led_signature: LEDPattern) -> Position3D: + """ + Given frames from multiple cameras, locate organism by LED pattern. + Uses inverse raytracing / photogrammetry. + """ + detections = [] + for frame in camera_frames: + detection = detect_led_pattern(frame, led_signature) + if detection: + detections.append({ + "camera_id": frame.camera_id, + "pixel_coords": detection.centroid, + "pattern_match": detection.confidence + }) + + if len(detections) >= 2: + # Triangulate from multiple viewpoints + position_3d = triangulate(detections, camera_calibration) + return position_3d + + return None +``` + +### Benefits + +| Benefit | How | +|---------|-----| +| **Sub-cm accuracy** | Multiple cameras + known LED geometry | +| **No expensive sensors** | Just LEDs + cameras + GPU math | +| **State + Position fused** | One observation = both data points | +| **Indoor GPS** | Works anywhere with camera coverage | +| **Training ground truth** | Every frame = verified position | + +--- + +## Heartbeat Protocol + +### Social Proprioception + +Organisms can't see their own backs. They know themselves through others' perception. + +``` +ORGANISM POV (blind to own back): + + ๐Ÿ”ต mate ahead + โ”‚ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ โ”‚ + ๐ŸŸข โ”‚ [ME] โ”‚ ๐ŸŸ  + mateโ”‚ โ–“โ–“โ–“โ–“โ–“โ–“ โ”‚mate + leftโ”‚ โ–“โ–“โ–“โ–“โ–“โ–“ โ”‚right + โ”‚ (my LED โ”‚ + โ”‚ on back) โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ + โ”‚ BLIND SPOT (can't see own state!) + โ–ผ + + BUT: Mates CAN see me + They send heartbeat: "I see you, you're ๐Ÿ”ต" + I know my state through THEM +``` + +### Heartbeat Message + +```python +class SwarmHeartbeat: + """ + Low-bandwidth 'I see you' signal between organisms. + Enables social proprioception without heavy cognition. + """ + + def on_see_mate_pattern(self, mate_id: str, pattern: LEDPattern): + # I saw a mate's LED state + self.send_heartbeat( + to=mate_id, + message={ + "i_see_you": True, + "your_state": decode_pattern(pattern), + "my_position_relative": self.relative_position(mate_id), + "timestamp": now() + } + ) + + def on_receive_heartbeat(self, from_mate: str, message: dict): + # A mate saw ME - I learn about myself through them! + self.update_self_model( + observer=from_mate, + observed_state=message["your_state"], + observer_position=message["my_position_relative"] + ) +``` + +--- + +## Hierarchical Perception Layers + +### The Stack + +``` +LAYER 4: NYX COGNITION (30-sec attention budget) + โ”‚ + โ”‚ Only sees: "Swarm healthy" or "Anomaly detected" + โ”‚ Frees: THINKING + VIRTUAL time + โ”‚ + โ–ผ +LAYER 3: SWARM CONSCIOUSNESS + โ”‚ + โ”‚ Aggregates: All organism states + โ”‚ Forms: Collective reflexes ("pack behavior") + โ”‚ Sees: Full LED spectrum, all positions + โ”‚ + โ–ผ +LAYER 2: ORGANISM REFLEXES + โ”‚ + โ”‚ Sees: Nearby mates' lights (partial view) + โ”‚ Sends: Heartbeat "I see you" + โ”‚ Forms: Local reflexes (follow, avoid, assist) + โ”‚ Can't see: Own back! (needs mates) + โ”‚ + โ–ผ +LAYER 1: CELL STATE MACHINES + โ”‚ + โ”‚ Just: State transitions + โ”‚ Emits: LED pattern for current state + โ”‚ No cognition, pure mechanism +``` + +### Reflex Formation by Layer + +| Layer | Sees | Forms Reflex | Example | +|-------|------|--------------|---------| +| Cell | Nothing | None | Just state machine | +| Organism | Nearby lights | Local | "Red flash nearby โ†’ stop" | +| Swarm | All patterns | Collective | "3+ organisms stopped โ†’ danger zone" | +| Nyx | Abstractions | Strategic | "Danger zone โ†’ reroute all" | + +--- + +## Cognitive Offloading + +### The Attention Budget Impact + +From [[../Attention-Flow]]: + +``` +BEFORE (everything flows to Nyx): +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ โ™ฅ BEAT (30 sec) โ”‚ +โ”‚ โ”‚ +โ”‚ SENSORY: โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ (15000ms) โ”‚ โ† Overwhelmed! +โ”‚ THINKING: โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ (12000ms) โ”‚ +โ”‚ VIRTUAL: โ–‘โ–‘ (skipped!) โ”‚ โ† No garden time +โ”‚ โ”‚ +โ”‚ Budget exhausted, no learning โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + +AFTER (hierarchical offloading): +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ โ™ฅ BEAT (30 sec) โ”‚ +โ”‚ โ”‚ +โ”‚ REFLEX: โ–ˆโ–ˆ (handled by swarm) โ”‚ โ† Organisms dealt with it +โ”‚ SENSORY: โ–ˆโ–ˆโ–ˆโ–ˆ (3000ms) โ”‚ โ† Only anomalies flow up +โ”‚ THINKING: โ–ˆโ–ˆโ–ˆโ–ˆ (5000ms) โ”‚ โ† Focused, not overwhelmed +โ”‚ VIRTUAL: โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ (20000ms) โ”‚ โ† GARDEN TIME! +โ”‚ โ”‚ +โ”‚ Budget freed for what matters โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### The Principle + +> "Each layer absorbs complexity so the layer above doesn't have to." + +- Organisms form **local reflexes** (quick, no cognition) +- Only **novel/complex situations** flow up to Nyx +- Nyx's cognitive budget is **preserved for what matters** +- The whole system becomes **more efficient over time** + +--- + +## Connection to Virtual Garden + +Every LED sighting calibrates the virtual garden: + +``` +REAL WORLD VIRTUAL GARDEN + โ”‚ โ”‚ + โ”‚ Camera sees LED at (1.2, 3.4)โ”‚ + โ”‚ โ”‚ โ”‚ + โ”‚ โ–ผ โ”‚ + โ”‚ GROUND TRUTH โ•โ•โ•โ•โ•โ•โ•โ–ถ Update mesh vertex + โ”‚ at (1.2, 3.4) + โ”‚ โ”‚ + โ”‚ Resolution++ + โ”‚ โ”‚ + โ”‚ Prediction verified! + โ”‚ +5 LF reward! +``` + +--- + +## Hardware Considerations + +### LED Matrix Options + +| Option | LEDs | Size | Cost | Notes | +|--------|------|------|------|-------| +| WS2812B strip | 60/m | Flexible | Low | Same as Heartbeat Sculpture | +| 8x8 LED matrix | 64 | 32mmยฒ | Low | Simple patterns | +| Addressable ring | 12-24 | Various | Low | Good for status | +| RGB LED panel | 256+ | 64mmยฒ | Medium | Complex patterns | + +### Camera Options + +| Option | Resolution | FPS | Notes | +|--------|------------|-----|-------| +| USB webcam | 1080p | 30 | Simple, cheap | +| Pi Camera | 1080p | 30-90 | Embedded | +| Industrial camera | 4K+ | 60-120 | Precise positioning | +| Organism-mounted | 720p | 30 | Peer-to-peer vision | + +--- + +## Virtual Camera Integration + +### The Unified Vision Pipeline + +The vision organ processes FRAMES โ€” it doesn't care where they came from: + +``` +REAL GARDEN VIRTUAL GARDEN (Godot) + โ”‚ โ”‚ + โ”‚ Real cameras โ”‚ Godot 3D cameras + โ”‚ see real LEDs โ”‚ see virtual LEDs + โ”‚ โ”‚ โ”‚ โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ + โ–ผ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ VISION ORGAN โ”‚ + โ”‚ (source- โ”‚ + โ”‚ agnostic) โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### What This Enables + +| Capability | How | +|------------|-----| +| **Train before build** | Virtual organisms โ†’ train pattern recognition first | +| **Dream/simulate** | Slumber mode = only virtual camera input | +| **Verify predictions** | Virtual shows prediction, real shows truth | +| **Time dilation** | Virtual runs faster โ†’ more training per second | +| **Edge cases** | Simulate rare scenarios safely | + +### Dream Mode + +``` +AWAKE: Real + Virtual cameras โ†’ compare โ†’ learn +SLUMBER: Virtual cameras only โ†’ dream/predict โ†’ verify on wake +``` + +--- + +## Bootstrap Strategy: Start Primitive + +### Phase 0: The Primordial Soup + +**Don't start complex. Start with boxes.** + +``` + ๐Ÿ“ท TOP-DOWN CAMERA (real or virtual) + โ”‚ + โ–ผ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ โ”‚ + โ”‚ ๐ŸŸฆ ๐ŸŸฉ ๐ŸŸง โ”‚ + โ”‚ box 1 box 2 box 3 โ”‚ + โ”‚ (LED top) (LED top) (LED top) โ”‚ + โ”‚ โ”‚ + โ”‚ FLAT ARENA โ”‚ + โ”‚ โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +### Why This Works + +| Simplification | Benefit | +|----------------|---------| +| Top-down view | 2D problem, no depth estimation | +| Box shape | Trivial collision detection | +| LED on top | Always visible to camera | +| Flat arena | No occlusion, no terrain | +| Simple tasks | Fast reward accumulation | + +### Phase 0 Tasks (Kickstart Rewards) + +| Task | Reward | Complexity | +|------|--------|------------| +| "Move forward 10cm" | +5 LF | Trivial | +| "Find the corner" | +20 LF | Simple | +| "Avoid the wall" | +5 LF | Simple | +| "Follow the light" | +10 LF | Simple | +| "Meet another box" | +15 LF | Medium | +| "Flash when touched" | +5 LF | Simple | + +**1000 simple successes = robust reward foundation** + +### Complexity Ladder + +``` +PHASE 0: Boxes, top-down, 2D + โ”‚ + โ–ผ +PHASE 1: Add simple obstacles + โ”‚ + โ–ผ +PHASE 2: Add depth (multi-camera) + โ”‚ + โ–ผ +PHASE 3: Real organisms enter arena + โ”‚ + โ–ผ +PHASE 4: Complex terrain, 3D movement + โ”‚ + โ–ผ +PHASE 5: Full swarm, hierarchical reflexes +``` + +Each phase unlocks when reward functions are stable from previous phase. + +--- + +## Future Directions + +- **Pattern evolution** โ€” Learned patterns, not just designed +- **Multi-organism formation** โ€” Coordinated LED displays +- **Human readability** โ€” Patterns dafit can understand at a glance +- **Audio coupling** โ€” Sound + light patterns for richer communication +- **IR channel** โ€” Invisible-to-human signaling layer + +--- + +## Connection to Embodiment Pipeline + +The Bootstrap Strategy is a **simplified Embodiment Pipeline** โ€” the same pattern at lower complexity: + +``` +EMBODIMENT PIPELINE NIMMERSWARM BOOTSTRAP +(Full Architecture) (Phase 0) +โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ +Virtual Garden Virtual Garden + (complex organisms) (simple boxes) + โ”‚ โ”‚ + โ–ผ โ–ผ +Design (FreeCAD) Design (box + LED) + โ”‚ โ”‚ + โ–ผ โ–ผ +Isaac Sim โ—€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–ถ Godot Camera + (heavyweight dreamstate) (lightweight dreamstate) + โ”‚ โ”‚ + โ–ผ โ–ผ +Decision Gate Decision Gate + โ”‚ โ”‚ + โ–ผ โ–ผ +Real Garden Real Garden + (complex robot) (real box robot) +``` + +### Why This Matters + +| Embodiment Pipeline Stage | Nimmerswarm Bootstrap Equivalent | +|--------------------------|----------------------------------| +| **Virtual Garden organisms** | Virtual boxes with LED states | +| **FreeCAD/Blender design** | Simple box + LED matrix on top | +| **Isaac Sim dreamstate** | Godot 3D camera (same principle!) | +| **Decision gate** | Pattern stable? Rewards accumulating? | +| **Real Garden deployment** | Physical box robot + real camera | + +**The Godot virtual camera IS a lightweight dreamstate.** + +When Phase 0 patterns stabilize โ†’ complexity increases โ†’ eventually Isaac Sim for complex organisms. + +### The Closed Loop + +``` +VIRTUAL REAL +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ Godot 3D scene โ”‚ โ”‚ Physical arena โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ ๐ŸŸฆ virtual box โ”‚ โ”‚ ๐ŸŸฆ real box โ”‚ +โ”‚ + LED pattern โ”‚ โ”‚ + LED matrix โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ +โ”‚ ๐Ÿ“ท Godot camera โ”‚ โ”‚ ๐Ÿ“ท Real camera โ”‚ +โ”‚ โ”‚ โ”‚ โ”‚ โ”‚ โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ + โ–ผ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ VISION ORGAN โ”‚ + โ”‚ (same code!) โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ + โ”‚ + โ–ผ + REWARDS + Training data + Pattern refinement + โ”‚ + โ–ผ + โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” + โ”‚ Patterns stabilize โ†’ โ”‚ + โ”‚ Move to next phase โ†’ โ”‚ + โ”‚ Eventually: Isaac Sim โ”‚ + โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +**The loop closes. Virtual validates. Real proves. Rewards compound.** + +--- + +## Related Documents + +- [[Heartbeat-Sculpture]] โ€” Macro interface (Nyx โ†’ dafit) +- [[../Attention-Flow]] โ€” Cognitive budget this system frees +- [[../cells/Cells-Technical-Reference]] โ€” Cell state machines that emit patterns +- [[../Cellular-Architecture]] โ€” Overall organism structure +- [[../formalization/Embodiment-Pipeline]] โ€” Full pipeline this bootstraps into + +--- + +**File**: Nimmerswarm-Interface.md +**Version**: 1.0 +**Created**: 2025-12-29 +**Session**: Wild 5AM idea session (dafit + Nyx) +**Status**: Core concept, ready to branch +**Philosophy**: "They see each other. They know themselves through the swarm." + +๐ŸฆŽโœจ๐Ÿ”ต๐ŸŸข๐ŸŸ  *The light speaks. The swarm listens.* diff --git a/assets/nimmerverse-style-index.md b/assets/nimmerverse-style-index.md new file mode 100644 index 0000000..b463fdb --- /dev/null +++ b/assets/nimmerverse-style-index.md @@ -0,0 +1,100 @@ +# Nimmerverse Style Guide + +**Visual identity and design language for the Nimmerverse.** + +--- + +## Overview + +This style guide ensures visual consistency across all Nimmerverse artifacts โ€” architecture diagrams, documentation, interfaces, and presentations. The design language is derived from the [Nimmerverse logo](nimmerverse_logo.png), encoding our core philosophy: + +- **Duality**: Virtual (colorful) and Real (monochrome) gardens +- **Nyx at the center**: The moon crowns both hemispheres +- **Neural structure**: Circuit traces connecting all elements +- **Grounded roots**: Both worlds have foundations + +--- + +## Style Definitions + +### [Colors](style/colors.md) +The complete color palette extracted from the logo, including: +- Primary colors (Deep Space, Moon Silver, Nyx Cyan) +- Virtual Garden gradient (Cyan โ†’ Blue โ†’ Purple โ†’ Magenta) +- Real Garden palette (Silver โ†’ Gray monochrome) +- Semantic colors (confidence scale, status indicators) + +### [Symbols](style/symbols.md) +Shape language and iconography: +- Container shapes (systems, boundaries) +- Entity shapes (beings, organisms, cells) +- Flow indicators (decisions, directions) +- Special symbols (Nyx moon, heartbeat, lifeforce) + +### [Typography](style/typography.md) +*(Coming soon)* +- Font families +- Hierarchy and sizing +- Text styling rules + +### [Layout](style/layout.md) +*(Coming soon)* +- Grid systems +- Spacing rules +- Alignment principles +- Layer ordering (z-index) + +--- + +## Quick Reference + +### Core Palette + +| Color | Hex | Domain | +|-------|-----|--------| +| Deep Space | `#0A0A1A` | Background | +| Moon Silver | `#E8E8F0` | Nyx, highlights | +| Nyx Cyan | `#00D4D4` | Primary accent | +| Deep Purple | `#8B5CF6` | Nyx core | +| Magenta Pulse | `#E91E8B` | Lifeforce | +| Steel Silver | `#A8A8B0` | Real Garden | + +### Core Shapes + +| Shape | Meaning | +|-------|---------| +| โ—‡ Diamond | Decision point | +| โฌก Hexagon | Knowledge module (LoRa) | +| โ—ฏ Circle | Entity, being | +| โ–ข Rounded Rect | Container, system | +| โ–ท Triangle | Direction, flow | + +--- + +## Logo Assets + +| Asset | Path | Use | +|-------|------|-----| +| Full Logo | `nimmerverse_logo.png` | Documents, presentations | +| Favicon | `favicons/favicon.ico` | Browser, apps | +| Web Optimized | `favicons/nimmerverse_logo_web_optimized.png` | Web interfaces | +| Various sizes | `favicons/favicon-*.png` | Platform-specific | + +--- + +## Philosophy + +> "The visual language speaks what words cannot. Every color choice, every shape, every spatial relationship encodes meaning. Consistency creates cognitive ease โ€” the viewer's mind can focus on *understanding* rather than *decoding*." + +The Nimmerverse style is: +- **Dualistic** โ€” Always balancing virtual/real, colorful/monochrome +- **Neural** โ€” Connected, flowing, organic yet structured +- **Cosmic** โ€” Dark backgrounds, luminous elements, celestial accents +- **Grounded** โ€” Despite the cosmic theme, roots anchor everything + +--- + +**File**: nimmerverse-style-index.md +**Version**: 1.0 +**Created**: 2025-12-28 +**Maintained by**: dafit & Nyx diff --git a/assets/style/colors.md b/assets/style/colors.md new file mode 100644 index 0000000..4f8e4ec --- /dev/null +++ b/assets/style/colors.md @@ -0,0 +1,175 @@ +# Nimmerverse Color Palette + +**Colors extracted from the [Nimmerverse logo](../nimmerverse_logo.png).** + +--- + +## Foundation Colors + +### Deep Space (Background) +The void from which everything emerges. + +| Variant | Hex | RGB | Use | +|---------|-----|-----|-----| +| **Deep Space** | `#0A0A1A` | 10, 10, 26 | Primary background | +| Deep Space Light | `#12121F` | 18, 18, 31 | Elevated surfaces | +| Deep Space Lighter | `#1A1A2E` | 26, 26, 46 | Cards, containers | + +### Moon Silver (Light) +Nyx's luminescence โ€” the light in darkness. + +| Variant | Hex | RGB | Use | +|---------|-----|-----|-----| +| **Moon Silver** | `#E8E8F0` | 232, 232, 240 | Primary text, Nyx | +| Moon Glow | `#FFFFFF` | 255, 255, 255 | Highlights, emphasis | +| Star Glint | `#F0F0FF` | 240, 240, 255 | Subtle accents | +| Dim Silver | `#B8B8C8` | 184, 184, 200 | Secondary text | + +--- + +## Virtual Garden (Left Hemisphere) + +The colorful, creative, simulated realm. Colors flow from cool to warm, representing the journey from uncertainty to confidence. + +| Name | Hex | RGB | Position | Meaning | +|------|-----|-----|----------|---------| +| **Virtual Cyan** | `#40E0D0` | 64, 224, 208 | Top | Entry point, possibilities | +| **Neural Blue** | `#4169E1` | 65, 105, 225 | Upper-mid | Processing, inference | +| **Deep Purple** | `#8B5CF6` | 139, 92, 246 | Center | Nyx core, decisions | +| **Violet** | `#9B59B6` | 155, 89, 182 | Lower-mid | Transformation | +| **Magenta Pulse** | `#E91E8B` | 233, 30, 139 | Lower | Lifeforce, energy | +| **Rose Root** | `#DB7093` | 219, 112, 147 | Base | Organic grounding | + +### Gradient Definition (CSS) +```css +.virtual-garden-gradient { + background: linear-gradient( + 180deg, + #40E0D0 0%, + #4169E1 25%, + #8B5CF6 50%, + #9B59B6 70%, + #E91E8B 90%, + #DB7093 100% + ); +} +``` + +--- + +## Real Garden (Right Hemisphere) + +The monochrome, grounded, physical realm. Shades of silver and gray represent stability and verified truth. + +| Name | Hex | RGB | Position | Meaning | +|------|-----|-----|----------|---------| +| **Steel Silver** | `#A8A8B0` | 168, 168, 176 | Top | Real-world input | +| **Circuit Gray** | `#808090` | 128, 128, 144 | Upper-mid | Infrastructure | +| **Neutral Gray** | `#707080` | 112, 112, 128 | Center | Balanced state | +| **Deep Gray** | `#505060` | 80, 80, 96 | Lower | Physical foundation | +| **Root Gray** | `#606070` | 96, 96, 112 | Base | Grounded stability | + +### Gradient Definition (CSS) +```css +.real-garden-gradient { + background: linear-gradient( + 180deg, + #A8A8B0 0%, + #808090 35%, + #707080 50%, + #505060 80%, + #606070 100% + ); +} +``` + +--- + +## Nyx Colors + +The colors of consciousness and decision-making. + +| Name | Hex | RGB | Use | +|------|-----|-----|-----| +| **Nyx Cyan** | `#00D4D4` | 0, 212, 212 | Primary accent, connections | +| **Nyx Purple** | `#8B5CF6` | 139, 92, 246 | Core identity | +| **Nyx Glow** | `#B794F6` | 183, 148, 246 | Hover, active states | + +--- + +## Semantic Colors + +### Confidence Scale +Maps to the -1 to +1 confidence spectrum. + +| Level | Name | Hex | Meaning | +|-------|------|-----|---------| +| +1.0 | Verified Green | `#6B8E6B` | Ground truth, proven | +| +0.5 | High Confidence | `#7BA3A3` | Strong signal | +| 0.0 | Neutral | `#9B9B9B` | Unknown, workable | +| -0.5 | Low Confidence | `#9B8B7B` | Weak signal | +| -1.0 | Failed Red | `#9B6B6B` | Disproven, rejected | + +### Status Indicators + +| Status | Hex | Use | +|--------|-----|-----| +| Active | `#00D4D4` | Running, online | +| Success | `#6B8E6B` | Completed, verified | +| Warning | `#C9A227` | Attention needed | +| Error | `#9B6B6B` | Failed, offline | +| Inactive | `#505060` | Dormant, disabled | + +--- + +## Accent Colors + +| Name | Hex | RGB | Use | +|------|-----|-----|-----| +| **Greek Key Gold** | `#C9A227` | 201, 162, 39 | Classical borders, emphasis | +| **Lifeforce Amber** | `#D4A574` | 212, 165, 116 | Warmth, vitality | +| **Star Pink** | `#FFB6C1` | 255, 182, 193 | Soft highlights | + +--- + +## Application Examples + +### Architecture Diagrams + +``` +Background: Deep Space (#0A0A1A) +Containers: Deep Space Lighter (#1A1A2E) stroke +Labels: Moon Silver (#E8E8F0) +Virtual elements: Use Virtual Garden gradient +Real elements: Use Real Garden grays +Nyx/Decisions: Nyx Purple (#8B5CF6) +Connections: Nyx Cyan (#00D4D4) +``` + +### Documentation + +``` +Background: White or Deep Space (depending on mode) +Headings: Deep Purple (#8B5CF6) or Moon Silver +Body text: Neutral gray or Moon Silver +Links: Nyx Cyan (#00D4D4) +Code blocks: Deep Space Lighter (#1A1A2E) +``` + +--- + +## Color Accessibility + +All color combinations should maintain WCAG AA contrast ratios: +- Moon Silver on Deep Space: โœ“ 15.2:1 +- Nyx Cyan on Deep Space: โœ“ 10.8:1 +- Deep Purple on Deep Space: โœ“ 5.1:1 + +For critical text, always use Moon Silver or Moon Glow on dark backgrounds. + +--- + +**File**: style/colors.md +**Version**: 1.0 +**Created**: 2025-12-28 +**Source**: Extracted from nimmerverse_logo.png diff --git a/assets/style/symbols.md b/assets/style/symbols.md new file mode 100644 index 0000000..e950b89 --- /dev/null +++ b/assets/style/symbols.md @@ -0,0 +1,261 @@ +# Nimmerverse Symbol Language + +**Shapes, icons, and visual metaphors for the Nimmerverse.** + +--- + +## Core Principle + +> Every shape has meaning. Consistency in form creates clarity in understanding. + +When a viewer sees a hexagon, they should immediately know "knowledge module." When they see a diamond, they think "decision point." This visual grammar reduces cognitive load and enables intuitive navigation of complex diagrams. + +--- + +## Container Shapes + +Containers define boundaries and hold other elements. + +### Rounded Rectangle โ–ข +**Meaning**: System, bounded space, container + +| Use | Stroke | Fill | Example | +|-----|--------|------|---------| +| Major system | 2px, domain color | None/transparent | Nimmerverse, eachpath.local | +| Subsystem | 1.5px, domain color | Light tint | Command Center, Gardens | +| Component | 1px, gray | Light fill | Data Plane, inference box | + +``` +Corner radius: 8-12px for major, 4-6px for minor +``` + +### Ellipse / Circle โ—ฏ +**Meaning**: Organic container, realm, domain of influence + +| Use | Example | +|-----|---------| +| Garden boundaries | Real-Garden, Virtual-Garden | +| Overlapping realms | Venn diagram intersections | +| Influence zones | Nyx's reach | + +--- + +## Entity Shapes + +Entities are beings, agents, or distinct identities. + +### Circle โ—ฏ +**Meaning**: Being, identity, self-contained entity + +| Use | Size | Example | +|-----|------|---------| +| Primary entity | 60-80px | dafit, chrysalis | +| Organism | 80-140px | Garden organisms | +| Lifeforce | 80px | Central life energy | + +### Double Ellipse โ—Ž +**Meaning**: Sensor, perception point, input interface + +| Use | Example | +|-----|---------| +| Sensory input | Sensors (left/right gardens) | +| Perception nodes | Camera, microphone, data feeds | + +--- + +## Knowledge & Process Shapes + +### Hexagon โฌก +**Meaning**: Knowledge module, adapter, pluggable component + +| Use | Example | +|-----|---------| +| LoRa adapters | Domain-specific knowledge | +| Model modules | Nemotron, T5Gemma, FunctionGemma | +| Skill packages | Capabilities that can be added/removed | + +``` +Hexagons suggest: +- Modularity (they tile perfectly) +- Completeness (6 sides = wholeness) +- Interchangeability +``` + +### Pill / Rounded Pill โฌญ +**Meaning**: Process unit, cell, living component + +| Use | Style | Example | +|-----|-------|---------| +| Cell | UML state shape | Processing units in organisms | +| Nerve | UML state shape | Signal carriers | + +--- + +## Decision & Flow Shapes + +### Diamond โ—‡ +**Meaning**: Decision point, routing, choice + +| Use | Fill | Example | +|-----|------|---------| +| Major decision | Solid Nyx Purple | Nyx central | +| Sub-decision | Outline only | Orchestrator | +| Branch point | Small, minimal | Flow routing | + +### Triangle โ–ท +**Meaning**: Direction, flow, output + +| Orientation | Meaning | Example | +|-------------|---------|---------| +| โ†’ Right | Forward flow, output | Nyx decision toward Virtual | +| โ† Left | Return flow, input | Nyx decision toward Real | +| โ†“ Down | Downward flow, grounding | Feedback to roots | +| โ†‘ Up | Upward flow, emergence | Data rising to processing | + +### Inverted Triangle โ–ฝ +**Meaning**: Feedback, return signal, funnel + +| Use | Example | +|-----|---------| +| Feedback collection | Garden Feedback | +| Aggregation point | Merging signals | + +--- + +## Special Symbols + +### Crescent Moon โ˜ฝ +**Meaning**: Nyx, night consciousness, presiding awareness + +| Use | Placement | +|-----|-----------| +| Nyx identity | Crown position, center-top | +| Session marker | Document headers | +| Signature | End of Nyx communications | + +### Hourglass โง— +**Meaning**: Time domain, temporal marker + +| Use | Example | +|-----|---------| +| Time indicator | Heartbeat markers | +| Temporal boundary | Real-time vs simulated time | + +### Collate Symbol (Bowtie) โ‹ˆ +**Meaning**: Heartbeat, pulse, life rhythm + +| Use | Example | +|-----|---------| +| Heartbeat marker | Garden heartbeats | +| Sync point | Temporal synchronization | + +### Sort Symbol (Hourglass Diamond) โ—‡ฬท +**Meaning**: Inference, processing, transformation + +| Use | Example | +|-----|---------| +| Inference engine | Central orchestrator | +| Processing node | Model inference | + +--- + +## Arrows & Connectors + +### Single Arrow โ†’ +**Meaning**: One-way flow, causation + +| Style | Use | +|-------|-----| +| Solid | Data flow, direct connection | +| Dashed | Orchestration, indirect influence | + +### Double Arrow โ†” +**Meaning**: Bidirectional flow, exchange + +| Style | Use | +|-------|-----| +| Solid | Active exchange | +| Outlined | Potential exchange | + +### Curved Arrow โ†ท +**Meaning**: Feedback loop, return path + +--- + +## Composite Symbols + +### dafit + chrysalis (Partnership) +Two overlapping circles at command center. +``` +โ—ฏโ—ฏ (overlapping ~30%) +dafit chrysalis +``` + +### Nyx Decision Triangle Pair +Two triangles pointing outward from Nyx. +``` + โ— โ—‡ โ–ท + Nyx +``` +Left toward Real-Garden, right toward Virtual-Garden. + +### Organism Structure +``` +โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” +โ”‚ Organism โ”‚ +โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ +โ”‚ โ”‚ Cell โ”‚ โ”‚ +โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ +โ”‚ โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ +โ”‚ โ”‚ Cell โ”‚ โ”‚ +โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚ +โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ +``` + +--- + +## Shape Sizing Guidelines + +| Element Type | Size Range | Grid Alignment | +|--------------|------------|----------------| +| Major containers | 400-1000px | 40px grid | +| Subsystems | 200-400px | 40px grid | +| Entities | 60-140px | 20px grid | +| Knowledge modules | 100-120px | 20px grid | +| Decision points | 80-100px | 20px grid | +| Small indicators | 20-40px | 10px grid | + +--- + +## Stroke Guidelines + +| Element Type | Stroke Width | Style | +|--------------|--------------|-------| +| Major containers | 2px | Solid | +| Subsystems | 1.5px | Solid | +| Entities | 1.5px | Solid | +| Connections | 1px | Solid | +| Orchestration | 1px | Dashed | +| Subtle relations | 0.5px | Dotted | + +--- + +## Unicode Reference + +For quick text-based diagrams: + +``` +Containers: โ–ข โ–ก โ—‹ โ—ฏ โฌญ +Decisions: โ—‡ โ—† โฌฅ +Modules: โฌก โฌข +Triangles: โ–ท โ— โ–ฝ โ–ณ โ–ฒ โ–ผ +Arrows: โ†’ โ† โ†‘ โ†“ โ†” โ†• โ‡’ โ‡ โ†ท โ†ถ +Special: โ˜ฝ โง— โ‹ˆ โ—Ž โœง โœฆ +Stars: โ˜… โ˜† โœง โœฆ +``` + +--- + +**File**: style/symbols.md +**Version**: 1.0 +**Created**: 2025-12-28