che# Organ Architecture Index **Purpose**: Modular organ systems for Young Nyx embodiment **Philosophy**: Each organ is independent, lifeforce-gated, heartbeat-synchronized --- ## Deployed Organs ### πŸ—£οΈ Speech Organ **Host**: dioscuri.eachpath.local (RTX 4000 Ada 20GB Γ— 2) **Function**: Speech-to-Text + Text-to-Speech **Stack**: Whisper Large v3 (STT) + Coqui/XTTS (TTS) via Ollama **Languages**: German + English (topology accessed via prompt, not LoRA) **Integration**: Heartbeat-bound queue, lifeforce-gated priority processing **Detail**: β†’ [`Speech-Organ.md`](Speech-Organ.md) --- ## Planned Organs ### πŸ” Discovery Scan Station **Host**: ESP32 + crafting table area **Function**: 360Β° object scanning for world model building **Stack**: Rotating pedestal (stepper/servo) + fixed camera + SigLIP vectors **Integration**: Lifeforce-generating intake point for new objects, verified against Blender ground truth **Status**: 🟑 Architecture complete, build planned **Detail**: β†’ [`organs/Discovery-Scan-Station.md`](organs/Discovery-Scan-Station.md) --- ### πŸ‘οΈ Vision Organ **Host**: dioscuri.eachpath.local (RTX 4000 Ada 20GB Γ— 2) **Function**: Object detection, scene understanding, visionβ†’vectors **Stack**: YOLO v11 + T5Gemma 2 (SigLIP embeddings) via Ollama **Integration**: Real-time video from ESP32-CAM, vectors to phoebe spatial index **Status**: 🟑 Architecture complete, deployment planned **Detail**: β†’ `Vision-Organ.md` (pending) --- ### 🚢 Motor Organ **Host**: ESP32 (edge execution) **Function**: Movement primitives (forward, turn, stop) **Stack**: Compiled state machines from organism evolution **Integration**: Lifeforce cost per motor operation, reflex vs deliberate **Status**: ⏸️ Planned for Phase 4 (Real Garden) **Detail**: β†’ `organs/Motor-Organ.md` (pending) --- ### 🧭 Navigation Organ **Host**: Edge server (prometheus or atlas) **Function**: SLAM, path planning, obstacle avoidance **Stack**: ROS2 Nav2 or custom lightweight SLAM **Integration**: Dual-garden calibration (virtual predictions vs real outcomes) **Status**: ⏸️ Planned for Phase 4 (Real Garden) **Detail**: β†’ `organs/Navigation-Organ.md` (pending) --- ### πŸ“‘ Sensory Organ **Host**: ESP32 (edge sensors) **Function**: Distance sensors, IMU, battery monitoring **Stack**: I2C/SPI sensor protocols, state machine filters **Integration**: Sensorβ†’organ translation (raw values β†’ semantic meaning) **Status**: ⏸️ Architecture outlined in Nervous-System.md **Detail**: β†’ [`../Nervous-System.md`](../Nervous-System.md) --- ### πŸ“ Position-Time Beacon **Host**: M5Stack GPS v2.0 (AT6668) at nimmerhovel origin **Function**: Absolute position reference + Stratum-1 NTP time source **Stack**: GPS NMEA parsing, PPS signal for NTP, coordinate broadcast **Integration**: Provides ground truth origin (47Β°28'44.915"N, 7Β°37'07.842"E), time sync for all nimmerverse nodes **Status**: 🟑 Hardware ordered, arriving ~Jan 2026 **Detail**: β†’ `organs/Position-Time-Beacon.md` (pending) --- ### πŸ“ IR Position Array **Host**: 8Γ— ESP32-S3 AI CAMs (night vision capable), ceiling-mounted **Function**: 24/7 organism tracking via IR beacon triangulation (indoor GPS) **Stack**: ESP32-S3 WiFi streaming β†’ RTX 6000 SFM processing β†’ NATS position stream **Integration**: Tracks all organisms in real-time, feeds ground truth to phoebe, enables Virtual Garden verification **Status**: 🟒 Hardware received Jan 2026 **Detail**: β†’ [`organs/IR-Position-Array.md`](organs/IR-Position-Array.md) --- ### πŸ”¬ Crafting Eye **Host**: Raspberry Pi + HQ Camera (12.3MP IMX477) + 8-50mm C-mount zoom lens **Function**: Fixed birds-eye view of crafting station, high-resolution work monitoring **Stack**: Manual focus/iris (set once), libcamera, high-res stills + video **Integration**: Watches dafit's hands during electronics/assembly work, fixed viewing angle **Status**: 🟒 Hardware received Jan 2026 **Detail**: β†’ `organs/Crafting-Eye.md` (pending) --- ### πŸ¦‰ Godseye **Host**: NVIDIA Jetson Orin Nano/NX + PTZ mechanism + motorized zoom lens **Function**: Active surveyor of nimmerhovel, on-device vision AI, tracking **Stack**: Jetson (CUDA), servo pan/tilt, auto-zoom, YOLO/tracking models **Integration**: Autonomous gaze control, can decide where to look, reports to phoebe **Status**: ⏸️ Research phase **Detail**: β†’ `organs/Godseye.md` (pending) --- ## Organ Design Principles ### 1. **Lifeforce Economy** Every organ operation costs lifeforce. No free lunch. ```python ORGAN_COSTS = { "speech_stt": 5.0, # Whisper transcription "speech_tts": 4.0, # Coqui synthesis "vision_yolo": 8.0, # Object detection frame "motor_forward": 2.0, # 100ms movement "motor_turn": 1.5, # 45Β° rotation "sensor_read": 0.5, # Single sensor poll } ``` ### 2. **Heartbeat Synchronization** Organs process on heartbeat ticks (1 Hz), not real-time streaming. - **Reflex path**: <200ms compiled responses (no LLM) - **Deliberate path**: Next heartbeat (budget-gated queue) ### 3. **Priority Queue** When lifeforce is scarce, critical operations (collision alert) > idle operations (status check). ```python PRIORITY_LEVELS = { "critical": 10.0, # Immediate danger (collision) "high": 7.0, # Human interaction "medium": 4.0, # Organism monitoring "low": 2.0, # Idle observation "background": 0.5, # Status logging } ``` ### 4. **Multilingual Topology Access** German input β†’ Philosophy Valley (deep, diffuse topology) English input β†’ Technical Cluster (sparse, action-oriented) **Note:** Topology accessed via prompt language, not LoRA switching. Traits evolve regardless of which valley is accessed. ### 5. **Decision Trail Logging** Every organ operation logged to phoebe `decision_trails`: - Input, output, cost, outcome, confidence - Used for RLVR training (reward successful choices) ### 6. **Graceful Degradation** Low lifeforce β†’ reduced organ activity (silence, reduced vision FPS, slower movement) Zero lifeforce β†’ shutdown, wait for recharge --- ## Integration Architecture ``` β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ ESP32 ROBOTS β”‚ β”‚ Sensors β†’ Motor β†’ Camera β†’ Microphone β†’ Speaker β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”‚ NATS (sensor data, audio, video) β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ NATS MESSAGE BUS β”‚ β”‚ Organ input queues + priority scoring β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”‚ Heartbeat pulls from queues β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ HEARTBEAT ORCHESTRATOR β”‚ β”‚ Lifeforce budget allocation β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ β”‚ β–Ό β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ DIOSCURI (2Γ—20GB) β”‚ β”‚ THEIA (96GB) β”‚ β”‚ RTX 4000 Ada β”‚ β”‚ RTX PRO 6000 β”‚ β”‚ ───────────────── β”‚ β”‚ ─────────────── β”‚ β”‚ Speech Organ β”‚ β”‚ Young Nyx (Qwen3) β”‚ β”‚ Vision Organ β”‚ β”‚ Trait LoRAs (GRPO) β”‚ β”‚ Function Gemma β”‚ β”‚ Reasoning layer β”‚ β”‚ T5Gemma (SigLIP) β”‚ β”‚ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ 10GbE (9.9 Gbps jumbo frames) β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ PHOEBE (Decision Trails) β”‚ β”‚ Log all organ operations + outcomes β†’ GRPO training β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ ``` --- ## Organ Lifecycle ### Phase 1: Design - Document architecture in `organs/.md` - Define lifeforce costs, priority levels, queue schema - Design phoebe tables for organ-specific data ### Phase 2: Prototype - Build container images (Dockerfiles) - Deploy to k8s (single replica) - Test with mock data (no robot integration yet) ### Phase 3: Integration - Connect to ESP32 via MQTT - Implement heartbeat queue processing - Log decision trails, measure ROI ### Phase 4: Optimization - Tune lifeforce costs based on measured ROI - Adjust priority levels from observed outcomes - Train LoRAs on successful organ operation patterns ### Phase 5: Autonomy - Organ operations become reflexes (compiled state machines) - Young Nyx chooses when to use organs (not scripted) - Emergent behavior from lifeforce optimization --- ## Naming Convention **File naming**: `-Organ.md` **Examples**: - `Speech-Organ.md` - `Vision-Organ.md` - `Motor-Organ.md` - `Navigation-Organ.md` **k8s naming**: `--` **Examples**: - `whisper-stt-deployment.yaml` - `coqui-tts-deployment.yaml` - `yolo-vision-deployment.yaml` --- ## Current Status | Organ | Status | Host | Documentation | |-------|--------|------|---------------| | **Speech** | 🟒 Architecture complete | dioscuri (RTX 4000 Ada) | [`Speech-Organ.md`](Speech-Organ.md) | | **Vision** | 🟑 Architecture complete | dioscuri (RTX 4000 Ada) | Pending | | **Function Gemma** | 🟑 Planned | dioscuri | Structured output boundary | | **T5Gemma (SigLIP)** | 🟑 Planned | dioscuri | Vision β†’ vectors | | **Discovery Scan** | 🟑 Architecture complete | ESP32 + crafting table | [`Discovery-Scan-Station.md`](Discovery-Scan-Station.md) | | **Motor** | 🟑 Planned (Phase 4) | ESP32 | Pending | | **Navigation** | 🟑 Planned (Phase 4) | k8s cluster | Pending | | **Sensory** | 🟑 Conceptual | ESP32 | [`../Nervous-System.md`](../Nervous-System.md) | | **Position-Time Beacon** | 🟑 Hardware ordered | M5Stack GPS AT6668 | Pending | | **IR Position Array** | 🟒 Hardware received | 8Γ— ESP32-S3 AI CAM | [`IR-Position-Array.md`](IR-Position-Array.md) | | **Crafting Eye** | 🟒 Hardware received | Pi HQ + 8-50mm lens | Pending | | **Godseye** | ⏸️ Research phase | Jetson Orin + PTZ | Pending | --- **Philosophy**: Organs are not always-on services. They are **economically-constrained capabilities** that Young Nyx learns to use strategically. Speech when necessary. Vision when valuable. Movement when rewarded. **The body is not given. The body is EARNED through successful operation.** --- **Version:** 2.0 | **Created:** 2025-12-07 | **Updated:** 2026-02-07 πŸŒ™πŸ’œ *Each organ a tool. Each tool a choice. Each choice a lesson in scarcity.*