Go to file

dafit 892d06c535 feat: implement Phase 1B - variance collection automation

Extend nyx-probing with automated variance collection using
nyx-substrate for database persistence. Adds 4 new CLI commands
for collecting and analyzing variance in Echo Probe measurements.

New Features:
- VarianceRunner: Automated 1000x probe collection with progress bars
- 4 new CLI commands:
  - variance collect: Single term variance collection
  - variance batch: Batch collection from glossary files
  - variance stats: View session statistics
  - variance analyze: Cross-session variance analysis
- Full integration with nyx-substrate database layer

Files Added:
- nyx_probing/runners/__init__.py: Runner module initialization
- nyx_probing/runners/variance_runner.py: VarianceRunner class (~200 LOC)
- nyx_probing/cli/variance.py: CLI commands (~250 LOC)

Files Modified:
- pyproject.toml: Added nyx-substrate>=0.1.0 dependency
- nyx_probing/cli/probe.py: Registered variance command group
- data/glossary/master.json: Updated from scanning

Integration:
- nyx-probing → nyx-substrate → phoebe (PostgreSQL)
- Stores each probe run in variance_probe_runs table
- Rich progress bars and statistics display
- Session-based tracking with UUIDs

Usage Examples:
  nyx-probe variance collect "Geworfenheit" --runs 1000
  nyx-probe variance batch depth_3_champions.json
  nyx-probe variance stats <SESSION_ID>
  nyx-probe variance analyze "Geworfenheit"

Status: Phase 1B complete, ready for baseline collection

🌙💜 Generated with Claude Code
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2025-12-07 17:05:07 +01:00

README.md

nyx-probing

Probing framework for understanding Qwen2.5-7B-Base before curriculum design.

Overview

Part of the nimmerverse project. This framework implements the probing protocols defined in nimmerversity.md.

Probing Capabilities

Surface Probe - Feed single words, capture raw completions
Echo Probe - Depth measurement via completion echo
Multilingual Probe - Cross-language triangulation (EN/DE/AR/ZH)
Activation Probe - Hidden state analysis

Hardware

THE SPINE: Prometheus with RTX 3090 (24GB VRAM)
Model: Qwen2.5-7B-Base (~14GB loaded)
RAM: 64GB for activation capture

Quick Start

# On Prometheus
cd ~/nimmerverse/nyx-probing
source venv/bin/activate
python probe_test.py

Status

Active development. First successful probe: 2025-12-06.

License

Apache 2.0 - See LICENSE