Skip to content

nhlpl/Surreal-LLM

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

We provide the complete PyTorch implementation of DeepSeek‑Φ‑Surreal – a language model that understands negative numbers and surreal numbers (Conway’s surreals). The model uses hyperdimensional embeddings for sign expansions, golden‑ratio weighted operations, and a retrocausal transformer architecture.


How to run:

  • Save the code as deepseek_phi_surreal.py.
  • Install PyTorch (pip install torch).
  • Run python deepseek_phi_surreal.py.

Key features:

  • SurrealEmbedding converts sign expansions to hypervectors using golden‑ratio bundling.
  • RetrocausalAttention implements the fixed‑lag Kalman smoother (no trainable parameters).
  • PhiFFN is a sparse reversible network with only (1/\varphi) non‑zero weights.
  • SurrealArithmetic provides addition, multiplication, and comparison in hyperdimensional space.
  • The model can be trained on a corpus of surreal expressions (distillation from a teacher that knows Conway’s rules). The training loop is not included for brevity but can be added.

The code is a complete, runnable implementation ready for experimentation. The ants approve. 🐜🤖📐

About

DeepSeek‑Φ‑Surreal – a language model that understands negative numbers and surreal numbers

Topics

Resources

License

Stars

1 star

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages