Implementation of Universal Transformer in Pytorch
-
Updated
Nov 19, 2018 - Python
#
universal-transformer
Here are 12 public repositories matching this topic...
Looped transformers and recurrent depth: 333 papers, English reading guides, diagrams, and a searchable research library.
transformers awesome-list universal-transformer llm test-time-compute recurrent-depth latent-reasoning looped-transformer
-
Updated
Nov 11, 2026 - HTML
Awesome list of papers, code, models and blogs on Looped / recurrent-depth / weight-tied Transformers — depth as a third scaling axis
awesome-list universal-transformer large-language-models looped-transformers test-time-compute recurrent-depth latent-reasoning
-
Updated
Sep 5, 2026
The implementation of Adaptive Computation function used in RNN "https://arxiv.org/pdf/1603.08983.pdf" and Universal Transformer Network "https://arxiv.org/pdf/1807.03819.pdf"
-
Updated
Aug 30, 2018 - Python
Universal Transformers implementation in PyTorch
-
Updated
Jul 14, 2022 - Python
Unofficial Implementation of Universal Transformer https://arxiv.org/abs/1807.03819
machine-learning deep-learning tensorflow adaptive-computation-time tensor2tensor self-attention universal-transformer
-
Updated
Oct 14, 2018 - Python
A Universal Transformer that solves 4x4 Sudoku by repeatedly applying one shared block and learning when to stop
-
Updated
Oct 9, 2026 - Python
Does the Universal/Looped-Transformer trick (reuse one block N times instead of stacking N) work on Mamba? Weight-shared depth in a state-space model, with honest per-seed results.
deep-learning reproducible-research pytorch ssm mamba state-space-models weight-sharing universal-transformer sequence-modeling recurrent-depth parameter-efficiency looped-transformer associative-recall
-
Updated
Sep 15, 2026 - Python
Local EDU AI LAB for looped (latent-recurrent) transformers - run, patch and measure loop counts on local GPU
docker benchmark transformers huginn educational dory universal-transformer ouro adaptive-computation llama-cpp local-llm llm-inference gguf nvidia-nemotron rtx-4070 looped-transformer latent-recurrence weight-tied
-
Updated
Oct 31, 2026 - Python
Simple from-scratch implementations of transformer-based models that match the state of the art.
transformers transformer attention universal-transformer universal-transformers xlnet transformer-xl
-
Updated
Dec 8, 2022 - Python
Multi strategy logit fusion between Ouro-1.4B (Universal Transformer) and HRM-Text-1B (prefix-LM) for improved text generation
entropy transformers fusion benchmarks language-model kl-divergence perplexity universal-transformer logits llm ouro-1-4b hrm-text-1b js-div
-
Updated
Jul 1, 2026 - Python
Untying Prefill and Decode Loops in Looped Language Models: a loop adapter lets a looped (recurrent-depth) LM prefill with m loops and decode with n. Ouro, SenseNova-Loop, Lev; every number recomputable.
rope reasoning efficient-inference universal-transformer ouro kv-cache llm test-time-compute recurrent-depth looped-language-model
-
Updated
Nov 15, 2026 - Python
Add this topic to your repo
To associate your repository with the universal-transformer topic, visit your repo's landing page and select "manage topics."