Popular repositories Loading

1. LTCAttention LTCAttention Public

   Official implementation of LTCAttention — improving self-attention with adaptive memory decay.

   Python 10

2. NexteraBERT NexteraBERT Public

   Input-Dependent Gating Liquid Mixer and Length-Adaptive Attention for Fast, Long-Context Bidirectional Encoders

   Python 6 1

3. IMoE IMoE Public

   Pytorch official implementation of IMoE: Indefinacy Mixture of Experts. IMoE dynamically selects neurons. This implementation replicates the neurons which is dynamically changing synapses and enabl…

   Python 5

4. Stable-Static-Embedding-Models Stable-Static-Embedding-Models Public

   SSE (Stable Static Embedding): Unlocking the Potential of Static Embeddings, A Dynamic Tanh Normalization Approach without Speed Penalty

   Python 5

5. Liquid_Time_nanochat Liquid_Time_nanochat Public

   Forked from karpathy/nanochat

   The best ChatGPT that $80 can buy. reducing training time by more than 30 minutes and lowering computational costs by over $10. Original Faster Nanochat: SEA Model Series Op.0: Saint Iberis.

   Python 3

6. Nova-Nox-Neural-Network Nova-Nox-Neural-Network Public

   N4: Nova Nox Neural Network official pytorch implementation. A simplified Selective copying mechanism + Attention mechanism.

   Python 2