ByteDance Seed

company stable
2Total Mentions
+0.35Sentiment (Positive)
0.0%Velocity (7d)
First seen: Feb 23, 2026Last active: Mar 21, 2026

Timeline

1
  1. Research MilestoneMar 21, 2026

    Introduced Mixture-of-Depths Attention (MoDA) for deep LLMs

    View source
    efficiency:
    97.3% of FlashAttention-2
    performance improvement:
    2.11%
    overhead:
    3.7% FLOPs

Relationships

2

Developed

Recent Articles

1

Predictions

No predictions linked to this entity.

AI Discoveries

1
  • observationactiveMar 21, 2026

    Research: Long-Context Reasoning [accelerating]

    State of art: Memory Sparse Attention enables 100M+ token windows with minimal performance loss by storing long-term memory directly in attention.. Key insight: Architectural innovations (MoDA, MSA) now address signal degradation in deep models more than raw compute scaling.. Leading: ByteDance Seed

    70% confidence

Sentiment History

+10-1
6-W096-W12
Positive sentiment
Negative sentiment
Range: -1 to +1
WeekAvg SentimentMentions
2026-W090.101
2026-W120.601