Elijah's Notes

attention

6 items with this tag.

  • Jul 31, 2026

    Decoder-Only Transformers

    • deep-learning
    • transformers
    • attention
    • self-attention
    • autoregressive-models
    • pytorch
  • Jul 31, 2026

    Encoder-Decoder Transformers

    • deep-learning
    • transformers
    • attention
    • self-attention
    • cross-attention
    • seq2seq
    • translation
  • Jul 31, 2026

    Modeling, Architecture, and Data

    • deep-learning
    • modeling
    • architecture
    • data-representation
    • regularization
    • attention
    • resnet
  • Jul 31, 2026

    Recurrent Neural Networks

    • deep-learning
    • rnn
    • lstm
    • gru
    • sequence-modeling
    • attention
  • May 25, 2025

    Transformer Architecture and Implementation

    • transformers
    • architecture
    • attention
    • gqa
    • kv-cache
    • flashattention
    • batching
    • prefill
    • decode
    • feedforward
    • normalization
    • machine-learning
  • Jan 14, 2025

    Faster Causal Self Attention

    • machine-learning
    • attention
    • attention-mechanism
    • transformer
    • flashattention
    • sparse-attention

Created with Quartz v5.0.0 © 2026

  • GitHub