Entities · Models
GPT-2
36 articles tagged with this entity.
-
Fractal KV-Cache Archives: Lossless Symbolic Storage with In-Place Retrieval for Long-Context LLM Inference
-
RPAM: A Principled Metric for Evaluating Associations in Language Models with High Predictive Validity in Downstream Outputs
-
Deriving Neural Scaling Laws from the statistics of natural language
-
The Wiola Architecture for Efficient Small Language Models
-
When transformers learn "impossible" languages, what do they learn?
-
Timesteps of Mamba Align with Human Reading Times
-
EPIC-EuroParl-UdS: Information-Theoretic Perspectives on Translation and Interpreting
-
On the Nonlinearity of Learning Rate Scaling for LLM Training
-
RSD: Moving Local Triangular Charts for Auditing Language-Model Hidden States
-
A-Evolve-Training: Autonomous Post-Training of a 30B Model
-
Automatic Generation of Highlights for Academic Paper Via Prompt-based Learning
-
An LLM-based Two-Stage Transformer Framework for Cross-Domain Bearing Fault Diagnosis with Limited Data
-
How Linear Is a Transformer Feed-Forward Block? Per-Block Linear Recoverability Is Learned, Not Architectural
-
Explaining Attention with Program Synthesis
-
Rift: A Conflict Signature for Deception in Language Models
-
Privacy from Symmetry: Orthogonally Equivariant Transformers for LLM Inference
-
The Reservoir Attention Network: Cross-Pass State in Pretrained Transformers via Content-Addressable Reservoir Injection
-
Recurrent Reasoning on Symbolic Puzzles with Sequence Models
-
Generalized Discrete Diffusion with Self-Correction
-
Recoverable but Not Stationary:Local Linear Structures in Weights and Activations
-
Trajectory Geometry of Transformer Representations Across Layers
-
Limitations of Normalization in Attention Mechanism
-
Binary Gaussian Copula Synthesis: an LLM-powered data augmentation framework for early dialysis prediction in chronic kidney disease
-
Epidemiology of Model Collapse: Modeling Synthetic Data Contamination via Bilayer SIR Dynamics
-
Subspace-Aware Sparse Autoencoders for Effective Mechanistic Interpretability
-
Pitfalls of Evaluating Language Models with Open Benchmarks
-
Adapting Large Language Models to a Low-Resource Agglutinative Language: A Comparative Study of LoRA and QLoRA for Bashkir
-
On the Relationship Between Activation Outliers and Feature Death in Sparse Autoencoders
-
Text-Preserving Lossy Text Compression: A Study of Strategic Deletion and LLM Reconstruction
-
Federated Language Models Under Bandwidth Budgets: Distillation Rates and Conformal Coverage
-
The Stability of Singular Distribution: A Spectral Perspective on the Two-Phase Dynamics of Language Model Pre-training
-
Extra-Merge: Tracing the Rank-1 Subspace of Model Merging in Language Model Pre-Training
-
Continuous-Depth Field Theory for Transformer Patching and Mechanistic Interpretability
-
Differences in Typological Alignment in Language Models' Treatment of Differential Argument Marking
-
Beyond Red-Teaming: Formal Guarantees of LLM Guardrail Classifiers
-
Pro-KLShampoo: Projected KL-Shampoo with Whitening Recovered by Orthogonalization