
Adaptive Layer-wise Attention Entropy Regularisation for Deep Transformer Stability
KriraAI introduces ALAER, a novel per-layer entropy regularisation method that reduces attention collapse by 31% in transformers deeper than 24 layers.
Divyang Mandani










