Three-Phase Transformer: Geometry Imposition in Neural Networks
分析
The article discusses a novel approach to transformer models by imposing three-phase geometry from the start, which leads to improved performance and faster convergence on certain tasks.
重要ポイント
引用・出典
原文を見る""When the three phases are balanced, one direction in channel space - the DC direction - is left empty by construction, geometrically orthogonal to all three phases.""