Arden Palme

Designed a Byzantine-robust decentralized machine learning algorithm which uses a binary classifier as a filter. Derived theoretical convergence, stab...

Studied the low-rank bottleneck phenomenon in multi-head attention mechanisms of transformer encoders, which occurs when the head size is less than th...