Qiang Liu

IFML Seminar

An Lyapunov Analysis of the Lion Optimizer

Abstract: Lion (Evolved Sign Momentum) is an optimizer discovered through program search ( https://arxiv.org/abs/2302. 06675 ). It was shown to perform comparably or favorably to AdamW but with higher memory efficiency by eliminating the...

Event Details

Upcoming Events

Past Events