✦ Open to WorkML Engineer with 9+ years shipping production AI systems. Get in touch →

The Transformer Family Version 2.0

A comprehensive overview of the Transformer architecture and its many variants, covering attention mechanisms, positional encoding, efficient …

January 27, 2023 · 5 min · 1016 words · Lilian Weng