Noam Shazeer

Noam Shazeer is a computer scientist and entrepreneur. Noam co-leads Google Gemini and is a VP Engineering at Google. 

​

Some of his inventions include:

• Transformer (2017) - personally designed the multi-head attention, the residual architecture, and coded up the first better-than-SOTA working implementation

• Sparsely-gated Mixture of Experts (2016)

• Mesh-Tensorflow (2018) - first practical system for training giant Transformers on supercomputers

• T5 (2019)

• Major contributor to Google’s LaMDA dialog system, a project led by Daniel De Freitas

 

Shazeer started at Google in 2000, where he improved the search engine's spelling corrector. Noam later wrote the PHIL algorithm, which became the core of the Google AdSense system.

 

Noam also founded Character.AI, the first chatbot to launch on the Transformer - before ChatGPT.