google brain, accra


My research focuses on understanding and developing deep learning algorithms. I'm interested in creating deep learning algorithms that can learn with little supervision and to understand the principles of learning.

I moved in 2019 to Google AI. Before that I worked for close to 4 years at Facebook AI Research, where I helped push forward the state-of-the-art in neural machine translation and improved our understanding of how to train deep neural nets. I completed my Ph.D. at U. of Montreal with Yoshua Bengio on the subject of scaling deep learning algorithms. My collaborators and I have won two international AI competitions with our algorithms: the Unsupervised Transfer Learning Challenge in 2011, and the EmotiW challenge in 2014.

AI Conference Talk
Fixup Initialization: Residual Learning Without Normalization