Mila

A Montreal research institute run as a partnership of Quebec universities, chiefly the Université de Montréal and McGill University, whose deep-learning faculty and students it houses together; it ranks among the largest academic AI centers in the world. Yoshua Bengio's group, before and after it took the Mila name, produced foundational deep learningdeep learning, n.: Machine learning done with neural networks built from many stacked layers: raw data such as pixels, sound or text goes in at one end, and each layer turns what it receives into something more abstract. work: neural probabilistic language modelslanguage model, n.: A system that has learned how likely different sequences of words are, so it can predict the next word in a text and, by doing that repeatedly, write text of its own. (2003), generative adversarial networksgenerative adversarial network, n.: Two neural networks trained as rivals: one forges fake images, the other tries to spot the fakes. As both improve, the forger's output becomes realistic enough to fool people. (2014), the attentionattention, n.: A way for an AI model to choose what to focus on. For each word it processes, the model scores how relevant every other word is and draws information mostly from the relevant ones. mechanism for neural machine translation (2014–2015) and Theano (2007–2017), an early software framework for GPU-based deep learning. It is one of three national AI institutes under the Pan-Canadian Artificial Intelligence Strategy (2017), with the Vector Institute in Toronto and Amii in Edmonton, and has a substantial program on AI safety, ethics and policy.