Building Machines in our Image
Published:
Read this blog post on the Caltech Letters website. Thank you to the editors at Caltech Letters for their helpful feedback in writing this article.
Joe Marino
Research Scientist @ Google DeepMind
- London, UK
- Github
- Google Scholar
You May Also Enjoy
Evaluating Probabilities
13 minute read
Published:
This blog post covers the evaluation of probabilities and probability densities for continuous variables. The motivation for this discussion came from seeing the disparity in various modeling approaches. My hope is that this blog post serves as a resource, particularly for those entering the field, on the different approaches that exist.
The Role of Prediction
7 minute read
Published:
Is machine learning the answer to creating flexible, capable machines? Can learning alone solve complex tasks? Perhaps, but, more likely, creating intelligent machines will require a certain degree of design, which we can think of as an architectural prior. In other words, a learning system requires a scaffolding on which to build. There is no better example of this than the intricate evolutionary structures of the human brain. This is the type of system we are striving for: hard coded low-level functionalities with a specific, yet incredibly flexible, higher-level architecture, resulting in the potential to quickly learn a large variety of tasks, i.e. general intelligence. Such a system walks the line between nature and nurture, trading off between pre-specified design and learning.
Statistical Whitening
14 minute read
Published:
Normalization is a fundamental component of machine learning. Take any introductory machine learning course, and you’ll learn about the importance of normalizing the inputs to your model. The justification goes something like this: the important patterns in the data often correspond to the relative relationships between the different input dimensions. Therefore, you can make the task of learning and recognizing these patterns easier by removing the constant offset and standardizing the scales.
Being a Better Model
5 minute read
Published:
I enjoy thinking about how to apply insights from our understanding of biological intelligence to improve machine intelligence. However, the insights often flow in the opposite direction as well: machine learning often recasts findings from neuroscience and psychology in a more grounded and principled way. The following is a perspective on what machine learning can teach us about ourselves.