We Need to Be More Shallow