Deep Diversity: A Framework for Understanding Action