Interpretability: the Next Deep Learning Challenge

Deep learning researchers are increasingly focusing on a big problem in the field: interpretability.

While supervised neural nets trained on huge datasets can achieve impressive performances in tasks such as computer vision and speech recognition, they are often criticized because their internal representations are lacking in interpretability. In order to address some of these concerns, work by scientist Charlie Tang proposes models which add domain-specific knowledge in the form of structured latent variables to standard deep learning methods, leading to good results in one-shot face recognition under illumination variations.

Charlie Tang is a Research Scientist at Apple, with research interests in deep learning, computer vision, neuroscience and robotics. At the Deep Learning Summit in Boston, on 25-26 May, he will present 'Deep Learning with Structure', exploring how neural nets can leverage domain-specific knowledge in computer vision. I asked him a few questions ahead of the summit to learn more.

Can you tell us a bit about yourself and your work? Plus, give us a teaser of your session at the summit?
I'm a currently a research scientist at Apple, previously I've obtained my PhD from the University of Toronto. I do research in Machine Learning, Deep Learning, and Reinforcement Learning, with applications to vision and robotics.

I would like to present my research on how to do deep learning with structure by leverage domain-specific knowledge in computer vision.

What started your work in deep learning?
I was interested in how the human brain learned to form concepts from the sensory stimuli. At the time, Boltzmann Machines were using Hebbian learning, which is inspired by how real synapses of Neurons adapt and learn.

What are the key factors that have enabled recent advancements in deep learning?
I think the availability of compute in the form of GPUs, the availability of datasets/simulators, and the confidence of researchers in deep learning community have led to the recent advancements.

Which industries do you think deep learning will benefit the most and why?
I think every industry from finance to e-commerce to biotech will benefit. They will benefit due to a couple of things. The first is the ability of deep learning to deliver more automation and efficiency to various tasks/services/jobs. The second is the increase in predictive capabilities of algorithms which are trained on large amounts of data.

What advancements in deep learning would you hope to see in the next 3 years?
I want to see deep learning powered applications, startups and services which help make people's lives easier and perhaps even help to save lives. These would obviously require not only advancement in AI algorithms but also overcoming challenges in engineering. 

Charlie Tang will be speaking at the annual Deep Learning Summit in Boston on 25-26 May. Speakers at the summit include Spyros Matsoukas, Principal Scientist at Amazon; Carl Vondrick, PhD Student at MIT; Dilip Krishnan, Research Scientist at Google; Sanja Fidler, Assistant Professor at University of Toronto; Andrew Tulloch, Research Engineer at Facebook, and more.

Early Bird tickets are available until 31 March for the summits in Boston. Register your place here.

Discounted tickets for the Deep Learning Summit and Deep Learning in Finance Summit in Singapore end this week on Friday 3 March! Join us there to explore advances in deep learning and smart artificial intelligence from the world's leading innovators. Book your place now. Original
Deep Learning Neural Networks Machine Learning A I Deep Learning Summit Speech Recognition Computer Vision



Recommended Posts

Latest Posts

Upcoming Events

Women in AI in Healthcare Dinner London

22 November 2017, London

Leading minds in healthcare and machine intelligence will come together for an evening of networking and keynote presentations around tools & techniques set to revolutionise healthcare applications, medicine & diagnostics. Join us for a three course meal to support and showcase women in Healthcare and Machine Intelligence.

Women in Machine Intelligence Dinner San Francisco

23 January 2018, San Francisco

Leading minds in machine intelligence will come together for an evening of networking and keynote presentations. Join us for a three course meal to support women in AI and Machine Intelligence.

AI Assistant Summit San Francisco

25 January 2018, San Francisco

The next generation in predictive intelligence. Anticipating user & business needs to alert & advise logical steps to increase efficiency. The summit will showcase the opportunities of advancing trends in AI Assistants & their impact on business & society. What impact will predictive intelligence have on business efficiency & personal organization?


Be Sociable

  • Twitter
  • Facebook
  • Linkedin
  • Youtube
  • Flickr
  • Lanyrd
  • Instagram
  • Google plus
  • Medium