On-Device Language Understanding for the Google Assistant
Improvements in mobile power have enable the move of the computing behind commercial products from datacenters to the users' devices. For the Google Assistant, this allows a faster and more reliable product, as well as new user experiences which take advantage of the reduced latency and increased responsiveness. A central problem in this new scenario is the on-device deployment of semantic parsing solutions which can identify the intent that the user has expressed. This talk discusses the challenges inherent to building such an on-device solution. These range from technical (NN architectures, quantization, differential privacy), infrastructural (releasing, versioning) and organizational (data collection and management, developer experience).
Rushin Shah is a senior manager at Google. Prior to Google, Rushin was leading the natural language understanding group at Facebook Conversational AI. Previously, he was at Siri at Apple for 5 years, where he built and headed the natural language understanding group and he also worked at the query understanding group at Yahoo. He has worked on a broad range of problems in the NLP area including parsing, information extraction, dialog and question answering. He holds degrees in language technologies and computer science from Carnegie Mellon and IIT Kharagpur.