Building Visual Search at Salesforce
Fine-grain recognition remains an unsolved problem at in the general case, indeed, it may even be as difficult as self-driving cars. There are many technical challenges in achieving accurate production-level image retrieval at web scale (handling catalogs of tens of millions of items). This talk details the steps and highlights the hurdles in building such a search platform. At Commerce Cloud Einstein, we have developed a custom multi-stage pipeline of deep metric learning models for product detection and recognition. Our networks are trained to discover a manifold representing the space of all consumer products. We will present the current architectures in our embedding networks, i.e. the mapping from consumer images to the product feature space, as well as the most promising research directions. Implementation level details will be covered insofar as they make efficient fine-grain retrieval possible, and performance evaluation (both statistical as well as qualitative) measures will be described.
Michael received a doctorate in mathematics from the University of Wyoming. Since 2012 he has led research and development teams at a number of successful Boston-based startups. Currently a lead data scientist on Salesforce's Einstein team, he enoys designing and building deep learning systems with applications to e-commerce and computer vision.