James Sharpnack & Xingjian Shi, Rediscover Your Data with a New Multimodal Search Capability

Rediscover Your Data with a New Multimodal Search Capability

James Sharpnack, Senior Applied Scientist, AWS
Xingjian Shi, Senior Applied Scientist, Amazon AI

In modern search, our databases can be any modality—text, images, tabular—and we propose to add multimodal search capabilities to OpenSearch through AutoGluon, Amazon’s open-source AutoML software. Through multimodal embeddings, we’re able to perform semantic search and retrieve data based on its contextual meaning. In this session, we’ll discuss how with these embeddings, we can detect anomalous data and assess the similarities between datasets to improve our models.