Build an intelligent search pipeline for grounded AI | THRSP1066

Andy Tran presents the components of a search pipeline and demonstrates how Cohere’s Parse, Embed, and Re-Rank models support document processing and retrieval. The session is aimed at developers building AI systems that need relevant company information at generation time.

Search pipeline overview

The pipeline starts with a user question or instruction, retrieves relevant information from company datasets, and supplies that information to the model when it generates a response.

The session introduces four components:

Cohere’s Parse, Embed, and Re-Rank models address different stages of this process.

Parsing documents

The Parse demonstration covers optical character recognition (OCR), visual extraction, charts, tables, and structured document parsing. These capabilities help make information contained in documents available to downstream search.

Tran also discusses the benefits of purpose-built parsing models compared with larger, more expensive language models.

Multimodal retrieval with embeddings

The Embed overview introduces unified multimodal vector search for text and images. Demonstrations show how retrieval can support different types of content and queries:

These examples extend retrieval beyond text-only document search.

Re-ranking for multi-condition queries

The Re-Rank segment focuses on improving retrieval accuracy and handling complex queries. A Nike product-search demonstration shows how re-ranking improves results for searches that must satisfy multiple conditions.

The distinction is between finding candidate results and ordering those results according to how well they meet the user’s request.

Session chapters

Resource