Overview

Dataflow

Once the ETL process has finished, the next step is to retrieve data through semantic search. The pipeline supports native capabilities to do semantic search. The pipeline supports natively:

  • Metadata filtering (automatically enabled by the metadata configured on the source connector)
  • Query embedding generation (automatically enabled by the embed connector )
  • Similarity search (automatically enabled by the sink connector)

This means that once you configure the pipeline, you can use its configuration to do semantic search.

Alternatively, you can also query the vector store used as a sink direclty using the APIs provided by vector store itself.

When using the Neum AI Search capabilities, you are able to leverage the existing pipeline configuration to query data including the sink configuration as well as the content and metadata configuration.

Search pipeline

Query the data associated to a pipeline.