Legacy Product

Fusion 5.10
    Fusion 5.10

    Milvus Ensemble Query Stage

    The Milvus Ensemble Query stage performs ensemble of different search results to retrieve metadata from Solr (see Milvus documentation).

    Troubleshooting

    Milvus Vector Search Issue

    Issue: Create, Read, Update, and Delete (CRUD) operations for indexing and query objects save current user permissions in thread local variables. Permissions are saved only once, and are never updated for that thread. Calls to a pipeline with a REST call or to Milvus stages use the saved permissions, not the calling user permissions. And the saved permissions are then used to check authorization for Milvus or external http: and https: calls.

    If a thread does not have saved permissions, the call to Milvus is authorized for any user.

    Workaround for Milvus stages:

    1. Add the following permissions to all existing non-admin users:

      GET,POST,PUT:/http-call/milvus/**

    2. Restart all instances of query and indexing services.

    Update a Milvus collection

    Update and delete semantics are not supported on individual items in a Milvus collection. We recommend that you use a blue/green set of collections: reindex to apply updates to an empty Milvus collection, then swap between collections to apply the updates.

    Configuration

    When entering configuration values in the UI, use unescaped characters, such as \t for the tab character. When entering configuration values in the API, use escaped characters, such as \\t for the tab character.

    Performs ensemble of different search results to retrieve metadata from Solr.

    skip - boolean

    Set to true to skip this stage.

    Default: false

    label - string

    A unique label for this stage.

    <= 255 characters

    condition - string

    Define a conditional script that must result in true or false. This can be used to determine if the stage should process or not.

    ensembleExpression - stringrequired

    Can reference results (numeric_id, score) map objects by key in the context, as well as max_[context key], min_[context key], count_[context key] etc.

    >= 1 characters

    Default: 1.0 * milvus_results

    resultFieldName - stringrequired

    Field name to store result ensemble score

    >= 1 characters

    Default: ensemble_score

    failOnError - boolean

    Flag to indicate if this stage should throw an exception if an error occurs.

    Default: false