Create Indexes in Milvus Jobs
Creates indexes for specified collections in Milvus.
Issue: Create, Read, Update, and Delete (CRUD) operations for indexing and query objects save current user permissions in thread local variables. Permissions are saved only once, and are never updated for that thread. Calls to a pipeline with a REST call or to Milvus stages use the saved permissions, not the calling user permissions. And the saved permissions are then used to check authorization for Milvus or external http: and https: calls.
|
|
If a thread does not have saved permissions, the call to Milvus is authorized for any user.
|
Workaround for Milvus stages:
-
Add the following permissions to all existing non-admin users:
GET,POST,PUT:/http-call/milvus/**
-
Restart all instances of query and indexing services.
Update and delete semantics are not supported on individual items in a Milvus collection. We recommend that you use a blue/green set of collections: reindex to apply updates to an empty Milvus collection, then swap between collections to apply the updates.
Creates indexes for specified collections in Milvus
id - stringrequired
The ID for this job. Used in the API to reference this job. Allowed characters: a-z, A-Z, dash (-) and underscore (_)
<= 63 characters
Match pattern: [a-zA-Z][_\-a-zA-Z0-9]*[a-zA-Z0-9]?
indexes-list - array[object]
List of the indexes that should be created with corresponding params.
object attributes:{indexParams : {
display name: Index Parameters
type: array
}indexType required : {
display name: Index Type
type: string
}milvusCollectionName required : {
display name: Collection Name
type: string
}}
readOptions - array[object]
Options used when reading input from Solr or other sources.
object attributes:{key required : {
display name: Parameter Name
type: string
}value : {
display name: Parameter Value
type: string
}}
sparkConfig - array[object]
Provide additional key/value pairs to be injected into the training JSON map at runtime. Values will be inserted as-is, so use " to surround string values
object attributes:{key required : {
display name: Parameter Name
type: string
}value : {
display name: Parameter Value
type: string
}}
type - stringrequired
Default: argo-milvus-create-indexes
Allowed values: argo-milvus-create-indexes
writeOptions - array[object]
Options used when writing output to Solr or other sources
object attributes:{key required : {
display name: Parameter Name
type: string
}value : {
display name: Parameter Value
type: string
}}