Text Processing Index Stage
The Text Processing Index Stage processes simple text according to the transformation applied in a field.
|
This stage requires the Tika service in order to be deployed inside the cluster. It will only be deployed inside the cluster by default in environments where Transport Layer Security has been enabled*.
|
This stage processes text according to the transformations applied per field
skip - boolean
Set to true to skip this stage.
Default: false
label - string
A unique label for this stage.
<= 255 characters
condition - string
Define a conditional script that must result in true or false. This can be used to determine if the stage should process or not.
rules - array[object]
The rules follow this pattern :(source as a regexp field matcher - the pattern can match multiple fields, the results will be concatenated) -> Transformation -> (target as a single field name); Some transformations can accept arguments. If multiple rules point to the same target, then each subsequent rule will use the output from the preceding one instead of using its configured source.
object attributes:{source
required : {
display name: Source Field
type: string
}target
required : {
display name: Target Field
type: string
}transformation
required : {
display name: Transformation
type: string
}transformationConfig
: {
display name: Transformation config
type: string
}}