Ground Truth Jobs
Estimate ground truth queries using click signals and query signals, with document relevance per query determined using a click/skip formula.
Pair this job with the Ranking Metrics job to calculate relevance metrics, such as nDCG. |
Legacy Product
Estimate ground truth queries using click signals and query signals, with document relevance per query determined using a click/skip formula.
Pair this job with the Ranking Metrics job to calculate relevance metrics, such as nDCG. |
Use this job when you want to estimate ground truth queries using click and query signals with document relevance per query determined using a click/skip formula. Pair this job with ranking metrics job to calculate relevance metrics, such as nDCG
The ID for this Spark job. Used in the API to reference this job. Allowed characters: a-z, A-Z, dash (-) and underscore (_). Maximum length: 63 characters.
<= 63 characters
Match pattern: [a-zA-Z][_\-a-zA-Z0-9]*[a-zA-Z0-9]?
Spark configuration settings.
object attributes:{key
required : {
display name: Parameter Name
type: string
}value
: {
display name: Parameter Value
type: string
}}
Collection containing click signals and the associated search log identifier
>= 1 characters
Additional options to use while loading search logs collection
Additional options to use while loading signals collection
Pipeline id associated with search log entries
>= 1 characters
Join key of query signals in the signals collection
Default: id
Join key of click signals in the signals collection
Default: fusion_query_id
Filter queries to apply while choosing top queries from query signals in signals collection
Total number of queries to pick for Ground truth calculations
Default: 100
Default: ground_truth
Allowed values: ground_truth