Transfer Collection to Cloud Job

id - stringrequired

The ID for this Spark job. Used in the API to reference this job. Allowed characters: a-z, A-Z, dash (-) and underscore (_). Maximum length: 63 characters.

<= 63 characters

Match pattern: [a-zA-Z][_\-a-zA-Z0-9]*[a-zA-Z0-9]?

sparkConfig - array[object]

Spark configuration settings.

object attributes:{key required : {
 display name: Parameter Name
 type: string
}value : {
 display name: Parameter Value
 type: string
}}

inputCollection - stringrequired

Solr collection to copy

>= 1 characters

outputLocation - stringrequired

URI of output location (e.g. s3a://..., gs://..., wasb://...)

>= 1 characters

overwriteOutput - boolean

Overwrite output collection

Default: true

outputFormat - string

Format for cloud output (e.g. parquet, json, csv)

Default: parquet

sparkPartitions - integer

Spark will re-partition the input to have this number of partitions. Increase for greater parallelism

Default: 200

readOptions - array[object]

Options used when reading input from Solr

object attributes:{key required : {
 display name: Parameter Name
 type: string
}value : {
 display name: Parameter Value
 type: string
}}

type - stringrequired

Default: transfer

Allowed values: transfer