ContentFetcher.FetchContext.newCandidate(String)
ContentFetcher.FetchContext.newCandidate(String)
ContentFetcher.FetchContext.newCandidate(String)
ContentFetcher.FetchContext.newCandidate(String)
ContentFetcher.FetchContext.newCandidate(String)
ContentFetcher.FetchContext.newCandidate(String)
ContentFetcher.FetchContext.newCandidate(String)
ContentFetcher.FetchContext.newCandidate(String)
ContentFetcher.FetchContext.newContent(Supplier)
ContentFetcher.FetchContext.newContent(Supplier)
ContentFetcher.FetchContext.newContent(Supplier)
ContentFetcher.FetchContext.newDelete()
ContentFetcher.FetchContext.newDelete(String)
ContentFetcher.FetchContext.newDelete()
ContentFetcher.FetchContext.newDelete(String)
ContentFetcher.FetchContext.newDocument()
ContentFetcher.FetchContext.newDocument(String)
ContentFetcher.FetchContext.newDocument()
ContentFetcher.FetchContext.newError()
ContentFetcher.FetchContext.newError(String)
ContentFetcher.FetchContext.newSkip()
ContentFetcher.FetchContext.newSkip(String)
Candidate
s.Fetcher.fetch(FetcherContext.FetchContext)
FetchResult.FetchResult(String)
instead.MapBuilder
consumer.MapBuilder
consumer.Callable
with the context of the retry.Optional
if the value exists, otherwise Optional.empty().FetchGroup
instead.FetchGroup
s instead.FetchGroup
instead.Map
object which is to be indexed in solr.MapBuilder.values
Ignores values that is not accepted by solr like nested map.MapBuilder
consumer.MapBuilder
consumer.ContentFetcher.FetchContext.newCheckpoint(String)
gets id from FetchInputContentFetcher.FetchContext.newContent(String, InputStream)
Creates a new content emitter
Example Usage: fetchContext.newContent(file.getId(), file::getInputStream)
.withFields(file.getMetadata())
.emit();
ContentFetcher.FetchContext.newContent(String, Supplier)
gets id from FetchInputContentFetcher.FetchContext.newDelete(String)
gets id from FetchInputContentFetcher.FetchContext.newDocument(String)
gets id from FetchInputContentFetcher.FetchContext.newSkip(String)
gets id from FetchInputConnectorPluginProperties
implementation.ConnectorPluginProperties
implementation.RetryPolicy
to set
retry properties. The developer could implement their own logic in the connector
itself for the retry, though it's not recommended to do so.
Example of retrying from connector by emitting errors:
e.g. fetchContext
.newError("2", "error-retry-test-2")
.retryPolicy(r -> {
r.setMaxRetries(5);
r.setDelayInSeconds(10);
})
.metadata(m -> {
m.merge(fetchContext.getFetchInput().getMetadata());
})
}
Retryer
CheckedRunnable
with the context of the retry.StaticSecurityConfig
* #DynamicSecurityConfig
MapBuilder.setLocalDateTimes(String, Collection)
FetchResult.FetchResult(String)
instead.Fetcher.start(FetcherContext.StartContext)
DynamicSecurityConfig
.Fetcher.stop(FetcherContext.StopContext)
ValidationContext
class, primarily provides the configuration to be validated.FetchGroup
s instead.ConnectorPlugin.FetcherDef
and adds it to ConnectorPlugin.Builder.fetcherDefs
FetchInput.Builder.fields(Consumer)
FetchInput.Builder.metadata(Consumer)