avro generic (generic)

Description - This generic is used by the Avro File Connector to execute Avro RPC's


Parameter Groups

 ParameterTypeDescription
*URL:stringURL to post this information to, example http://thehost:9876
Default File System:stringIn some Hadoop environments, this should be specified as the URI of the namenode, like "hdfs://[your namenode]".
* - denotes required
 ParameterTypeDescription
User ID:stringUser ID for authentication challenges
Password:passwordPassword for authentication challenges
Domain:stringDomain for NTLM authentication challenges; Note that to use NTLM, you must enable connection persistence.
Preemptive Authentication:stringSend the basic authentication credentials pre-emptively before the server returns an authorization request. This saves a round trip at the risk of significant security issues, such as sending credentials in clear to an unauthorized third party. The value default selects the behavior configured in the HTTP Client Provider.

Select from one of the following options:
  • Default {default}
  • false
  • true
* - denotes required
 ParameterTypeDescription
Configuration:stringPath to the Hadoop configuration file, normally core-site.xml
Default File System:stringIn some Hadoop environments, this should be specified as the URI of the namenode, like "hdfs://[your namenode]".
* - denotes required
 ParameterTypeDescription
*Configuration:stringA provider for configuring HTTP security, pooling, proxy and policies.

Click below for a definition:
Cookie Store Name:stringAllows thread-specific management of cookies. If a name is not specified, a cookie store global to the HTTP Client provider will be used.
Replace Connection?booleanIf false, connection will not be returned to connection pool immediately. The connection's identifier will be stored in the httpclient-key special register and the connection can be handled by the HTTP Client Manager agent.
Max Client Manager Delay:stringMaximum time the HTTP Client Manager can take to deal with a particular connection before it is automatically aborted. The format is [xxh][xxm]xx[s]. The default is 60 seconds.
Try Expect/Continue Handshake?booleanIf checked, client will send the HTTP Expect: 100-continue header and await HTTP 100 response before sending request body.
Chunk Encoded Request?booleanIf true, request entity will be sent with chunk encoding.
Max Request Size:stringMaximum size, after compression, of a request entity that can be sent with this emitter. 0 means no maximum and blank will default to 256KB.
Max Response Size:stringMaximum size of a response entity that can be received by this emitter. 0 means no maximum and blank will default to 256KB.
Persistence:booleanIf checked, ask the server to maintain the connection.
*Response Timeout:integerSeconds to wait for response before signalling error
* - denotes required
 ParameterTypeDescription
Compress Request:stringIf set, the HTTP request entity will be compressed using the selected encoding and the Content-Encoding header will be set accordingly.

Select from one of the following options:
  • deflate
  • gzip
  • none
Ask for Compressed Response:stringIf set, requests will set the Accept-Encoding header to indicate that that the client can accept a compressed response, as described in RFC-2616. If the response has a compressed content encoding, the client will automatically inflate.

Select from one of the following options:
  • deflate
  • either
  • gzip
  • none
* - denotes required
Description - This generic is used by the Avro File Connector to read files.


Parameter Groups

 ParameterTypeDescription
Configuration:stringPath to the Hadoop configuration file, normally core-site.xml
Default File System:stringIn some Hadoop environments, this should be specified as the URI of the namenode, like "hdfs://[your namenode]".
* - denotes required
Subscribe to avro generic (generic)