Generic - Avro File Connector (Avro RPC)
Search form
Description - This generic is used by the Avro File Connector to execute Avro RPC's
Parameter Groups
Parameter Type Description * URL: string URL to post this information to, example http://thehost:9876
Default File System: string In some Hadoop environments, this should be specified as the URI of the namenode, like "hdfs://[your namenode]".
* - denotes required
Parameter Type Description User ID: string User ID for authentication challenges
Password: password Password for authentication challenges
Domain: string Domain for NTLM authentication challenges; Note that to use NTLM, you must enable connection persistence.
Preemptive Authentication: string Send the basic authentication credentials pre-emptively before the server returns an authorization request. This saves a round trip at the risk of significant security issues, such as sending credentials in clear to an unauthorized third party. The value default selects the behavior configured in the HTTP Client Provider.
Select from one of the following options:
- Default {default}
- false
- true
* - denotes required
Parameter Type Description Configuration: string Path to the Hadoop configuration file, normally core-site.xml
Default File System: string In some Hadoop environments, this should be specified as the URI of the namenode, like "hdfs://[your namenode]".
* - denotes required
Parameter Type Description * Configuration: string A provider for configuring HTTP security, pooling, proxy and policies.
Click below for a definition:
Cookie Store Name: string Allows thread-specific management of cookies. If a name is not specified, a cookie store global to the HTTP Client provider will be used.
Replace Connection? boolean If false, connection will not be returned to connection pool immediately. The connection's identifier will be stored in the httpclient-key special register and the connection can be handled by the HTTP Client Manager agent.
Max Client Manager Delay: string Maximum time the HTTP Client Manager can take to deal with a particular connection before it is automatically aborted. The format is [xxh][xxm]xx[s]. The default is 60 seconds.
Try Expect/Continue Handshake? boolean If checked, client will send the HTTP Expect: 100-continue header and await HTTP 100 response before sending request body.
Chunk Encoded Request? boolean If true, request entity will be sent with chunk encoding.
Max Request Size: string Maximum size, after compression, of a request entity that can be sent with this emitter. 0 means no maximum and blank will default to 256KB.
Max Response Size: string Maximum size of a response entity that can be received by this emitter. 0 means no maximum and blank will default to 256KB.
Persistence: boolean If checked, ask the server to maintain the connection.
* Response Timeout: integer Seconds to wait for response before signalling error
* - denotes required
Parameter Type Description Compress Request: string If set, the HTTP request entity will be compressed using the selected encoding and the Content-Encoding header will be set accordingly.
Select from one of the following options:
- deflate
- gzip
- none
Ask for Compressed Response: string If set, requests will set the Accept-Encoding header to indicate that that the client can accept a compressed response, as described in RFC-2616. If the response has a compressed content encoding, the client will automatically inflate.
Select from one of the following options:
- deflate
- either
- gzip
- none
* - denotes required
Parameter Groups
| Parameter | Type | Description | |
|---|---|---|---|
| * | URL: | string | URL to post this information to, example http://thehost:9876 | Default File System: | string | In some Hadoop environments, this should be specified as the URI of the namenode, like "hdfs://[your namenode]". |
* - denotes required
| Parameter | Type | Description | |
|---|---|---|---|
| User ID: | string | User ID for authentication challenges | Password: | password | Password for authentication challenges | Domain: | string | Domain for NTLM authentication challenges; Note that to use NTLM, you must enable connection persistence. | Preemptive Authentication: | string | Send the basic authentication credentials pre-emptively before the server returns an authorization request. This saves a round trip at the risk of significant security issues, such as sending credentials in clear to an unauthorized third party. The value default selects the behavior configured in the HTTP Client Provider.
Select from one of the following options:
|
* - denotes required
| Parameter | Type | Description | |
|---|---|---|---|
| Configuration: | string | Path to the Hadoop configuration file, normally core-site.xml | Default File System: | string | In some Hadoop environments, this should be specified as the URI of the namenode, like "hdfs://[your namenode]". |
* - denotes required
| Parameter | Type | Description | |
|---|---|---|---|
| * | Configuration: | string | A provider for configuring HTTP security, pooling, proxy and policies.
Click below for a definition: |
Cookie Store Name: | string | Allows thread-specific management of cookies. If a name is not specified, a cookie store global to the HTTP Client provider will be used. | Replace Connection? | boolean | If false, connection will not be returned to connection pool immediately. The connection's identifier will be stored in the httpclient-key special register and the connection can be handled by the HTTP Client Manager agent. | Max Client Manager Delay: | string | Maximum time the HTTP Client Manager can take to deal with a particular connection before it is automatically aborted. The format is [xxh][xxm]xx[s]. The default is 60 seconds. | Try Expect/Continue Handshake? | boolean | If checked, client will send the HTTP Expect: 100-continue header and await HTTP 100 response before sending request body. | Chunk Encoded Request? | boolean | If true, request entity will be sent with chunk encoding. | Max Request Size: | string | Maximum size, after compression, of a request entity that can be sent with this emitter. 0 means no maximum and blank will default to 256KB. | Max Response Size: | string | Maximum size of a response entity that can be received by this emitter. 0 means no maximum and blank will default to 256KB. | Persistence: | boolean | If checked, ask the server to maintain the connection. | * | Response Timeout: | integer | Seconds to wait for response before signalling error |
* - denotes required
| Parameter | Type | Description | |
|---|---|---|---|
| Compress Request: | string | If set, the HTTP request entity will be compressed using the selected encoding and the Content-Encoding header will be set accordingly.
Select from one of the following options:
|
Ask for Compressed Response: | string | If set, requests will set the Accept-Encoding header to indicate that that the client can accept a compressed response, as described in RFC-2616. If the response has a compressed content encoding, the client will automatically inflate.
Select from one of the following options:
|