Image ModifiedCompression: The selected compression method decompresses the input data files.
Select the required compression method from the dropdown.
| Expand |
|---|
|
| Panel |
|---|
| panelIconId | 1f517 |
|---|
| panelIcon | :link: |
|---|
| panelIconText | 🔗 |
|---|
| bgColor | #FFFFFF |
|---|
| GZip: GNU Zip |
|
Encryption: The selected encryption method decrypts the data using an algorithm and private key to parse the information.
| Panel |
|---|
| panelIconId | 1f510 |
|---|
| panelIcon | :closed_lock_with_key: |
|---|
| panelIconText | 🔐 |
|---|
| bgColor | #EAE6FF |
|---|
|
Data encrypted with the public key can only be decrypted with the private key. |
| Expand |
|---|
| title | For Example: PGP, None. |
|---|
|
| Panel |
|---|
| panelIconId | 1f517 |
|---|
| panelIcon | :link: |
|---|
| panelIconText | 🔗 |
|---|
| bgColor | #FFFFFF |
|---|
| PGP: PGP encryption selection will enable the Configure button. |
| Panel |
|---|
| panelIconId | 1f517 |
|---|
| panelIcon | :link: |
|---|
| panelIconText | 🔗 |
|---|
| bgColor | #FFFFFF |
|---|
| None: This selection will keep disabling the Configure button, which will not allow you for algorithm selections. |
|
Configure: Encryption algorithms assist in the process of transforming original data into encrypted data using the public key.
Image Removed
Image AddedClick the Configure button. The Configuration Pop-up will appear.
Select the required encryption method from the Select Method dropdown.
Click Upload Private Key to upload the file or paste the private key in the text box.
Enter the Passphrase in the text box.
Click the 
icon to view and confirm the entered Passphrase.
Click Save Changes to save the encryption configuration.
| Warning |
|---|
The configured Passphrase will not be visible while editing the configuration. |
| Expand |
|---|
| title | For Example: PGP, None. |
|---|
|
| Panel |
|---|
| panelIconId | 1f517 |
|---|
| panelIcon | :link: |
|---|
| panelIconText | 🔗 |
|---|
| bgColor | #FFFFFF |
|---|
| PGP: Pretty Good Privacy (PGP), which works through cryptography, data compression, and hashing techniques. |
| Panel |
|---|
| panelIconId | 1f517 |
|---|
| panelIcon | :link: |
|---|
| panelIconText | 🔗 |
|---|
| bgColor | #FFFFFF |
|---|
| None: Select None if data files are not encrypted. |
|
The uploaded key will be used to decrypt the encrypted data.
Directory: The parent directory helps to define the file's static path. Also, it automatically reflects at the bottom of the File Name Pattern (Regex) with the regular expression.
| Panel |
|---|
| panelIconId | 26a0 |
|---|
| panelIcon | :warning: |
|---|
| panelIconText | ⚠️ |
|---|
| bgColor | #E6FCFF |
|---|
|
Separate directories for multiple listeners are recommended. |
The Final Path combines the parent directory and regular expression corresponding to the file/directory in S3.
| Note |
|---|
Amazon S3 bucket must have read and write access. |
Always use one directory per listener, separated by "/."
| Panel |
|---|
| panelIconId | 1f517 |
|---|
| panelIcon | :link: |
|---|
| panelIconText | 🔗 |
|---|
| bgColor | #FFFFFF |
|---|
|
For Example: Index/plans/^L…*C$ |
| Tip |
|---|
If the parent directory is empty, then the final path will be considered as "Root". |
| Panel |
|---|
| panelIconId | 1f517 |
|---|
| panelIcon | :link: |
|---|
| panelIconText | 🔗 |
|---|
| bgColor | #FFFFFF |
|---|
|
For Example: {root}/^L…*C$ |
Path Pattern (Regex): Regular expressions are mainly helpful for defining filters. It contains a series of characters that define a pattern of text to be matched to make a filter more specific.
Available data files in the source location can have different detail patterns. You can provide regular expressions to cover all of those different patterns.
| Panel |
|---|
| panelIconId | 1f516 |
|---|
| panelIcon | :bookmark: |
|---|
| panelIconText | 🔖 |
|---|
| bgColor | #EAE6FF |
|---|
|
There can be several combinations with respect to names, like fixed directory-fixed file names, fixed directory name-dynamic file names, and dynamic directory name-dynamic file names. |
| Panel |
|---|
| panelIconId | 1f517 |
|---|
| panelIcon | :link: |
|---|
| panelIconText | 🔗 |
|---|
| bgColor | #FFFFFF |
|---|
|
For example: CSV files are placed in a directory named "data" that needs to be parsed. For more information about Regular Expressions, See Path Pattern (Regex). |
Batch Listener
Path Pattern (Regex)
Data Format
Interval
Output