Parsing Inputs

Owned by Atul Dattatray Bhujbal
Last updated: 14/11/2023
3 min read

Compression: The selected compression method decompresses the input data files.

Select the required compression method from the dropdown.

GZip: GNU Zip

Encryption: The selected encryption method decrypts the data using an algorithm and private key to parse the information.

Data encrypted with the public key can only be decrypted with the private key.

PGP: PGP encryption selection will enable the Configure button.

Configure: Encryption algorithms assist in the process of transforming original data into encrypted data using the public key.

Configuration

  1. Click the Configure button. The Configuration Pop-up will appear.

  2. Select the required encryption method from the Select Method dropdown.

  3. Click Upload Private Key to upload the file or paste the private key in the text box.

  4. Enter the Passphrase in the text box.

  5. Click the icon to view and confirm the entered Passphrase.

  6. Click Save Changes to save the encryption configuration.

Directory: The parent directory helps to define the file's static path. Also, it automatically reflects at the bottom of the File Name Pattern (Regex) with the regular expression.

The Final Path combines the parent directory and regular expression corresponding to the file/directory in S3.

Automatic Folder Structure:

  • The batch listener automatically creates a folder structure in the provided path.

  • This structure is maintained to track processed files and facilitate troubleshooting in case of failures.

File Handling:

  • When the listener completes reading a file, it is moved to a "Processed" folder within the same directory.

  • This relocation is done to prevent reprocessing.

Reprocessing Capability:

  • If you need to reprocess the same file, simply move it from the "Processed" directory back to the original path.

  • The listener will pick up the file for processing once again.

Path Pattern (Regex): Regular expressions are mainly helpful for defining filters. It contains a series of characters that define a pattern of text to be matched to make a filter more specific.

Available data files in the source location can have different detail patterns. You can provide regular expressions to cover all of those different patterns.

https://kitewheel.atlassian.net/wiki/spaces/K2/pages/2970484737

https://kitewheel.atlassian.net/wiki/spaces/K2/pages/2919038977

https://kitewheel.atlassian.net/wiki/spaces/K2/pages/2969272321

Privacy Policy
© 2022 CSG International, Inc.