Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 10 Next »

The Batch Listener allows data ingestion from batch sources into a graph. Also, the Batch Listener captures input required to process data from batch sources at a defined frequency.

Creating a Batch Listener

Creating a new Batch Connection is mandatory to create a Batch Listener Adaptor.

To add a Batch Listener Adaptor on any graph:

  1. Click the Graph Options dropdown in the top left side of the window.

  2. Select Add Listener from the dropdown. The Listener Editor window will appear.

Listener Type: Select the Batch Listener Type from the Listener Type dropdown.

Connection: Choose the required batch Connection from the Connection drop-down.

Batch Connections created under the Batch Connection configuration will appear here.

The (blue star) (Edit) button is next to the connection dropdown.

It allows users to reconfigure, edit or create a new connection.

This Edit button is available for all types of listeners.


Batch Listener Options

Once the Batch Listener Type is selected, all the configurations related to Batch Listener will appear.

Data Format

In data processing, there are different types of file formats to store your data sets. The most popular data formats are Parquet, Delimited, and JSON.

Parquet is an open-source file format that handles flat columnar storage data formats.

Delimited files in which values in the row and columns are separated by configured delimiters (Comma, Tab, customized delimiter, quotation marks).

JSON (JavaScript Object Notation) is an open data format and is widely used by APIs (Application Programming Interface — basically how servers talk to each other) and several databases (like MongoDB)


Parsing Inputs


Path Pattern (Regex)


Interval


Output

  • No labels