Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Expand
titlePlain text file is written in the syntax of JSON
Info
  • Commonly used JSON structures for batch ingestion are supported.

  • Files with multiple JSON records (Except only a single record) are recommended .

  • JSON files with non-formatted records (where one row represents one record) are recommended.

At this time, JSON files that contain rows of array are not supported.

Supported Structure

  1. Characteristics of supported JSON is one record per row.

Code Block
{"first_name": "Bradley", "priority": 1683, "subscribe": true, "income": 955289.05, "address": {"City": "Nicolestad", "State": "Massachusetts"}, "countries_visited": ["Turks and Caicos Islands", "Spain", "New Caledonia"], "date_of_birth": "1988-02-19 00:00:00", "null_key": null}
{"first_name": "Jennifer", "priority": 2756, "subscribe": true, "income": 15248.17, "address": {"City": "Burnsborough", "State": "Idaho"}, "countries_visited": ["Mauritania", "Turkey", "Guinea"], "date_of_birth": "1994-08-31 00:00:00", "null_key": null}
{"first_name": "Tyler", "priority": 2628, "subscribe": false, "income": 248173.49, "address": {"City": "Ericahaven", "State": "California"}, "countries_visited": ["Sudan", "Afghanistan", "Chad"], "date_of_birth": "1978-06-30 00:00:00", "null_key": null}
{"first_name": "Lisa", "priority": 1518, "subscribe": false, "income": 338300.85, "address": {"City": "Tracyton", "State": "Oklahoma"}, "countries_visited": ["Honduras", "Samoa", "Congo"], "date_of_birth": "1991-08-06 00:00:00", "null_key": null}
{"first_name": "William", "priority": 1714, "subscribe": false, "income": 950738.18, "address": {"City": "Lake Tina", "State": "Nevada"}, "countries_visited": ["Seychelles", "Vietnam", "Lebanon"], "date_of_birth": "1981-02-09 00:00:00", "null_key": null}

This is a widely used format for data ingestion.

Not Supported Structure

  1. JSON files with formatted records (that span over multiple rows).

    Code Block
    {
       "first_name":"Rachel",
       "priority":2619,
       "subscribe":false,
       "income":435324.12,
       "address":{
          "City":"Smithstad",
          "State":"Michigan"
       },
       "countries_visited":[
          "Belize",
          "Eritrea",
          "Egypt"
       ],
       "date_of_birth":"1976-06-19 00:00:00",
       "null_key":null
    }
  2. JSON contains data in arrays.

    Code Block
    [{"id":1,"name":"John Doe","email":"john.doe@example.com"},{"id":2,"name":"Jane Doe","email":"jane.doe@example.com"},{"id":3,"name":"Mike Smith","email":"mike.smith@example.com"}]
    [{"id":7,"name":"Peter Green","email":"peter.green@example.com"},{"id":8,"name":"Susan Black","email":"susan.black@example.com"},{"id":9,"name":"Michael White","email":"michael.white@example.com"},{"id":10,"name":"Jessica Green","email":"jessica.green@example.com"}]

Upload: Click the Upload button to upload the data file. Select the required file needed to upload and click Upload.

...

  • After changes, copy the created entire schema and paste it into the defined project schema at the right-hand side drawer.

  • Click Save Changes to save the configuration.

...

Related Topics

Batch Listener (Revised)

Parsing Inputs

Path Pattern (Regex)

...