Permalink
Switch branches/tags
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
77 lines (48 sloc) 1.68 KB

Data formats

There are several data formats that are used to handle data. This includes XML, CSV, JSON, etc. Scrapple provides support for storing extracted data in two formats :

  • Javascript Object Notation (JSON)
  • Comma Separated Values (CSV)

JSON

Javascript Object Notation (JSON) files are easy to understand and create. They are easy to parse through, understand and write. It is a language independent format and hence many of the APIs use them as a data-interchange format.

Few data types in JSON are :

  • Object: It is an unordered set of name/value pairs.
  • Array: It is a set of values of same data type. It is enclosed in a square bracket and the name-value pairs are separated by a comma.
  • Name: It is the field that describes the data.
  • Value: It is the input data for the name attribute. It can be a number, a Boolean value(true or false), a character(inserted between single quotes) or a string(inserted between double quotes).

For example,

{

        "subject": "Computer Science",
        "data": [
        # Array

                {
                # Object

                        "name": "John",         # String
                        "marks": 96,            # Integer
                        "passed": true          # Boolean

                },

                {

                        "name": "Doe",
                        "marks": 33,
                        "passed": false

                }

        ]

}

CSV

Comma Separated Values (CSV) files consists of tabular data where the fields are separated by a comma and the records by a line. It is stored in plain-text format. CSV files are easy to handle and manipulate.

For example,

Name Marks Grade Promotion
John 96 O True
Doe 45 F False

can be represented as,

John,96,O,True
Doe,45,F,False