| title | description | ms.reviewer | ms.author | author | ms.topic | ms.custom | ms.date | ms.search.form | ||
|---|---|---|---|---|---|---|---|---|---|---|
Get data from file |
Learn how to get data from a local file in a KQL database in Real-Time Intelligence. |
tzgitlin |
yaschust |
YaelSchuster |
how-to |
|
04/21/2024 |
Get data in a KQL Database |
In this article, you learn how to get data from a local file into either a new or existing table.
- A workspace with a Microsoft Fabric-enabled capacity
- A KQL database with editing permissions
-
On the lower ribbon of your KQL database, select Get Data.
In the Get data window, the Source tab is selected.
-
Select the data source from the available list. In this example, you're ingesting data from Local file.
[!INCLUDE get-data-kql]
-
Select a target table. If you want to ingest data into a new table, select + New table and enter a table name.
[!NOTE] Table names can be up to 1024 characters including spaces, alphanumeric, hyphens, and underscores. Special characters aren't supported.
-
Either drag files into the window, or select Browse for files.
[!NOTE] You can add up to 1,000 files. Each file can be a max of 1 GB uncompressed.
:::image type="content" source="media/get-data-file/configure-tab.png" alt-text="Screenshot of configure tab with new table entered and one sample data file selected." lightbox="media/get-data-file/configure-tab.png":::
-
Select Next
The Inspect tab opens with a preview of the data.
To complete the ingestion process, select Finish.
:::image type="content" source="media/get-data-file/inspect-data.png" alt-text="Screenshot of the inspect tab." lightbox="media/get-data-file/inspect-data.png":::
Optionally:
- Select Command viewer to view and copy the automatic commands generated from your inputs.
- Use the Schema definition file dropdown to change the file that the schema is inferred from.
- Change the automatically inferred data format by selecting the desired format from the dropdown. For more information, see Data formats supported by Real-Time Intelligence.
- Edit columns.
- Explore Advanced options based on data type.
[!INCLUDE get-data-edit-columns]
:::image type="content" source="media/get-data-file/edit-columns.png" alt-text="Screenshot of columns open for editing." lightbox="media/get-data-file/edit-columns.png":::
[!INCLUDE mapping-transformations]
Tabular (CSV, TSV, PSV):
-
If you're ingesting tabular formats in an existing table, you can select Advanced > Keep table schema. Tabular data doesn't necessarily include the column names that are used to map source data to the existing columns. When this option is checked, mapping is done by-order, and the table schema remains the same. If this option is unchecked, new columns are created for incoming data, regardless of data structure.
-
To use the first row as column names, select Advanced > First row is column header.
:::image type="content" source="media/get-data-file/advanced-csv.png" alt-text="Screenshot of advanced CSV options.":::
JSON:
-
To determine column division of JSON data, select Advanced > Nested levels, from 1 to 100.
-
If you select Advanced > Skip JSON lines with errors, the data is ingested in JSON format. If you leave this check box unselected, the data is ingested in multijson format.
:::image type="content" source="media/get-data-file/advanced-json.png" alt-text="Screenshot of advanced JSON options.":::
In the Data preparation window, all three steps are marked with green check marks when data ingestion finishes successfully. You can select a card to query, drop the ingested data, or see a dashboard of your ingestion summary.
:::image type="content" source="media/get-data-file/summary.png" alt-text="Screenshot of summary page with successful ingestion completed." lightbox="media/get-data-file/summary.png":::
- To manage your database, see Manage data
- To create, store, and export queries, see Query data in a KQL queryset