| title | description | ms.reviewer | ms.topic | ms.date |
|---|---|---|---|---|
Get data from a file |
Learn how to get data from a local file in Azure Data Explorer. |
sharmaanshul |
how-to |
12/04/2023 |
Data ingestion is the process used to load data from one or more sources into a table in Azure Data Explorer. Once ingested, the data becomes available for query. In this article, you learn you how to get data from a local file into either a new or existing table.
For general information on data ingestion, see Azure Data Explorer data ingestion overview.
- A Microsoft account or a Microsoft Entra user identity. An Azure subscription isn't required.
- Sign-in to the Azure Data Explorer web UI.
- An Azure Data Explorer cluster and database. Create a cluster and database.
-
From the left menu, select Query.
-
Right-click on the database where you want to ingest the data. Select Get data.
:::image type="content" source="media/get-data-file/get-data.png" alt-text="Screenshot of query tab, with right-click on a database and the get options dialog open." lightbox="media/get-data-file/get-data.png":::
In the Get data window, the Source tab is selected.
Select the data source from the available list. In this example, you're ingesting data from a Local file.
:::image type="content" source="media/get-data-file/select-data-source.png" alt-text="Screenshot of get data window with source tab selected." lightbox="media/get-data-file/select-data-source.png":::
[!INCLUDE ingestion-size-limit]
-
Select a target database and table. If you want to ingest data into a new table, select + New table and enter a table name.
[!NOTE] Table names can be up to 1024 characters including spaces, alphanumeric, hyphens, and underscores. Special characters aren't supported.
-
Either drag files into the window, or select Browse for files.
[!NOTE] You can add up to 1,000 files. Each file can be a max of 1 GB uncompressed.
:::image type="content" source="media/get-data-file/configure-tab.png" alt-text="Screenshot of configure tab with new table entered and one sample data file selected." lightbox="media/get-data-file/configure-tab.png":::
-
Select Next
The Inspect tab opens with a preview of the data.
To complete the ingestion process, select Finish.
:::image type="content" source="media/get-data-file/inspect-data.png" alt-text="Screenshot of the inspect tab." lightbox="media/get-data-file/inspect-data.png":::
Optionally:
- Select Command viewer to view and copy the automatic commands generated from your inputs.
- Use the Schema definition file dropdown to change the file that the schema is inferred from.
- Change the automatically inferred data format by selecting the desired format from the dropdown. See Data formats supported by Azure Data Explorer for ingestion.
- Edit columns.
- Explore Advanced options based on data type.
[!INCLUDE get-data-edit-columns]
:::image type="content" source="media/get-data-file/edit-columns.png" alt-text="Screenshot of columns open for editing." lightbox="media/get-data-file/edit-columns.png":::
[!INCLUDE mapping-transformations]
[!INCLUDE get-data-advanced-options]
In the Data preparation window, all three steps are marked with green check marks when data ingestion finishes successfully. You can view the commands that were used for each step, or select a card to query, visualize, or drop the ingested data.
:::image type="content" source="media/get-data-file/summary.png" alt-text="Screenshot of summary page with successful ingestion completed." lightbox="media/get-data-file/summary.png":::