Skip to content
FileIO.jl integration for Parquet files
Branch: master
Clone or download
Latest commit 9247cfa Mar 5, 2019
Type Name Latest commit message Commit time
Failed to load latest commit information.
src Export FileIO.File and FileIO.@format_str Jan 10, 2019
.gitignore ParquetFiles.jl generated files. Dec 18, 2017
.travis.yml Add docs template Feb 23, 2019 Update LICENSE Jan 7, 2018 Update README Oct 30, 2018
appveyor.yml Update CI config for julia 1.1 Jan 3, 2019


Project Status: Active - The project has reached a stable, usable state and is being actively developed. Build Status Build status ParquetFiles


This package provides load support for Parquet files under the FileIO.jl package.


Use ] add ParquetFiles in Julia to install ParquetFiles and its dependencies.


Load a Parquet file

To read a Parquet file into a DataFrame, use the following julia code:

using ParquetFiles, DataFrames

df = DataFrame(load("data.parquet"))

The call to load returns a struct that is an IterableTable.jl, so it can be passed to any function that can handle iterable tables, i.e. all the sinks in IterableTable.jl. Here are some examples of materializing a Parquet file into data structures that are not a DataFrame:

using ParquetFiles, IndexedTables, TimeSeries, Temporal, VegaLite

# Load into an IndexedTable
it = IndexedTable(load("data.parquet"))

# Load into a TimeArray
ta = TimeArray(load("data.parquet"))

# Load into a TS
ts = TS(load("data.parquet"))

# Plot directly with Gadfly
@vlplot(:point, data=load("data.parquet"), x=:a, y=:b)

Using the pipe syntax

load also support the pipe syntax. For example, to load a Parquet file into a DataFrame, one can use the following code:

using ParquetFiles, DataFrame

df = load("data.parquet") |> DataFrame

The pipe syntax is especially useful when combining it with Query.jl queries, for example one can easily load a Parquet file, pipe it into a query, then pipe it to the save function to store the results in a new file.

You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.