Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ and is built with Sphinx (see [`docs/README.md`](docs/README.md) for the
build steps):

- [User guide](docs/source/user-guide/index.md) — installation, the
DataFrame and SQL APIs, Parquet ingestion, project status.
DataFrame and SQL APIs, Parquet ingestion.
- [Contributor guide](docs/source/contributor-guide/index.md) — build,
test, code style, and how to bump the DataFusion version.

Expand Down
4 changes: 2 additions & 2 deletions docs/source/user-guide/dataframe.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@ not start until you pull results.

## DataFrame transformations

The DataFrame API exposes `select` and `filter` today. Other
transformations are TBD — see [Project status](project-status.md).
The DataFrame API exposes `select`, `filter`, `limit`, `distinct`,
`dropColumns`, and `withColumnRenamed`.

```java
try (DataFrame df = ctx.readParquet("/path/to/orders.parquet")) {
Expand Down
1 change: 0 additions & 1 deletion docs/source/user-guide/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,6 @@ sessioncontext
dataframe
parquet
proto-plans
project-status
api-reference
```

Expand Down
49 changes: 0 additions & 49 deletions docs/source/user-guide/project-status.md

This file was deleted.

24 changes: 19 additions & 5 deletions docs/source/user-guide/sessioncontext.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,9 +40,23 @@ A `SessionContext` is **not thread-safe**. Do not share one across threads
without external synchronization. The simplest pattern is one context per
thread.

## What's configurable today
## Configuration

`SessionContext.builder()` exposes a fluent builder for overriding
DataFusion defaults — batch size, target partitions, statistics
collection, information schema, memory pool size, and the spill
directory. See the
<!-- Raw HTML link: MyST resolves relative .html Markdown links as
cross-references, which fails sphinx-build -W. The Javadoc tree is
copied verbatim via html_extra_path and is unknown to Sphinx. -->
<a href="../api/org/apache/datafusion/SessionContextBuilder.html"><code>SessionContextBuilder</code></a>
Javadoc for the full list.

Today, `SessionContext` exposes only data-source registration and query
construction. Tuning knobs that DataFusion offers natively
(`SessionConfig`, `RuntimeEnv`) are not yet wired through the Java API.
See [Project status](project-status.md) for the current shape of the API.
```java
try (SessionContext ctx = SessionContext.builder()
.batchSize(4096)
.targetPartitions(8)
.build()) {
// ...
}
```
Loading