v0.20.0

This release introduces a number of significant updates, including new ways to work with files, better integrations with SAS and Stata, and new methods for parallel data processing – alongside a series of significant performance improvements when streaming large tables and files

What's new

• table.file("path/to/file") -> you can now reference a file within a table directly by its name!
• table.to_directory() -> construct a Directory, which is a representation of the files within a table that follows standard filesystem tree semantics, and allows for powerful manipulation of files at scale.
  • Directory.download()
  • Directory.get()
  • Directory.list()
  • Directory.mount()
• Calling file.open() now behaves the same as opening a file on the filesystem. E.g., with file.open() as f: ...
• Redivis filesystems are automatically registered with fsspec. When using compatible libraries, you can reference Redivis files via the URI scheme: redivis://table_ref/path/to/file.
• New table.to_read_streams() method returns a list of readable data streams that can be used for parallel processing.
• New table.to_sas() and table.to_stata() methods streamline the ability to load data directly into SAS / Stata within compatible notebooks.
• New table.update_variables(), dataset.update_variables(), and workflow.update_variables() methods allow for the bulk management of variable metadata across a table, dataset, or workflow.
• All exceptions raised by Redivis now inherit from class redivis.exceptions.RedivisError, with additional context based on the type of exception (docs).

Deprecations

• file.stream() has been renamed to file.open(). Use of the stream method will print a deprecation warning, and will be fully removed in a future version.
• table.download_files() has been superseded by table.to_directory().download(). Use of the old method will print a deprecation warning, and will be removed in a future version.
• Previously, a file id was used in the file(<id>) constructor. This behavior has been deprecated, in favor of passing the file name / path directly. Using the file id will print a deprecation warning, and will be fully removed in a future version.

Breaking changes

• redivis.file() is not longer available. Please use `redivis.table("table_ref").file("path/to/file") instead
• table.list_rows(), which has been deprecated for a number of major versions, has now been removed and will raise an error. Use table.to_arrow_table().to_pylist() instead.