Skip to content

@simonw simonw released this Mar 29, 2021

Documentation improvements, bug fixes and support for SpatiaLite 5.

  • The SQL editor can now be resized by dragging a handle. (#1236)
  • Fixed a bug with JSON faceting and the __arraycontains filter caused by tables with spaces in their names. (#1239)
  • Upgraded httpx dependency. (#1005)
  • JSON faceting is now suggested even if a column contains blank strings. (#1246)
  • New datasette.add_memory_database() method. (#1247)
  • The Response.asgi_send() method is now documented. (#1266)
  • The official Datasette Docker image now bundles SpatiaLite version 5. (#1278)
  • Fixed a no such table: pragma_database_list bug when running Datasette against SQLite versions prior to SQLite 3.16.0. (#1276)
  • HTML lists displayed in table cells are now styled correctly. Thanks, Bob Whitelock. (#1141, #1252)
  • Configuration directory mode now correctly serves immutable databases that are listed in inspect-data.json. Thanks Campbell Allen and Frankie Robertson. (#1031, #1229)
Assets 2

@simonw simonw released this Feb 19, 2021

Support for cross-database SQL queries and built-in support for serving via HTTPS.

  • The new --crossdb command-line option causes Datasette to attach up to ten database files to the same /_memory database connection. This enables cross-database SQL queries, including the ability to use joins and unions to combine data from tables that exist in different database files. See Cross-database queries for details. (#283)
  • --ssl-keyfile and --ssl-certfile options can be used to specify a TLS certificate, allowing Datasette to serve traffic over https:// without needing to run it behind a separate proxy. (#1221)
  • The /:memory: page has been renamed (and redirected) to /_memory for consistency with the new /_internal database introduced in Datasette 0.54. (#1205)
  • Added plugin testing documentation on Using pdb for errors thrown inside Datasette. (#1207)
  • The official Datasette Docker image now uses Python 3.7.10, applying the latest security fix for that Python version. (#1235)
Assets 2

@simonw simonw released this Feb 2, 2021

  • Fixed a bug where ?_search= and ?_sort= parameters were incorrectly duplicated when the filter form on the table page was re-submitted. (#1214)
Assets 2

@simonw simonw released this Jan 25, 2021

The two big new features in this release are the _internal SQLite in-memory database storing details of all connected databases and tables, and support for JavaScript modules in plugins and additional scripts.

For additional commentary on this release, see Datasette 0.54, the annotated release notes.

The _internal database

As part of ongoing work to help Datasette handle much larger numbers of connected databases and tables (see Datasette Library) Datasette now maintains an in-memory SQLite database with details of all of the attached databases, tables, columns, indexes and foreign keys. (#1150)

This will support future improvements such as a searchable, paginated homepage of all available tables.

You can explore an example of this database by signing in as root to the latest.datasette.io demo instance and then navigating to latest.datasette.io/_internal.

Plugins can use these tables to introspect attached data in an efficient way. Plugin authors should note that this is not yet considered a stable interface, so any plugins that use this may need to make changes prior to Datasette 1.0 if the _internal table schemas change.

Named in-memory database support

As part of the work building the _internal database, Datasette now supports named in-memory databases that can be shared across multiple connections. This allows plugins to create in-memory databases which will persist data for the lifetime of the Datasette server process. (#1151)

The new memory_name= parameter to the Database class can be used to create named, shared in-memory databases.

JavaScript modules

JavaScript modules were introduced in ECMAScript 2015 and provide native browser support for the import and export keywords.

To use modules, JavaScript needs to be included in <script> tags with a type="module" attribute.

Datasette now has the ability to output <script type="module"> in places where you may wish to take advantage of modules. The extra_js_urls option described in Custom CSS and JavaScript can now be used with modules, and module support is also available for the extra_body_script() plugin hook. (#1186, #1187)

datasette-leaflet-freedraw is the first example of a Datasette plugin that takes advantage of the new support for JavaScript modules. See Drawing shapes on a map to query a SpatiaLite database for more on this plugin.

Code formatting with Black and Prettier

Datasette adopted Black for opinionated Python code formatting in June 2019. Datasette now also embraces Prettier for JavaScript formatting, which like Black is enforced by tests in continuous integration. Instructions for using these two tools can be found in the new section on Code formatting in the contributors documentation. (#1167)

Other changes

  • Datasette can now open multiple database files with the same name, e.g. if you run datasette path/to/one.db path/to/other/one.db. (#509)
  • datasette publish cloudrun now sets force_https_urls for every deployment, fixing some incorrect http:// links. (#1178)
  • Fixed a bug in the example nginx configuration in Running Datasette behind a proxy. (#1091)
  • The Datasette Ecosystem documentation page has been reduced in size in favour of the datasette.io tools and plugins directories. (#1182)
  • The request object now provides a request.full_path property, which returns the path including any query string. (#1184)
  • Better error message for disallowed PRAGMA clauses in SQL queries. (#1185)
  • datasette publish heroku now deploys using python-3.8.7.
  • New plugin testing documentation on Testing outbound HTTP calls with pytest-httpx. (#1198)
  • All ?_* query string parameters passed to the table page are now persisted in hidden form fields, so parameters such as ?_size=10 will be correctly passed to the next page when query filters are changed. (#1194)
  • Fixed a bug loading a database file called test-database (1).sqlite. (#1181)
Assets 2
Pre-release
Pre-release

@simonw simonw released this Jan 19, 2021

Alpha release. Release notes in progress.

  • Improved support for named in-memory databases. (#1151)
  • New _internal in-memory database tracking attached databases, tables and columns. (#1150)
  • Support for JavaScript modules. (#1186, #1187)
Assets 2

@simonw simonw released this Dec 11, 2020

Datasette has an official project website now, at https://datasette.io/. This release mainly updates the documentation to reflect the new site.

  • New ?column__arraynotcontains= table filter. (#1132)
  • datasette serve has a new --create option, which will create blank database files if they do not already exist rather than exiting with an error. (#1135)
  • New ?_header=off option for CSV export which omits the CSV header row, documented here. (#1133)
  • "Powered by Datasette" link in the footer now links to https://datasette.io/. (#1138)
  • Project news no longer lives in the README - it can now be found at https://datasette.io/news. (#1137)
Assets 3

@simonw simonw released this Dec 9, 2020

  • Fix for error caused by combining the _searchmode=raw and ?_search_COLUMN parameters. (#1134)
Assets 2

@simonw simonw released this Dec 5, 2020

  • Show pysqlite3 version on /-/versions, if installed. (#1125)
  • Errors output by Datasette (e.g. for invalid SQL queries) now go to stderr, not stdout. (#1131)
  • Fix for a startup error on windows caused by unnecessary from os import EX_CANTCREAT - thanks, Abdussamet Koçak. (#1094)
Assets 2

@simonw simonw released this Dec 3, 2020

  • Fixed bug where static assets would 404 for Datasette installed on ARM Amazon Linux. (#1124)
Assets 2

@simonw simonw released this Dec 3, 2020

  • Generated columns from SQLite 3.31.0 or higher are now correctly displayed. (#1116)
  • Error message if you attempt to open a SpatiaLite database now suggests using --load-extension=spatialite if it detects that the extension is available in a common location. (#1115)
  • OPTIONS requests against the /database page no longer raise a 500 error. (#1100)
  • Databases larger than 32MB that are published to Cloud Run can now be downloaded. (#749)
  • Fix for misaligned cog icon on table and database pages. Thanks, Abdussamet Koçak. (#1121)
Assets 2