0.15.7 (2022-07-21)
New
DagsterRun
now has ajob_name
property, which should be used instead ofpipeline_name
.TimeWindowPartitionsDefinition
now has aget_partition_keys_in_range
method which returns a sequence of all the partition keys between two partition keys.OpExecutionContext
now hasasset_partitions_def_for_output
andasset_partitions_def_for_input
methods.- Dagster now errors immediately with an informative message when two
AssetsDefinition
objects with the same key are provided to the same repository. build_output_context
now accepts apartition_key
argument that can be used when testing thehandle_output
method of an IO manager.
Bugfixes
- Fixed a bug that made it impossible to load inputs using a DagsterTypeLoader if the InputDefinition had an
asset_key
set. - Ops created with the
@asset
and@multi_asset
decorators no longer have a top-level “assets” entry in their config schema. This entry was unused. - In 0.15.6, a bug was introduced that made it impossible to load repositories if assets that had non-standard metadata attached to them were present. This has been fixed.
- [dagster-dbt] In some cases, using
load_assets_from_dbt_manifest
with aselect
parameter that included sources would result in an error. This has been fixed. - [dagit] Fixed an error where a race condition of a sensor/schedule page load and the sensor/schedule removal caused a GraphQL exception to be raised.
- [dagit] The “Materialize” button no longer changes to “Rematerialize” in some scenarios
- [dagit] The live overlays on asset views, showing latest materialization and run info, now load faster
- [dagit] Typing whitespace into the launchpad Yaml editor no longer causes execution to fail to start
- [dagit] The explorer sidebar no longer displays “mode” label and description for jobs, since modes are deprecated.
Community Contributions
- An error will now be raised if a
@repository
decorated function expects parameters. Thanks @roeij!
Documentation
- The non-asset version of the Hacker News example, which lived inside
examples/hacker_news/
, has been removed, because it hadn’t received updates in a long time and had drifted from best practices. The asset version is still there and has an updated README. Check it out here
All Changes
See All Contributors
- 57acdd5 -
Correct check for pickle s3 io manager (#8834)
by @ripplekhera - 4114910 -
[dagit] Always show “Materialize” instead of “Rematerialize” based on status (#8711)
by @bengotow - 972274c -
[dagster-dbt] make group configurable for load_assets_from_dbt (#8863)
by @OwenKephart - 05fc596 -
asset_partitions_def on InputContext and OutputContext (#8858)
by @sryza - 2d86c76 -
[dagster-dbt] refactor the dbt asset integration (#8793)
by @OwenKephart - 150bc3e -
PartitionMappings when non-partitioned assets depend on partitioned assets (#8866)
by @sryza - 70a7dbf -
[dagster-dbt] seeds and snapshots are assets when using dbt build (#8794)
by @OwenKephart - e46b9a0 -
Document valid names for asset keys (#8765)
by @jamiedemaria - 2357a02 -
[docs] Dagster + dbt guide (#8714)
by @OwenKephart - dbaed58 -
0.15.6 changelog (#8876)
by @yuhan - 5bb50c0 -
provide description for MAP ConfigType (#8824)
by @Jiafi - b1aa83a -
Retrieve minimal set of asset records for assetsLatestInfo (#8835)
by @bengotow - b8493f3 -
error when duplicate asset keys on a repository (#8874)
by @sryza - 084c66c -
[docs] - Add Airflow Operator to Op Docs (#8875)
by @clairelin135 - 2f15fbf -
dagster-datahub Rest and Kafka Emitter integration (#8764)
by @Jiafi - 0988274 -
Automation: versioned docs for 0.15.6
by @elementl-devtools - 0e83834 -
[1.0] move solid to dagster.legacy (#8843)
by @dpeng817 - bc5e502 -
Extract ECS task overrides (#8842)
by @jmsanders - e3ea175 -
[graphql] tolerate empty runConfigData (#8886)
by @alangenfeld - 56c7023 -
[dagit] Fix edge case where “ “ launchpad config is not coerced to an empty object (#8895)
by @bengotow - ee2e977 -
Fix ScheduleRootQuery typo (#8903)
by @johannkm - 61c1c20 -
unloadable shit (#8887)
by @prha - 711b323 -
Change base image for OSS release builds (#8902)
by @gibsondan - c85e158 -
change deprecation warnings to 1.0 (#8892)
by @dpeng817 - cd779b1 -
update README for hacker news assets example (#8904)
by @sryza - e657abd -
[hacker news] add missing key prefix to activity analytics python assets (#8817)
by @sryza - 4da2a9e -
[buildkite] Specify internal branch used for compatibility pipeline (#8881)
by @smackesey - 6c97c75 -
[dagit] Remove “mode” label and description in explorer sidebar (#8907)
by @bengotow - 4cefd84 -
remove the non-asset version of the hacker news example (#8883)
by @sryza - 23a9997 -
Error when @repository-decorated function has arguments (#8913)
by @roeij - f787d6d -
[docs] - Correct snippets for dbt (#8923)
by @erinkcochran87 - 1961e51 -
[bug] fix input loading regression (#8885)
by @OwenKephart - ff87738 -
[docs] - graph backed assets doc fix (#8927)
by @jamiedemaria - 18f254d -
silence system-originated experimental warning for PartitionMapping (#8931)
by @sryza - a2df1de -
Add partition key to build_output_context, add documentation for partition_key on build_op_context (#8774)
by @dpeng817 - 53287b9 -
fix dimensions of screenshot on connecting ops tutorial page (#8908)
by @sryza - c00de5b -
ttv: remove undocumented/legacy example - user in loop (#8934)
by @yuhan - 31f3283 -
[docs] - Clean up graph-backed asset example, put under test (#8893)
by @dpeng817 - 7c60a46 -
[docs] - Fix garbled sentence in ops.mdx (#8935)
by @schrockn - c554461 -
enable getting asset partitions def from op context (#8924)
by @sryza - 7c13e28 -
Increase test_docker_monitoring timeout (#8906)
by @johannkm - 6365996 -
PartitionsDefinition.get_partition_keys_in_range (#8933)
by @sryza - b58d711 -
Move pipeline to dagster.legacy (#8888)
by @dpeng817 - 7e11df2 -
[dagit] Rename search open event (#8954)
by @hellendag - f3caeae -
[dagit] Adjust shift-selection behavior in asset graphs (#8950)
by @bengotow - 65caf79 -
[dagit] Clean up code around the graph sidebar (#8914)
by @bengotow - 5bd5c8b -
add a job_name property to PipelineRun (#8928)
by @sryza - 9421f73 -
remove partition entries from asset op config schema (#8951)
by @sryza - 000d37a -
avoid pipelines in run status sensor doc snippets (#8929)
by @sryza - a9b25dd -
[bug] Fix issue where 'invalid' asset metadata resulted in an error (#8947)
by @OwenKephart - 4dadcd4 -
[dagster-dbt] fix tagged source asset loading (#8943)
by @OwenKephart - 065adbd -
fix black in run status sensor docs example (#8974)
by @sryza - 164c585 -
[known state] fix build_for_reexecution bug (#8975)
by @alangenfeld - cc70c88 -
Document deprecation of MetadataEntry static constructors (#8984)
by @smackesey - eed9277 -
changelog (#8986)
by @jamiedemaria - b283b8a -
0.15.7
by @elementl-devtools