Skip to content

Add direct emissions method with data export#3444

Open
kndehaan wants to merge 79 commits into
masterfrom
emissions
Open

Add direct emissions method with data export#3444
kndehaan wants to merge 79 commits into
masterfrom
emissions

Conversation

@kndehaan
Copy link
Copy Markdown
Member

@kndehaan kndehaan commented May 29, 2026 •
edited
Loading

Context

This PR adds a new direct emissions method to the model, together with a detailed data export containing all greenhouse gas emissions of a scenario.

Implemented changes

  • New engine methods and node attributes that calculate relevant direct emissions, based on presence of (molecule) node group emissions
  • Data processing pipeline that generates start year emissions data for country datasets, based on reported emission data from UNFCCC. Start year data is added as emissions.csv file to ETSource using a rake task.
  • New molecule nodes that read static emission data from emissions.csv, specified for co2 and other_ghg
  • Detailed data export containing relevant direct reporting emission results for all relevant nodes, and categorises these into ETM sector and subsector.

Related

Goes with pull requests:

Checklist

  • I have tested these changes
  • I have updated documentation as needed
  • I have tagged the relevant people for review

@kndehaan kndehaan marked this pull request as ready for review May 29, 2026 14:42
This was referenced May 29, 2026
Open
Open
Open
@kndehaan kndehaan requested a review from mabijkerk May 29, 2026 14:46
louispt1 and others added 25 commits May 29, 2026 17:07
@louispt1 @kndehaan
Add simple emissions group to specified nodes in the buildings sector…
6c82e32 
… for testing the production methods
@louispt1 @kndehaan
Add crude oil edge group to buildings sector and emissions to buildin…
3190557 
…gs crude oil nodes
@louispt1 @kndehaan
Add emissions.csv (example) to nl2019 and nl2023
c774f1c
@louispt1 @kndehaan
Add other_ghg carrier
b3c441a
@louispt1 @kndehaan
Add other_ghg to carriers.csv for nl2019 and nl2023
0c4c250
@kndehaan
Extend emissions group to rest of buildings sector
6f5915f
@louispt1 @kndehaan
Fix which nodes have the emissions group
460d5e0
@kndehaan
Correction in carriers.csv files
de226a1
@louispt1 @kndehaan
Adjust molecule node to query EMISSIONS with underscores
a202bf7
@kndehaan
Add co2_conversion_per_mj attribute to other_ghg
a7e8a05 
 carrier
@kndehaan
Convert emissions.csv values to kton
cbe6fc4
@kndehaan @robindesmit-quintel
Add dataset value molecule nodes with emissions groups
7d8abfe 
* Add molecule node examples

* Create 35 molecule nodes for emissions accounting

* Create groups for all emission molecule nodes

* Minor corrections

---------

Co-authored-by: robindesmit-quintel <robin.desmit@quintel.com>
@kndehaan
Bug fix molecule node positions
c477cb9
@kndehaan
Omit co2 conversion and cost attribute for other_ghg
95d1fb7
@kndehaan
Emissions groups added to Building sector nodes
c727bda
@kndehaan
Add emissions node and edge groups to sector Agriculture
88d2ce7
@kndehaan
Add emissions node groups for sector Other
7672310
@kndehaan
Add emissions and edge node groups for sector Households
c4f6743
@kndehaan
Add emissions groups for sector National transport
0bd9af6
@kndehaan
Update molecule node name to transport
a38a04a
@kndehaan
Undo added co2_conversion_per_mj attribute to kms carriers
f6e8f43
@kndehaan
Add emissions groups for sector International transport
5ded374
@kndehaan
Rename molecule nodes to bunkers
316c9e8
@kndehaan
Molecule node positions
18b1566
@kndehaan
Add co2_converison_per_mj to carrier files
8d81730
kndehaan and others added 28 commits May 29, 2026 17:11
@kndehaan
Update node groups
21fa157
@kndehaan
Update emissions csv files according to pipeline changes
8b791db
@robindesmit-quintel @kndehaan
Update the layout of groups in files with emission groups.
fb22c0c
@kndehaan
Update ccs_capture_rate for fischer tropsch non-biogenic waste
e61941f
@kndehaan
Add emissions groups to utilisation molecule node
4914e7a
@robindesmit-quintel @kndehaan
Change the name of emission group ccu_emitted to ccus_emitted
a94a3ee
@kndehaan
Reapply emissions_energy_steel groups to cokes nodes
7f50ada
@robindesmit-quintel @kndehaan
Update ccs_capture_rate value for Fischer Tropsch and Methanol synthe…
7d1930f 
…sis nodes.
@robindesmit-quintel @kndehaan
Add emissions groups and ccus_captured groups to relevant molecule no…
68a1c5e 
…des.
@louispt1 @kndehaan
Remove emissions_lulucf_removalsm group and replace with ccus_capture…
0e22131 
…d on lulucf removals node
@kndehaan
Remove ccus_utilised group from utilisation molecule node
b745435
@kndehaan
Restore emissions_lulucf_removals grouop
a3c288e
@kndehaan
Correction in molecule node groups
f182e6f
@robindesmit-quintel @kndehaan
Fix spelling mistake in emissions group of domestic aviation.
e3079d9
@robindesmit-quintel @kndehaan
Update the co2 utilisation of Fischer Tropsch molecule node.
3d8fd65
@robindesmit-quintel @kndehaan
More decimals in co2_utilization of Fischer Tropsch nodes.
5856e95
@robindesmit-quintel @kndehaan
Add molecule nodes for subcategories of food and paper.
aaa5e76
@robindesmit-quintel @kndehaan
Round to 6 decimals the co2 utilisation of Fischer Tropsch nodes.
799f49d
@kndehaan
Update methanol synthesis utilisation conversion factor molecule nodes
4bae05e
@kndehaan
Dummy values for industry food and paper non-energetic
700d36f
@kndehaan
Exclude fishing from nl datasets
7589918
@kndehaan
Apply UNFCCC API source for emissions country datasets
42b4fee
@kndehaan
Correct utilisation factor in fischer tropsch molecule nodes
270eb16
@kndehaan
Split 2.H and reallocate fishing
5aa783f
@kndehaan
Add emissions.csv dummy for eu
a97905d
@kndehaan
Bump Atlas to quintel/atlas@515a69c
becd987
@kndehaan
Bump Atlas to quintel/atlas@b6e9aea
ffcdcf9
@kndehaan
Split refineries process emissions from 1.B
2b3f743
@aaccensi @louispt1
@robindesmit-quintel @kndehaan
Emissions CSV export (#3443)
620564b 
* Rake import emissions task

* Update the layout of groups in files with emission groups.

* Add emissions_csv config file for the data export

* Add other emission methods to the data export and include all the sectors and subsectors.

* Simplify GHG column to use ghg_carrier method and round numeric columns to 6 decimal places

* Add documentation for emissions export yml file

* Minor rebasing corrections

---------

Co-authored-by: louispt1 <louisparkestalbot1@gmail.com>
Co-authored-by: robindesmit-quintel <robin.desmit@quintel.com>
Co-authored-by: Kyra de Haan <kyra.dehaan@quintel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mabijkerk mabijkerk Awaiting requested review from mabijkerk

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@kndehaan @louispt1 @robindesmit-quintel @aaccensi