Enrich the CML Action using jupytext #176

radistoubalidis · 2022-08-30T11:09:43Z

Pull Request Template

Description

Use the jupytext tool to convert annual_summaries.py into a python notebook so its code can be used for display in the CML Action.

Additional Context (Please include any Screenshots/gifs if relevant)

The report would look something like this :

Headline

Some text about the report

Dependencies

import sqlite3
import pandas as pd

Connect to Database and Define SQL Query

conn = sqlite3.connect("tests/output/compiled_simulation_output.db")
query = <query_string>

Run Query and Generate plot

df = pd.read_sql_query(query, conn)
ax = df.plot.line("year")
ax.figure.savefig("tests/output/total_biomass_mt.png", dpi=300)

The plot image

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

…NT.Cloud into add_jupytext

* reproduce FLINT.Cloud apis * example sim report using cml * Update cml-report.yml * Update cml-report.yml * Update cml-report.yml * Update cml-report.yml * test if cml is setup right * add cml script * changed file paths to not show local directories * update cml report * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * update python script * run model summary * add sim start and end dates * delete irrelevant files * convert annual_summaries.py to py:percent format Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * converts and run annual_summaries.py as notebook usinng jupytext Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 4) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 5) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (fixed typo on 5, try 6) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (fixed typo on 7) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 8) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 9) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 10) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 11) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 12) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * check why cml comment is 404 not found Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * uncomment labeling filter Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * adds --uptate option to cml send-comment command Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test cml action with --update Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test cml action with --update Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test action with GITHUB_SHA var Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test action with GITHUB_SHA var (fix typo) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test cml action without --pr option Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * run workflow only on labels * reproduce FLINT.Cloud apis * example sim report using cml * Update cml-report.yml * Update cml-report.yml * Update cml-report.yml * Update cml-report.yml * test if cml is setup right * add cml script * changed file paths to not show local directories * update cml report * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * setup GCBM summary * update python script * run model summary * add sim start and end dates * delete irrelevant files * convert annual_summaries.py to py:percent format Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * converts and run annual_summaries.py as notebook usinng jupytext Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 4) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 5) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (fixed typo on 5, try 6) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (fixed typo on 7) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 8) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 9) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 10) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 11) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test if action works with jupytext (try 12) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * check why cml comment is 404 not found Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * uncomment labeling filter Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * adds --uptate option to cml send-comment command Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test cml action with --update Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test cml action with --update Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test action with GITHUB_SHA var Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test action with GITHUB_SHA var (fix typo) Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * test cml action without --pr option Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> * run workflow only on labels * fix lint Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com> Co-authored-by: HarshCasper <erbeusgriffincasper@gmail.com> Signed-off-by: Freeman <freemanoparaocha@gmail.com>

radistoubalidis and others added 23 commits August 26, 2022 14:48

reproduce FLINT.Cloud apis

eba5ff8

example sim report using cml

f1be67d

Update cml-report.yml

cf102ae

Update cml-report.yml

12e75d6

Update cml-report.yml

74db7da

Update cml-report.yml

e783dcd

test if cml is setup right

7a078da

add cml script

1c4e6ea

changed file paths to not show local directories

7c8cc4a

update cml report

9d50807

setup GCBM summary

3923640

setup GCBM summary

119adf7

setup GCBM summary

b36067b

setup GCBM summary

5f3fccb

setup GCBM summary

548ac69

setup GCBM summary

63c18bc

setup GCBM summary

cf2ee27

setup GCBM summary

cec7c5e

update python script

39d3d23

run model summary

98b5a66

add sim start and end dates

35f5b0c

delete irrelevant files

0fb90c8

convert annual_summaries.py to py:percent format

ff133cf

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

radistoubalidis added the simulation label Aug 30, 2022

radistoubalidis mentioned this pull request Aug 30, 2022

Test CML comment radistoubalidis/FLINT.Cloud#5

Closed

radistoubalidis added 2 commits August 30, 2022 14:44

converts and run annual_summaries.py as notebook usinng jupytext

7243b01

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext

8aa2f16

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

radistoubalidis marked this pull request as draft August 30, 2022 11:59

test if action works with jupytext

fcfca96

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

radistoubalidis removed the simulation label Aug 30, 2022

radistoubalidis and others added 25 commits September 7, 2022 14:51

add sim start and end dates

0550ea1

delete irrelevant files

e843bc6

convert annual_summaries.py to py:percent format

7d5a69d

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

converts and run annual_summaries.py as notebook usinng jupytext

0fafffe

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext

62d634d

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext

361fb0d

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext

eb4ba73

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (try 4)

165822c

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (try 5)

5b8ede5

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (fixed typo on 5, try 6)

dfd4e65

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (fixed typo on 7)

a4915a7

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (try 8)

aef46fc

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (try 9)

d05e796

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (try 10)

43fa5b5

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (try 11)

93c2065

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test if action works with jupytext (try 12)

6fdf6e7

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

check why cml comment is 404 not found

c4bfeb1

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

uncomment labeling filter

cdbd54e

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

adds --uptate option to cml send-comment command

9e51a20

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test cml action with --update

64de27d

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test cml action with --update

64f9eb6

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test action with GITHUB_SHA var

2bfb076

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test action with GITHUB_SHA var (fix typo)

277f279

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

test cml action without --pr option

5c3222f

Signed-off-by: radis toubalidis <rtoumpalidis@gmail.com>

run workflow only on labels

2df5af3

HarshCasper force-pushed the add_jupytext branch from 6c09c51 to 2df5af3 Compare September 7, 2022 09:21

HarshCasper added 2 commits September 7, 2022 14:51

Merge branch 'add_jupytext' of https://github.com/radistoubalidis/FLI…

8e2ba33

…NT.Cloud into add_jupytext

fix lint

e24713f

HarshCasper merged commit 6535209 into moja-global:master Sep 7, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Enrich the CML Action using jupytext #176

Enrich the CML Action using jupytext #176

radistoubalidis commented Aug 30, 2022 •

edited

Loading

Enrich the CML Action using jupytext #176

Enrich the CML Action using jupytext #176

Conversation

radistoubalidis commented Aug 30, 2022 • edited Loading

Pull Request Template

Description

Additional Context (Please include any Screenshots/gifs if relevant)

Headline

Dependencies

Connect to Database and Define SQL Query

Run Query and Generate plot

radistoubalidis commented Aug 30, 2022 •

edited

Loading