PlotNamedStocks broken?

[djgroen]

Hi Yehor and Farzeen,

I've tried to use loc_lines in PlotNamedStocks, but I am stumbling upon the following error:

[Executing task] fplot
{'NamedStocksByTimestep': {'modes': ['loc_stdev']}, 'NamedSingleByTimestep': {'modes': ['stacked_bar', 'line_chart'], 'filters': ['None'], 'disaggregator': ['property_in_ukraine', 'gender', 'legal_status', 'origin'], 'primary_filter_column': ['destination'], 'primary_filter_value': None}}
/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_1
OUTDIRS:
['/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_1', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_2', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_3', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_4', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_5', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_6', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_7', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_8', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_9', '/home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_10']
[INFO] FUMEplot plots will be in /home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_1.
[FUMEplot]: plot_type set to stacked_bar.
[DEBUG] all destinations: ['austria', 'belgium', 'bulgaria', 'cherkaska', 'chernihivska', 'chernivetska', 'croatia', 'cyprus', 'czechia', 'denmark', 'dnipropetrovska', 'estonia', 'finland', 'france', 'germany', 'greece', 'hungary', 'ireland', 'italy', 'ivano-frankivska', 'khmelnytska', 'kirovohradska', 'kyiv', 'kyivska', 'latvia', 'lithuania', 'lvivska', 'mykolaivska', 'netherlands', 'odeska', 'poland', 'poltavska', 'portugal', 'republic-of-moldova', 'rivnenska', 'romania', 'slovakia', 'slovenia', 'spain', 'sumska', 'sweden', 'ternopilska', 'vinnytska', 'volynska', 'zakarpatska', 'zhytomyrska']
[DEBUG] keeping 18 oblasts: ['cherkaska', 'chernihivska', 'chernivetska', 'dnipropetrovska', 'ivano-frankivska', 'khmelnytska', 'kirovohradska', 'kyiv', 'kyivska', 'odeska', 'poltavska', 'rivnenska', 'sumska', 'ternopilska', 'vinnytska', 'volynska', 'zakarpatska', 'zhytomyrska']
[INFO] Saved PNG to /home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_1/EnsemblePlots/homecomingPlots/stacked_bar_property_in_ukraine.png
[INFO] Saved HTML to /home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_1/EnsemblePlots/homecomingPlots/stacked_bar_property_in_ukraine.html
[FUMEplot]: plot_type set to line_chart.
[INFO] saved PNG /home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_1/EnsemblePlots/homecomingPlots/fan_destination_None_property_in_ukraine.png
[INFO] saved HTML /home/csstddg/FabSim3/results/1412_1k_pwc25_archer2_1_replica_1/EnsemblePlots/homecomingPlots/fan_destination_None_property_in_ukraine.html
Traceback (most recent call last):
  File "/home/csstddg/.local/bin/fabsim", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/csstddg/FabSim3/fabsim/base/fabsim_main.py", line 162, in main
    env.exec_func(*env.task_args, **env.task_kwargs)
  File "/home/csstddg/FabSim3/fabsim/base/decorators.py", line 75, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/csstddg/FabSim3/plugins/FUMEplot/FUMEplot.py", line 90, in fplot
    PlotNamedStocksByTimestep.plotNamedStocksByTimestep(code, outdirs, m, FUMEheader, plot_path=outdirs[0])
  File "/home/csstddg/FabSim3/plugins/FUMEplot/fumeplot/PlotNamedStocksByTimestep.py", line 496, in plotNamedStocksByTimestep
    plotLocationSTDBound(outdirs, fi, i, sim_indices[i], data_indices[i], loc_names, y_label, save_fig=saving, plot_folder=plotfolder, combine_plots_pdf=pdf_pages)
  File "/home/csstddg/FabSim3/plugins/FUMEplot/fumeplot/PlotNamedStocksByTimestep.py", line 130, in plotLocationSTDBound
    fig.savefig(plot_folder+'/'+str(loc_names[loc_index]).replace(" ", "").replace("#", "Num")+'_std.png')
  File "/usr/lib/python3/dist-packages/matplotlib/figure.py", line 3285, in savefig
    self.canvas.print_figure(fname, **kwargs)
  File "/usr/lib/python3/dist-packages/matplotlib/backend_bases.py", line 2314, in print_figure
    self.figure.draw(renderer)
  File "/usr/lib/python3/dist-packages/matplotlib/artist.py", line 74, in draw_wrapper
    result = draw(artist, renderer, *args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/artist.py", line 51, in draw_wrapper
    return draw(artist, renderer)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/figure.py", line 3076, in draw
    self.get_layout_engine().execute(self)
  File "/usr/lib/python3/dist-packages/matplotlib/layout_engine.py", line 250, in execute
    return do_constrained_layout(fig, w_pad=w_pad, h_pad=h_pad,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/_constrained_layout.py", line 119, in do_constrained_layout
    make_layout_margins(layoutgrids, fig, renderer, h_pad=h_pad,
  File "/usr/lib/python3/dist-packages/matplotlib/_constrained_layout.py", line 371, in make_layout_margins
    pos, bbox = get_pos_and_bbox(ax, renderer)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/_constrained_layout.py", line 600, in get_pos_and_bbox
    tightbbox = martist._get_tightbbox_for_layout_only(ax, renderer)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/artist.py", line 1378, in _get_tightbbox_for_layout_only
    return obj.get_tightbbox(*args, **{**kwargs, "for_layout_only": True})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/axes/_base.py", line 4421, in get_tightbbox
    ba = martist._get_tightbbox_for_layout_only(axis, renderer)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/artist.py", line 1378, in _get_tightbbox_for_layout_only
    return obj.get_tightbbox(*args, **{**kwargs, "for_layout_only": True})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/axis.py", line 1269, in get_tightbbox
    bb = self.label.get_window_extent(renderer)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/text.py", line 915, in get_window_extent
    bbox, info, descent = self._get_layout(self._renderer)
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/text.py", line 321, in _get_layout
    w, h, d = _get_text_metrics_with_cache(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/text.py", line 97, in _get_text_metrics_with_cache
    return _get_text_metrics_with_cache_impl(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/text.py", line 105, in _get_text_metrics_with_cache_impl
    return renderer_ref().get_text_width_height_descent(text, fontprop, ismath)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/backends/backend_agg.py", line 229, in get_text_width_height_descent
    w, h, d = texmanager.get_text_width_height_descent(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/texmanager.py", line 362, in get_text_width_height_descent
    dvifile = cls.make_dvi(tex, fontsize)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/matplotlib/texmanager.py", line 295, in make_dvi
    cls._run_checked_subprocess(
  File "/usr/lib/python3/dist-packages/matplotlib/texmanager.py", line 261, in _run_checked_subprocess
    raise RuntimeError(
RuntimeError: latex was not able to process the following string:
b'\\\\Number of Refugees'

Here is the full command invocation and its output:

latex -interaction=nonstopmode --halt-on-error ../0774ea002e1d3fb9363b87045158dc13.tex

This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023/Debian) (preloaded format=latex)
 restricted \write18 enabled.
entering extended mode
(../0774ea002e1d3fb9363b87045158dc13.tex
LaTeX2e <2023-11-01> patch level 1
L3 programming layer <2024-01-22>
(/usr/share/texlive/texmf-dist/tex/latex/base/article.cls
Document Class: article 2023/05/17 v1.4n Standard LaTeX document class
(/usr/share/texlive/texmf-dist/tex/latex/base/size10.clo))
(/usr/share/texlive/texmf-dist/tex/latex/type1cm/type1cm.sty)
(/usr/share/texmf/tex/latex/cm-super/type1ec.sty
(/usr/share/texlive/texmf-dist/tex/latex/base/t1cmr.fd))
(/usr/share/texlive/texmf-dist/tex/latex/base/inputenc.sty)
(/usr/share/texlive/texmf-dist/tex/latex/geometry/geometry.sty
(/usr/share/texlive/texmf-dist/tex/latex/graphics/keyval.sty)
(/usr/share/texlive/texmf-dist/tex/generic/iftex/ifvtex.sty
(/usr/share/texlive/texmf-dist/tex/generic/iftex/iftex.sty)))
(/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsmath.sty
For additional information on amsmath, use the `?' option.
(/usr/share/texlive/texmf-dist/tex/latex/amsmath/amstext.sty
(/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsgen.sty))
(/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsbsy.sty)
(/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsopn.sty))
(/usr/share/texlive/texmf-dist/tex/latex/amsfonts/amssymb.sty
(/usr/share/texlive/texmf-dist/tex/latex/amsfonts/amsfonts.sty))
(/usr/share/texlive/texmf-dist/tex/latex/underscore/underscore.sty)
(/usr/share/texlive/texmf-dist/tex/latex/firstaid/underscore-ltx.sty)
(/usr/share/texlive/texmf-dist/tex/latex/base/textcomp.sty)
(/usr/share/texlive/texmf-dist/tex/latex/l3backend/l3backend-dvips.def)
No file 0774ea002e1d3fb9363b87045158dc13.aux.
*geometry* driver: auto-detecting
*geometry* detected driver: dvips
! Undefined control sequence.
l.29 {\rmfamily \Number
                        of Refugees}%
No pages of output.
Transcript written on 0774ea002e1d3fb9363b87045158dc13.log.

Do you perhaps know how I could possibly resolve this?

[djgroen]

I've used the latest UNHCR run data I shared with you, and defined the following homecoming.yml file:

NamedStocksByTimestep:
  modes: ["loc_stdev"]

NamedSingleByTimestep:
  modes: ["stacked_bar","line_chart"]
  filters: ["None"]
  disaggregator: ["property_in_ukraine","gender","legal_status","origin"]
  primary_filter_column: ["destination"]
  primary_filter_value: 

[YehorYudinIPP]

This must be an issue due to latexplot; it has problems rendering some of the headers.

I added a variable to choose whether one wants to use this library, and set it to false, it can influence only the creation of the figure; elsewhere syntax repeats matplotlib. We might want a better solution, though.

However, now I have the following issue when calling PlotNamedStocksByTimestep.py:

FileNotFoundError: No UA_*.geojson found in /home/yehor/workspace/vvuq/vamoplot/fumeplot/ukraine_geojson

Is this file available in the repository?