Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RFC, Use asyncio for external programs, just prototype for now #235

Open
wants to merge 11 commits into
base: develop
Choose a base branch
from
Open

RFC, Use asyncio for external programs, just prototype for now #235

wants to merge 11 commits into from

Commits on Dec 3, 2023

  1. Split invoking of extract into separate method

    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    aeb7938 View commit details
    Browse the repository at this point in the history

  2. Prototype of using async for running external programs, just for tag … 

    …filtering on linux for now
    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    e357761 View commit details
    Browse the repository at this point in the history

  3. further hacking with asyncio, it is now working with semaphore

    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    6b8dbdd View commit details
    Browse the repository at this point in the history

  4. Use asyncio to merge tile files

    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    f0213c0 View commit details
    Browse the repository at this point in the history

  5. Use asyncio for sorting tile files, but still unsure if we really nee… 

    …d the sorting step
    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    4b87d15 View commit details
    Browse the repository at this point in the history

  6. Use asyncio for creating map files and compressing them

    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    42248da View commit details
    Browse the repository at this point in the history

  7. Some minor cleanup of asyncio, and tuning of semaphores

    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    ea921e9 View commit details
    Browse the repository at this point in the history

  8. The create map file step is quite memory consuming, tune down semaphores

    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    a95b96e View commit details
    Browse the repository at this point in the history

  9. Add missing setting of tile filename

    @alfh
    alfh committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    5adb156 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2023

  1. Use asyncio also for invoking contour generation, use pyhgtmap for el… 

    …evation generation

Temporarily remove srg.. support, since it involves fetching files using login cookie
and that seems to run into trouble. Got trouble even with semaphore(1), so do not think
it is related to running many instances in parallel, need to check how the pyhgtmap
is handling the download.
The pyhgtmap should possibly be changed to rather use M2M API with token, instead of
simulating logging in as a web client.
    @alfh
    alfh committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    8e23657 View commit details
    Browse the repository at this point in the history

  2. Fix building command arguments for compressing

    @alfh
    alfh committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    d205e40 View commit details
    Browse the repository at this point in the history