Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

python plugins: enable direct I/O in core instead of calling python for read and write #1297

Merged
merged 32 commits into from
Dec 7, 2022

Commits on Dec 7, 2022

  1. Configuration menu
    Copy the full SHA
    f85bae2 View commit details
    Browse the repository at this point in the history
  2. BareosFilePacket: rename fid -> filedes

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    f6bf7c4 View commit details
    Browse the repository at this point in the history
  3. BareosFilePacket: add bool do_io_in_core

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    83497b0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8f1fe6e View commit details
    Browse the repository at this point in the history
  5. fd_plugins.cc: fix restore problems

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    d2f6ec8 View commit details
    Browse the repository at this point in the history
  6. docs: document python plugin direct I/O

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    e202d6e View commit details
    Browse the repository at this point in the history
  7. BareosFdPluginLocalFileset.py: use direct I/O

    Implement `plugin_io_open()` so that we can configure direct I/O and
    pass the filedescriptor.
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    73e934a View commit details
    Browse the repository at this point in the history
  8. PythonPluginAPI.rst: add text formatting

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    200613f View commit details
    Browse the repository at this point in the history
  9. plugins: fix sentinels in bareosfd.h

    Sentinels for PyRestorePacket_members and PyIoPacket_members were
    incomplete and are now corrected.
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    da33c5a View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    ebebb26 View commit details
    Browse the repository at this point in the history
  11. systemtests: fix bconsole comments

    Change every wrong use of "#" to comment out a bconsole command to the
    correct "@#" that will actually comment out the command and will not
    produce the error message "#: is an invalid command."
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    2ff3b47 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    e94a4b4 View commit details
    Browse the repository at this point in the history
  13. bareosfd_test.py: adapt to changed IoPacket type

    As do_io_in_core was removed from IoPacket again, the test should not
    check for it.
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    ad89f23 View commit details
    Browse the repository at this point in the history
  14. python-fd-module-tester.cc: use varargs

    In bareosJobMsg() and bareosDebugMsg()
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    3f97870 View commit details
    Browse the repository at this point in the history
  15. bareosfd.h: rename python variables

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    de718f2 View commit details
    Browse the repository at this point in the history
  16. systemtests: adapt python-local-fileset-test

    Change python-local-fileset-test to also use io_in_core.
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    400380c View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    2395df4 View commit details
    Browse the repository at this point in the history
  18. systemtests: label tests with UTF-8 issues broken

    The basic and io_in_core tests in py{2,3}plug-fd-local-fileset-basic
    will run into UTF-8 conversion errors when running under the python3
    plugin.
    Until this problem is fixed, these tests are now marked as broken.
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    b016b75 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    0fd6ea2 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    d0d8b37 View commit details
    Browse the repository at this point in the history
  21. fd_plugins.cc: fix comment

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    3170bd3 View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    3e43958 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    18633e5 View commit details
    Browse the repository at this point in the history
  24. introduced kInvalidFiledescriptor

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    5416e9e View commit details
    Browse the repository at this point in the history
  25. fd_plugins.cc: add review suggested changes

    enum IoStatus: wrap into namespace
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    01181a3 View commit details
    Browse the repository at this point in the history
  26. python-fd-module-tester: use vsnprintf

    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    f21992c View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    a46560a View commit details
    Browse the repository at this point in the history
  28. BareosCheckAcl.cmake: use execute_process

    Replaces exec_program() with the newer execute_process().
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    fbd0767 View commit details
    Browse the repository at this point in the history
  29. systemtests: correctly enable local-filset-basic

    The tests in pyplug-fd-local-fileset-basic are now enabled and disabled
    as originally intended.
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    ca89b6b View commit details
    Browse the repository at this point in the history
  30. systemtests: improve cmake output for adding tests

    Change status messages to use unicode "check mark" and "ballot x" when
    showing if a test was enabled/disabled.
    Also prints the directory containing the test now.
    pstorz authored and arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    3d11527 View commit details
    Browse the repository at this point in the history
  31. filed: better non-utf-8 handling in python plugins

    Changes the implementation of BareosFdPluginLocalFilesBaseclass to
    handle non-utf8 encodable file-names gracefully.
    Instead of crashing we will now emit an M_ERROR that the file's name
    cannot be represented and go on with the next file.
    arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    eea0e6e View commit details
    Browse the repository at this point in the history
  32. systemtests: set io_in_core py3 test broken

    due to issues with multibyte files in the baseclass when using python3,
    we mark this test as broken for python3, as it will fail when python
    thinks the filesystem is in ascii-mode.
    arogge committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    b39cdeb View commit details
    Browse the repository at this point in the history