Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: Incredible slow #2754

Closed
nathanredblur opened this issue Jul 14, 2024 · 4 comments
Closed

Bug: Incredible slow #2754

nathanredblur opened this issue Jul 14, 2024 · 4 comments

Comments

@nathanredblur
Copy link

Describe the bug

Issue: OneDrive docker container is incredibly slow, and I stuck and frustrated, I don't know what else to do. the maximu speed is 2MB/s

This is my docker compose

name: onedrive
services:
  main_app:
    cpu_shares: 90
    command: []
    container_name: onedrive
    deploy:
      resources:
        limits:
          memory: 15713M
    environment:
      - ONEDRIVE_GID=1000
      - ONEDRIVE_UID=1000
    image: driveone/onedrive:latest
    labels:
      icon: https://raw.githubusercontent.com/raivo-otp/issuer-icons/master/vectors/microsoft.com/microsoft-onedrive.svg
    restart: unless-stopped
    stdin_open: true
    tty: true
    volumes:
      - type: bind
        source: /DATA/AppData/onedrive
        target: /onedrive/conf
      - type: bind
        source: /media/Casper/oneDrive
        target: /onedrive/data
    ports: []
    devices: []
    cap_add: []
    network_mode: bridge
    privileged: false
x-casaos:
  author: NathanRedblur
  category: Developer
  hostname: ""
  icon: https://raw.githubusercontent.com/raivo-otp/issuer-icons/master/vectors/microsoft.com/microsoft-onedrive.svg
  index: /
  is_uncontrolled: false
  port_map: ""
  scheme: http
  store_app_id: onedrive
  title:
    custom: OneDrive

My hardware is new and other dockers works faster downoading things.
CleanShot 2024-07-14 at 06 40 27

Operating System Details

Linux ZimaCube 6.1.22 #2 SMP PREEMPT_DYNAMIC Wed Jun 12 08:43:36 UTC 2024 x86_64 GNU/Linux

cat: /etc/redhat-release: No such file or directory
-bash: lsb_release: command not found

this is the OS https://github.com/IceWhaleTech/zimaos-rauc
more hardware spects https://linuxgizmos.com/zimacube-6-bay-hdd-personal-cloud-with-quad-2-5gbe/

Client Installation Method

From Source

OneDrive Account Type

Personal

What is your OneDrive Application Version

onedrive v2.4.25

What is your OneDrive Application Configuration

onedrive  | # Launching onedrive
onedrive  | Configuration file successfully loaded
onedrive  | config file has been updated, checking if --resync needed
onedrive  | --------------- Application Runtime Configuration ---------------
onedrive  | onedrive version                             = v2.4.25
onedrive  | Config path                                  = /onedrive/conf
onedrive  | Config file found in config path             = true
onedrive  | Config option 'sync_dir'                     = /onedrive/data
onedrive  | Config option 'enable_logging'               = false
onedrive  | Config option 'log_dir'                      = /var/log/onedrive/
onedrive  | Config option 'disable_notifications'        = false
onedrive  | Config option 'min_notify_changes'           = 5
onedrive  | Config option 'skip_dir'                     = 
onedrive  | Config option 'skip_dir_strict_match'        = false
onedrive  | Config option 'skip_file'                    = ~*|.~*|*.tmp
onedrive  | Config option 'skip_dotfiles'                = false
onedrive  | Config option 'skip_symlinks'                = false
onedrive  | Config option 'monitor_interval'             = 300
onedrive  | Config option 'monitor_log_frequency'        = 6
onedrive  | Config option 'monitor_fullscan_frequency'   = 12
onedrive  | Config option 'read_only_auth_scope'         = false
onedrive  | Config option 'dry_run'                      = false
onedrive  | Config option 'upload_only'                  = false
onedrive  | Config option 'download_only'                = false
onedrive  | Config option 'local_first'                  = false
onedrive  | Config option 'check_nosync'                 = false
onedrive  | Config option 'check_nomount'                = false
onedrive  | Config option 'resync'                       = false
onedrive  | Config option 'resync_auth'                  = false
onedrive  | Config option 'cleanup_local_files'          = false
onedrive  | Config option 'classify_as_big_delete'       = 1000
onedrive  | Config option 'disable_upload_validation'    = false
onedrive  | Config option 'bypass_data_preservation'     = false
onedrive  | Config option 'no_remote_delete'             = false
onedrive  | Config option 'remove_source_files'          = false
onedrive  | Config option 'sync_dir_permissions'         = 700
onedrive  | Config option 'sync_file_permissions'        = 600
onedrive  | Config option 'space_reservation'            = 52428800
onedrive  | Config option 'application_id'               = 
onedrive  | Config option 'azure_ad_endpoint'            = 
onedrive  | Config option 'azure_tenant_id'              = common
onedrive  | Config option 'user_agent'                   = 
onedrive  | Config option 'force_http_11'                = false
onedrive  | Config option 'debug_https'                  = false
onedrive  | Config option 'rate_limit'                   = 104857600
onedrive  | Config option 'operation_timeout'            = 3600
onedrive  | Config option 'dns_timeout'                  = 60
onedrive  | Config option 'connect_timeout'              = 10
onedrive  | Config option 'data_timeout'                 = 600
onedrive  | Config option 'ip_protocol_version'          = 0
onedrive  | Config option 'sync_root_files'              = false
onedrive  | Selective sync 'sync_list' configured        = false
onedrive  | Config option 'sync_business_shared_folders' = false
onedrive  | Business Shared Folders configured           = false
onedrive  | Config option 'webhook_enabled'              = false

What is your 'curl' version

/bin/sh: 2: curl: not found

Where is your 'sync_dir' located

Local

What are all your system 'mount points'

overlay on / type overlay (rw,relatime,lowerdir=/var/lib/docker/overlay2/l/72KRCZWHYXNFZOZ2N5LOA25DGB:/var/lib/docker/overlay2/l/GVMXC542U53EDO3MK7CJOBLC4B:/var/lib/docker/overlay2/l/JYTILHBPW4JOX23PMOPP4BZPIH:/var/lib/docker/overlay2/l/I6FA57ZM2DU75PKFJYGMSO2BVH:/var/lib/docker/overlay2/l/EJ25SHURWTYAHDUG4P6KTQ2PSD:/var/lib/docker/overlay2/l/DAXR7FLBTGHFDFDAHYOURLTBSD,upperdir=/var/lib/docker/overlay2/1382169da98278c487eb2e7a3bc0fac87204940ed8a980fc075973e06ff8c005/diff,workdir=/var/lib/docker/overlay2/1382169da98278c487eb2e7a3bc0fac87204940ed8a980fc075973e06ff8c005/work)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev type tmpfs (rw,nosuid,size=65536k,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=666)
sysfs on /sys type sysfs (ro,nosuid,nodev,noexec,relatime)
cgroup on /sys/fs/cgroup type cgroup2 (ro,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
shm on /dev/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=65536k)
/dev/nvme0n1p8 on /onedrive/conf type ext4 (rw,relatime,commit=30)
/dev/sda on /onedrive/data type ext4 (rw,noatime)
/dev/nvme0n1p8 on /etc/resolv.conf type ext4 (rw,relatime,commit=30)
/dev/nvme0n1p8 on /etc/hostname type ext4 (rw,relatime,commit=30)
/dev/nvme0n1p8 on /etc/hosts type ext4 (rw,relatime,commit=30)
devpts on /dev/console type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=666)
proc on /proc/bus type proc (ro,nosuid,nodev,noexec,relatime)
proc on /proc/fs type proc (ro,nosuid,nodev,noexec,relatime)
proc on /proc/irq type proc (ro,nosuid,nodev,noexec,relatime)
proc on /proc/sys type proc (ro,nosuid,nodev,noexec,relatime)
proc on /proc/sysrq-trigger type proc (ro,nosuid,nodev,noexec,relatime)
tmpfs on /proc/asound type tmpfs (ro,relatime)
tmpfs on /proc/acpi type tmpfs (ro,relatime)
tmpfs on /proc/kcore type tmpfs (rw,nosuid,size=65536k,mode=755)
tmpfs on /proc/keys type tmpfs (rw,nosuid,size=65536k,mode=755)
tmpfs on /proc/timer_list type tmpfs (rw,nosuid,size=65536k,mode=755)
tmpfs on /proc/scsi type tmpfs (ro,relatime)
tmpfs on /sys/firmware type tmpfs (ro,relatime)

What are all your local file system partition types

# lsblk -f
NAME        FSTYPE FSVER LABEL UUID FSAVAIL FSUSE% MOUNTPOINTS
loop0                                              
loop1                                              
loop2                                              
loop3                                              
loop4                                              
loop5                                              
loop6                                              
loop7                                              
loop8                                              
loop9                                              
sda                                    5.5T    23% /onedrive/data
sdb                                                
`-sdb1                                             
zram0                                              
zram1                                              
zram2                                              
nvme0n1                                            
|-nvme0n1p1                                        
|-nvme0n1p2                                        
|-nvme0n1p3                                        
|-nvme0n1p4                                        
|-nvme0n1p5                                        
|-nvme0n1p6                                        
|-nvme0n1p7                                        
`-nvme0n1p8                          184.5G     8% /etc/hosts
                                                   /etc/hostname
                                                   /etc/resolv.conf
                                                   /onedrive/conf
#

How do you use 'onedrive'

I'm running a docker driveone/onedrive:latest only this docker is reading and writing in this mounting point.
My OneDrive account is active and running in other 3 devices (phone, and two PCs), none of them are storing data.

CleanShot 2024-07-14 at 07 16 07

Steps to reproduce the behaviour

just run the docker in that zima cube linux.

Complete Verbose Log Output

# We are being verbose
# Adding --verbose
# Launching onedrive
Using 'user' Config Dir: /onedrive/conf
Configuration file successfully loaded
--------------- Application Runtime Configuration ---------------
onedrive version                             = v2.4.25
Config path                                  = /onedrive/conf
Config file found in config path             = true
Config option 'sync_dir'                     = /onedrive/data
Config option 'enable_logging'               = false
Config option 'log_dir'                      = /var/log/onedrive/
Config option 'disable_notifications'        = false
Config option 'min_notify_changes'           = 5
Config option 'skip_dir'                     =
Config option 'skip_dir_strict_match'        = false
Config option 'skip_file'                    = ~*|.~*|*.tmp
Config option 'skip_dotfiles'                = false
Config option 'skip_symlinks'                = false
Config option 'monitor_interval'             = 300
Config option 'monitor_log_frequency'        = 6
Config option 'monitor_fullscan_frequency'   = 12
Config option 'read_only_auth_scope'         = false
Config option 'dry_run'                      = false
Config option 'upload_only'                  = false
Config option 'download_only'                = false
Config option 'local_first'                  = false
Config option 'check_nosync'                 = false
Config option 'check_nomount'                = false
Config option 'resync'                       = false
Config option 'resync_auth'                  = false
Config option 'cleanup_local_files'          = false
Config option 'classify_as_big_delete'       = 1000
Config option 'disable_upload_validation'    = false
Config option 'bypass_data_preservation'     = false
Config option 'no_remote_delete'             = false
Config option 'remove_source_files'          = false
Config option 'sync_dir_permissions'         = 700
Config option 'sync_file_permissions'        = 600
Config option 'space_reservation'            = 52428800
Config option 'application_id'               =
Config option 'azure_ad_endpoint'            =
Config option 'azure_tenant_id'              = common
Config option 'user_agent'                   =
Config option 'force_http_11'                = false
Config option 'debug_https'                  = false
Config option 'rate_limit'                   = 104857600
Config option 'operation_timeout'            = 3600
Config option 'dns_timeout'                  = 60
Config option 'connect_timeout'              = 10
Config option 'data_timeout'                 = 600
Config option 'ip_protocol_version'          = 0
Config option 'sync_root_files'              = false
Selective sync 'sync_list' configured        = false
Config option 'sync_business_shared_folders' = false
Business Shared Folders configured           = false
Config option 'webhook_enabled'              = false
-----------------------------------------------------------------
Checking Application Version ...
Initializing the OneDrive API ...
Configuring Global Azure AD Endpoints
Using Curl defaults for all HTTP operations
User Configured Rate Limit: 104857600
Opening the item database ...
All operations will be performed in: /onedrive/data
Application version: v2.4.25
Account Type: personal
Default Drive ID: 4859a2bf57aa86c5
Default Root ID: 4859A2BF57AA86C5!124
Remaining Free Space: 744854703308
Fetching details for OneDrive Root
OneDrive Root exists in the database
Initializing the Synchronization Engine ...
Initializing monitor ...
OneDrive monitor interval (seconds): 300
Monitor directory: .
Monitor directory: ./Pictures
Monitor directory: ./Pictures/Camera Roll
Monitor directory: ./Pictures/Camera Roll/2017
Monitor directory: ./Pictures/Camera Roll/2017/09
Monitor directory: ./Pictures/Camera Roll/2017/12
Monitor directory: ./Pictures/Camera Roll/2017/05
Monitor directory: ./Pictures/Camera Roll/2017/01
Monitor directory: ./Pictures/Camera Roll/2017/02
Monitor directory: ./Pictures/Camera Roll/2017/07
Monitor directory: ./Pictures/Camera Roll/2017/10
Monitor directory: ./Pictures/Camera Roll/2017/11
Monitor directory: ./Pictures/Camera Roll/2017/08
Monitor directory: ./Pictures/Camera Roll/2017/04
Monitor directory: ./Pictures/Camera Roll/2017/03
Monitor directory: ./Pictures/Camera Roll/2017/06
Monitor directory: ./Pictures/Camera Roll/2020
Monitor directory: ./Pictures/Camera Roll/2020/09
Monitor directory: ./Pictures/Camera Roll/2020/12
Monitor directory: ./Pictures/Camera Roll/2020/05
Monitor directory: ./Pictures/Camera Roll/2020/01
Monitor directory: ./Pictures/Camera Roll/2020/02
Monitor directory: ./Pictures/Camera Roll/2020/07
Monitor directory: ./Pictures/Camera Roll/2020/10
Monitor directory: ./Pictures/Camera Roll/2020/11
Monitor directory: ./Pictures/Camera Roll/2020/08
Monitor directory: ./Pictures/Camera Roll/2020/04
Monitor directory: ./Pictures/Camera Roll/2020/03
Monitor directory: ./Pictures/Camera Roll/2020/06
Monitor directory: ./Pictures/Camera Roll/2022
Monitor directory: ./Pictures/Camera Roll/2022/09
Monitor directory: ./Pictures/Camera Roll/2022/12
Monitor directory: ./Pictures/Camera Roll/2022/05
Monitor directory: ./Pictures/Camera Roll/2022/01
Monitor directory: ./Pictures/Camera Roll/2022/02
Monitor directory: ./Pictures/Camera Roll/2022/07
Monitor directory: ./Pictures/Camera Roll/2022/10
Monitor directory: ./Pictures/Camera Roll/2022/11
Monitor directory: ./Pictures/Camera Roll/2022/08
Monitor directory: ./Pictures/Camera Roll/2022/04
Monitor directory: ./Pictures/Camera Roll/2022/03
Monitor directory: ./Pictures/Camera Roll/2022/06
...
Monitor directory: ./Media/Books/Ciencia
Monitor directory: ./Media/Books/otros
Monitor directory: ./Media/Libros finanzas
Starting a sync with OneDrive
Syncing changes and items from OneDrive ...
Applying changes of Path ID: 4859A2BF57AA86C5!124
Updated Remaining Free Space: 744854703308
Processing 205 OneDrive items to ensure consistent local state
Processing 205 OneDrive items to ensure consistent local state
Downloading file Pictures/Camera Roll/2016/06/20160614-VID_20160614_132116-2.mp4 ...
Downloading 100% |oooooooooooooooooooooooooooooooooooooooo| DONE IN 00:00:11

Screenshots

No response

Other Log Information or Details

No response

Additional context

No response

@nathanredblur nathanredblur added the Bug Something isn't working label Jul 14, 2024
@abraunegg
Copy link
Owner

@nathanredblur
Unfortunately slow downloads are impacted by number of factors - including in your case how your OS has potentially chosen to implement Docker.

In your configuration you have also limited the client to 100 MB/s .... so I do not know if this is was intended or done due to testing .. but you should remove that configuration option.

Options to solve:

  1. I suggest you build your own Docker container from either the v2.5.x RC2 - please read OneDrive Client Version v2.5.0-rc2 is now available for testing #2710 and the updated documentation here: https://github.com/abraunegg/onedrive/blob/onedrive-v2.5.0-release-candidate-2/docs/docker.md
  2. As per above , but use what will become RC3 - 2724+updated logging test - For testing purposes only #2728 - again build your own Docker container.

Both these version have been 100% re-written to support multi-threading and provide significant performance improvements.

If you are still stuck at only using 2 MB/s post using RC2 or pre-RC3 .. you need to raise a bug with your OS .. as the bug lies in their implementation of Docker and/or their network stack.

@abraunegg abraunegg added Not a bug and removed Bug Something isn't working labels Jul 14, 2024
@nathanredblur
Copy link
Author

I'm getting troubles to make it works.
I can not create the image in my ZimaCube machine with the Linux because of the restriction of that system. So, I'm creating the image in my Mac M1 running this command
docker build . -t nathanredblur2/onedrive -f contrib/docker/Dockerfile-alpine

then, I upload the image to docker hub in order to use it with docker compose in my ZimaCube.

but I'm getting this error:
exec /entrypoint.sh: exec format error

I suppose that It's related to this
https://stackoverflow.com/questions/73398714/docker-fails-when-building-on-m1-macs-exec-usr-local-bin-docker-entrypoint-sh

but I'm not sure how can I solve it in this scenario.

@abraunegg
Copy link
Owner

@nathanredblur

I can not create the image in my ZimaCube machine with the Linux because of the restriction of that system.

Sounds like you need to raise another bug with your ZimaCube OS to allow you to build Docker images.

@abraunegg
Copy link
Owner

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

Repository owner locked as resolved and limited conversation to collaborators Jul 24, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants