🐛 [Firebase_Storage] Slow upload speed

[hyobbb]

I am using firebase storage to save images and videos(.mp4) but upload speed is too slow.
Every files I upload is less then 4MB and it takes more than 15secs to upload it to firebase storage.
If I upload same file directly from console it only takes few seconds.
Is there any way to optimize the upload speed? such as setting chunk size?

Here is the log of uploadTask information and flutter doctor -v

UploadTask uploadVideoFile(String fileName, String filePath, String subFolder) {
    final file = File(filePath);
    //final fileName = path.basename(filePath);
    currentTask = _storageRef
        .child('$video/$subFolder/$fileName.mp4')
        .putFile(file);
    return currentTask;
  }

      print('[RecordingProviderDebug] start upload ${DateTime.now()}');
      _videoUrl = await uploadVideoFile(videoName, _encodingPath, _subfolder)
          .then((upload) => upload.ref.getDownloadURL());

      print('[RecordingProviderDebug] end upload ${DateTime.now()}');
      print('[RecordingProviderDebug] upload bytes size ${_fireVideoService.currentTask.snapshot.totalBytes}');

I/flutter (11648): [RecordingProviderDebug] start upload 2020-12-01 15:30:11.337365
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
D/BufferPoolAccessor(11648): bufferpool2 0x6f231f5620 : 0(0 size) total buffers - 0(0 size) used buffers - 1/7 (recycle/alloc) - 6/258 (fetch/transfer)
D/BufferPoolAccessor(11648): Destruction - bufferpool2 0x6f231f5620 cached: 0/0M, 0/0% in use; allocs: 7, 14% recycled; transfers: 258, 98% unfetced
I/ViewRootImpl@eaa066[MainActivity](notion://www.notion.so/11648): MSG_WINDOW_FOCUS_CHANGED 1 1
D/InputMethodManager(11648): prepareNavigationBarInfo() DecorView@a651d00[MainActivity]
D/InputMethodManager(11648): getNavigationBarColor() 0
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask(11648): Increasing chunk size to 524288
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask(11648): Increasing chunk size to 1048576
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask(11648): Increasing chunk size to 2097152
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(11648): (HTTPLog)-Static: isSBSettingEnabled false
I/flutter (11648): [RecordingProviderDebug] end upload 2020-12-01 15:30:29.363642
I/flutter (11648): [RecordingProviderDebug] upload bytes size 3104208

Took 18secs for 3.1MB file

I/flutter ( 8584): [RecordingProviderDebug] start upload 2020-12-01 15:52:26.829094
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
W/ract.nowfiprot( 8584): Accessing hidden method Lsun/misc/Unsafe;->getObject(Ljava/lang/Object;J)Ljava/lang/Object; (greylist, linking, allowed)
D/UploadTask( 8584): Increasing chunk size to 524288
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask( 8584): Increasing chunk size to 1048576
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask( 8584): Increasing chunk size to 2097152
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out( 8584): (HTTPLog)-Static: isSBSettingEnabled false
I/flutter ( 8584): [RecordingProviderDebug] end upload 2020-12-01 15:52:44.418709
I/flutter ( 8584): [RecordingProviderDebug] upload bytes size 2632654

Also took 18secs for 2.6MB file

[✓] Flutter (Channel stable, 1.22.4, on Mac OS X 10.15.7 19H15 darwin-x64, locale en-KR)
    • Flutter version 1.22.4 at /Users/hyobbb/development/flutter
    • Framework revision 1aafb3a8b9 (3 weeks ago), 2020-11-13 09:59:28 -0800
    • Engine revision 2c956a31c0
    • Dart version 2.10.4

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.2)
    • Android SDK at /Users/hyobbb/Library/Android/sdk
    • Platform android-30, build-tools 30.0.2
    • Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6915495)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 12.2)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.2, Build version 12B45b
    • CocoaPods version 1.10.0

[✓] Android Studio (version 4.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin installed
    • Dart plugin version 201.9245
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6915495)

 
[✓] Connected device (1 available)            
    • SM G970N (mobile) • R39M30264QW • android-arm64 • Android 10 (API 29)

• No issues found!

[markusaksli-nc]

Hi @hyobbb
I'm not seeing this issue with my SM G950F on the latest master 1.24.0-8.0.pre.375 using the official example with firebase_storage: ^5.1.0.

flutter doctor -v

[√] Flutter (Channel master, 1.24.0-8.0.pre.375, on Microsoft Windows [Version 10.0.19041.630], locale et-EE)
    • Flutter version 1.24.0-8.0.pre.375 at C:\Development\flutter_master
    • Framework revision a7f5fd5360 (22 hours ago), 2020-11-30 13:14:13 +0100
    • Engine revision 20caf54969
    • Dart version 2.12.0 (build 2.12.0-76.0.dev)

[√] Android toolchain - develop for Android devices (Android SDK version 30.0.2)
    • Android SDK at C:\Users\marku\AppData\Local\Android\sdk
    • Platform android-30, build-tools 30.0.2
    • Java binary at: C:\Users\marku\AppData\Local\JetBrains\Toolbox\apps\AndroidStudio\ch-0\201.6953283\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b01)
    • All Android licenses accepted.

[√] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[√] Visual Studio - develop for Windows (Visual Studio Community 2019 16.7.7)
    • Visual Studio at C:\Program Files (x86)\Microsoft Visual Studio\2019\Community
    • Visual Studio Community 2019 version 16.7.30621.155
    • Windows 10 SDK version 10.0.18362.0

[√] Android Studio (version 4.1.0)
    • Android Studio at C:\Users\marku\AppData\Local\JetBrains\Toolbox\apps\AndroidStudio\ch-0\201.6953283
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b01)

[√] IntelliJ IDEA Ultimate Edition (version 2020.2)
    • IntelliJ at C:\Users\marku\AppData\Local\JetBrains\Toolbox\apps\IDEA-U\ch-0\202.8194.7
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart

[√] Connected device (6 available)
    • SM G950F (mobile)           • ce12171c51cc001c03 • android-arm64  • Android 9 (API 28)
    • sdk gphone x86 arm (mobile) • emulator-5554      • android-x86    • Android 11 (API 30) (emulator)
    • Windows (desktop)           • windows            • windows-x64    • Microsoft Windows [Version 10.0.19041.630]
    • Web Server (web)            • web-server         • web-javascript • Flutter Tools
    • Chrome (web)                • chrome             • web-javascript • Google Chrome 87.0.4280.66
    • Edge (web)                  • edge               • web-javascript • Microsoft Edge 87.0.664.47

• No issues found!

Could you test the upload speed of both your computer and phone to see if that could be causing the discrepancy (assuming you meant uploading from your computer when you said uploading from console)?

If your computer is connected via a cable and your phone is connected via wifi that could cause the difference if your router is particularly subpar or the connection isn't great.
Thank you

[hyobbb]

@markusaksli-nc

Thank you for the reply.
I tried the same process with Andorid Emulator(Pixel 3a) and yes it works fine.

on Emulator

LAN

I/flutter ( 8046): [RecordingProviderDebug] start upload 2020-12-02 10:50:12.919593
D/UploadTask( 8046): Increasing chunk size to 524288
D/UploadTask( 8046): Increasing chunk size to 1048576
I/flutter ( 8046): [RecordingProviderDebug] end upload 2020-12-02 10:50:14.826493
I/flutter ( 8046): [RecordingProviderDebug] upload bytes size 984316

WiFi

I/flutter (16451): [RecordingProviderDebug] start upload 2020-12-02 11:02:12.608428
D/UploadTask(16451): Increasing chunk size to 524288
D/UploadTask(16451): Increasing chunk size to 1048576
I/flutter (16451): [RecordingProviderDebug] end upload 2020-12-02 11:02:15.465289
I/flutter (16451): [RecordingProviderDebug] upload bytes size 913803

with emulator both LAN & WiFi it shows more than 300KB/s.
However in real device

WiFi Real device SM-G970N

I/flutter (18526): [RecordingProviderDebug] start upload 2020-12-02 10:32:47.056455
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
W/ract.nowfiprot(18526): Accessing hidden method Lsun/misc/Unsafe;->getObject(Ljava/lang/Object;J)Ljava/lang/Object; (greylist, linking, allowed)
W/ract.nowfiprot(18526): Accessing hidden method Lsun/misc/Unsafe;->getObject(Ljava/lang/Object;J)Ljava/lang/Object; (greylist, linking, allowed)
W/ract.nowfiprot(18526): Accessing hidden method Lsun/misc/Unsafe;->getInt(Ljava/lang/Object;J)I (greylist, linking, allowed)
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask(18526): Increasing chunk size to 524288
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask(18526): Increasing chunk size to 1048576
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask(18526): Increasing chunk size to 2097152
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(18526): (HTTPLog)-Static: isSBSettingEnabled false
I/flutter (18526): [RecordingProviderDebug] end upload 2020-12-02 10:33:11.468783
I/flutter (18526): [RecordingProviderDebug] upload bytes size 2126767

the upload speed is less than 100KB/s. Could you tell me which factor may cause that difference?

[hyobbb]

Also, the upload speed is not even linear with upload data size.

I/flutter (10841): [RecordingProviderDebug] start upload 2020-12-02 14:53:27.864421
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask(10841): Increasing chunk size to 524288
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
D/UploadTask(10841): Increasing chunk size to 1048576
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
I/System.out(10841): (HTTPLog)-Static: isSBSettingEnabled false
I/flutter (10841): [RecordingProviderDebug] end upload 2020-12-02 14:53:42.570363
I/flutter (10841): [RecordingProviderDebug] upload bytes size 818114

according to this log it takes 15secs for uploading just 818KB size data. Is there any way to check the process with more information?

[markusaksli-nc]

I meant if you could check the speed on both devices on a third-party service like https://www.speedtest.net/. The previous possibility for a discrepancy remains since emulator will use the host internet connection.

Not familiar with android networking debugging but you could try flutter run -v to see if it provides more logs.

[hyobbb]

@markusaksli-nc
I also tried uploading files from SM 970GN device using firebase console web. It didn't take so long time although I did the task with same device, same internet connection.

flutter run -v didn't help either :(