Not work audio streaming on android 11 #3796

bropines · 2023-03-12T12:15:42Z

I have read the FAQ.
I have searched in existing issues.

Environment

OS: Windows 11
scrcpy version: scrcpy 2.0
installation method: Windows release...
device model: Redmi Note 8T
Android version: 11

Describe the bug
The sound just doesn't work. When you try to make it forcibly this happens

PS Programs\scrcpy-win64-v2.0> .\scrcpy-console.bat -d --require-audio
scrcpy 2.0 <https://github.com/Genymobile/scrcpy>
C:\Users\bropi\Programs\scrcpy-win64-v2.0\scrcpy-server: 1 file pushed, 0 skipped. 62.6 MB/s (52867 bytes in 0.001s)
[server] INFO: Device: Xiaomi Redmi Note 8T (Android 11)
INFO: Renderer: direct3d
INFO: Initial texture: 1080x2336
[server] ERROR: Failed to start audio capture
[server] ERROR: On Android 11, it is only possible to capture in foreground, make sure that the device is unlocked when starting scrcpy.
WARN: Demuxer 'audio': stream explicitly disabled by the device
ERROR: Demuxer error
WARN: Killing the server... ```


Please do not post screenshots of your terminal, just post the content as text instead.

The text was updated successfully, but these errors were encountered:

rom1v · 2023-03-12T12:32:42Z

Dis you follow the instructions specific to Android 11? https://github.com/Genymobile/scrcpy/blob/master/doc/audio.md

bropines · 2023-03-12T12:40:57Z

Do you follow the instructions specific to Android 11? https://github.com/Genymobile/scrcpy/blob/master/doc/audio.md

Yep. The screen is on, the developer settings do not block access to the sound. I also tried it with the --require-audio parameter the result is zero. It just won't start.

rom1v · 2023-03-12T14:06:55Z

For testing, could you please replace the server in the scrcpy 2.0 release folder:

scrcpy-server _{SHA-256: 68f9c478177e543a180ee9460eb63b6969c0501ef22280fe00fe51d4310fe80f}

It disables the workaround for Android 11:

diff

diff --git a/server/src/main/java/com/genymobile/scrcpy/AudioCapture.java b/server/src/main/java/com/genymobile/scrcpy/AudioCapture.java
index 9228e3d71..6d336ac66 100644
--- a/server/src/main/java/com/genymobile/scrcpy/AudioCapture.java
+++ b/server/src/main/java/com/genymobile/scrcpy/AudioCapture.java
@@ -85,7 +85,7 @@ public final class AudioCapture {
     }
 
     public void start() throws AudioCaptureForegroundException {
-        startWorkaroundAndroid11();
+        //startWorkaroundAndroid11();
         try {
             recorder = createAudioRecord();
             recorder.startRecording();
@@ -97,7 +97,7 @@ public final class AudioCapture {
             }
             throw e;
         } finally {
-            stopWorkaroundAndroid11();
+            //stopWorkaroundAndroid11();
         }
     }

Then, unlock your device, and execute:

adb shell am start -n com.android.shell/.HeapDumpActivity

It should open a popup. Keep it open and visible (your device must be kept unlocked and powered on).

Then run scrcpy. Does audio capture work in this case?

bropines · 2023-03-12T14:23:36Z

For testing, could you please replace the server in the scrcpy 2.0 release folder:

scrcpy-server SHA-256: 68f9c478177e543a180ee9460eb63b6969c0501ef22280fe00fe51d4310fe80f

It disables the workaround for Android 11:

diff
Then, unlock your device, and execute:
adb shell am start -n com.android.shell/.HeapDumpActivity
It should open a popup. Keep it open and visible (your device must be kept unlocked and powered on).

Then run scrcpy. Does audio capture work in this case?

Yes. It works. Even if you press OK at the popup, the sound keeps streaming. And it only works the way you said it would.

This is the window that pops up (sorry for the Russian lang in system)

rom1v · 2023-03-12T14:29:50Z

OK, so the culprit is probably the delay here:

scrcpy/server/src/main/java/com/genymobile/scrcpy/AudioCapture.java

Line 76 in cbca79b

SystemClock.sleep(150);

Are you comfortable to build the app from sources? You could try to adjust the delay until you get a value which works for your device. I'm interested in that value :)

bropines · 2023-03-12T14:31:59Z

Are you comfortable to build the app from sources? You could try to adjust the delay until you get a value which works for your device. I'm interested in that value :)

It doesn't look hard, I'm going to try it now

bropines · 2023-03-12T14:36:41Z

OK, so the culprit is probably the delay here:

scrcpy/server/src/main/java/com/genymobile/scrcpy/AudioCapture.java

Line 76 in cbca79b

SystemClock.sleep(150);

Are you comfortable to build the app from sources? You could try to adjust the delay until you get a value which works for your device. I'm interested in that value :)

I would like to clarify. Which way should I change the delay? Higher or lower?

rom1v · 2023-03-12T14:37:40Z

It seems the delay is insufficient in your case, so you must use an higher delay.

bropines · 2023-03-12T15:48:27Z

It seems the delay is insufficient in your case, so you must use an higher delay.

I'm kind of dumb.

bropines · 2023-03-12T17:46:10Z

It seems the delay is insufficient in your case, so you must use an higher delay.

I'm kind of dumb.

That's the error thing because I was using kali -_-

bropines · 2023-03-12T21:01:33Z

After 5 hours of misunderstandings with Linux I finally installed it. Delay of 300 (units, seconds, whatever) is working

rom1v · 2023-03-12T22:14:01Z

Thank you. Does it 100% work with 300ms? I will probably increase the current value to 300 then.

bropines · 2023-03-12T22:20:01Z

Thank you. Does it 100% work with 300ms? I will probably increase the current value to 300 then.

It worked at 200 every other time, I have not tested at 250. I can check later. But at 300 it definitely works.

drobotk · 2023-03-13T18:49:28Z

Hi

I have an issue that seems related. For some reason audio works fine for me on Windows, but fails on Linux, with the same error:

[server] ERROR: Failed to start audio capture
[server] ERROR: On Android 11, it is only possible to capture in foreground, make sure that the device is unlocked when starting scrcpy.

I haven't tried changing that delay yet, but it seems a bit weird that the Linux version would require a different delay than the Windows version.

rom1v · 2023-03-14T18:29:41Z

I haven't tried changing that delay yet

Could you please try? ❤️

drobotk · 2023-03-15T20:03:02Z

Alright, with a delay of 250 it seems to work fine every time. I haven't tried any other values, though, but I might later.

EDIT: After a bunch of restarts I did manage to get it to fail. 300 might be better then.

On Android 11, a fake popup must be briefly opened to make the system think that the shell app is in the foreground so that audio may be recorded. Making the shell app foreground may take some time depending on the device, so make 3 attempts, waiting 100ms before each. Fixes #3796 <#3796>

rom1v · 2023-03-16T21:16:41Z

I implemented 3 attempts with 100ms before each, so that on most devices, it will work within 100ms (so the popup is not visible for too long), but on others it will still work: bc82e34

Here is a full build for win64:

scrcpy-win64.zip _{SHA-256: scrcpy-win64-v2.0-21-g85c45c5f5.zip}

Please tell me if it works for you.

bropines · 2023-03-16T23:08:59Z

I implemented 3 attempts with 100ms before each, so that on most devices, it will work within 100ms (so the popup is not visible for too long), but on others it will still work: bc82e34

Here is a full build for win64:

scrcpy-win64.zip SHA-256: scrcpy-win64-v2.0-21-g85c45c5f5.zip

Please tell me if it works for you.

Yep. Working on my phone. Thanks. I think we'll wait for feedback from other users, and close this issue

yume-chan · 2023-03-17T05:20:32Z

scrcpy/server/src/main/java/com/genymobile/scrcpy/AudioCapture.java

Lines 61 to 79 in 2ef1430

    
           private static void startWorkaroundAndroid11() { 
        
               if (Build.VERSION.SDK_INT == Build.VERSION_CODES.R) { 
        
                   // Android 11 requires Apps to be at foreground to record audio. 
        
                   // Normally, each App has its own user ID, so Android checks whether the requesting App has the user ID that's at the foreground. 
        
                   // But scrcpy server is NOT an App, it's a Java application started from Android shell, so it has the same user ID (2000) with Android 
        
                   // shell ("com.android.shell"). 
        
                   // If there is an Activity from Android shell running at foreground, then the permission system will believe scrcpy is also in the 
        
                   // foreground. 
        
                   if (Build.VERSION.SDK_INT == Build.VERSION_CODES.R) { 
        
                       Intent intent = new Intent(Intent.ACTION_MAIN); 
        
                       intent.addFlags(Intent.FLAG_ACTIVITY_NEW_TASK); 
        
                       intent.addCategory(Intent.CATEGORY_LAUNCHER); 
        
                       intent.setComponent(new ComponentName(FakeContext.PACKAGE_NAME, "com.android.shell.HeapDumpActivity")); 
        
                       ServiceManager.getActivityManager().startActivityAsUserWithFeature(intent); 
        
                       // Wait for activity to start 
        
                       SystemClock.sleep(150); 
        
                   } 
        
               } 
        
           }

It checked if (Build.VERSION.SDK_INT == Build.VERSION_CODES.R) twice.

rom1v · 2023-03-17T06:24:30Z

Yes, I noticed that yesterday 👍 It will be fixed by aa6846c (not merged yet).

bropines · 2023-03-17T10:21:45Z

Yes, I noticed that yesterday 👍 It will be fixed by aa6846c (not merged yet).

I just saw all these branches. What a horror)

rom1v · 2023-03-17T10:27:04Z

🙈

rom1v · 2023-03-17T11:01:44Z

Locally:

$ git branch | wc -l
1062

I should probably do some cleanup. 😄

However, I want to keep many of them somewhere, to be able to (manually) "bisect" across branches for debugging.

For example, if a bug is reported, and I observe that it works on audio.107 (102 commits) but not on audio.145 (119 commits), what changes has been made between the two patchsets?

git range-diff audio.107~102..audio.107 audio.145~119..audio.145

On Android 11, a fake popup must be briefly opened to make the system think that the shell app is in the foreground so that audio may be recorded. Making the shell app foreground may take some time depending on the device, so make 3 attempts, waiting 100ms before each. Fixes #3796 <#3796>

rom1v · 2023-03-17T20:35:28Z

02f4ff7 and 3626d90 merged into dev.

Making the shell app foreground (specific for Android 11) may take more than 300ms on some devices, so increase the number of attempts from 3 to 5 (separated by 100ms). Fixes #4147 <#4147> Refs #3796 <#3796> Refs 02f4ff7

rom1v closed this as completed Mar 17, 2023

This was referenced Mar 27, 2023

Audio issue #3868

Closed

Demuxer 'audio' #3869

Closed

rom1v mentioned this issue Apr 18, 2023

Update AudioCapture.java #3930

Closed

PureIncompetence mentioned this issue Jul 7, 2023

Failed to start audio capture / Demuxer 'audio': stream explicitly disabled by the device on Android 11 #4147

Closed

2 tasks

yume-chan mentioned this issue Jul 10, 2023

Audio capture does not work on OnePlus 6T (Android 11) *not on the main user* #4153

Closed

2 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Not work audio streaming on android 11 #3796

Not work audio streaming on android 11 #3796

bropines commented Mar 12, 2023 •

edited

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023 •

edited

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023

bropines commented Mar 12, 2023

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023 •

edited

bropines commented Mar 12, 2023

bropines commented Mar 12, 2023

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023

drobotk commented Mar 13, 2023

rom1v commented Mar 14, 2023 •

edited

drobotk commented Mar 15, 2023 •

edited

rom1v commented Mar 16, 2023

bropines commented Mar 16, 2023 •

edited

yume-chan commented Mar 17, 2023

rom1v commented Mar 17, 2023

bropines commented Mar 17, 2023

rom1v commented Mar 17, 2023

rom1v commented Mar 17, 2023

rom1v commented Mar 17, 2023

Not work audio streaming on android 11 #3796

Not work audio streaming on android 11 #3796

Comments

bropines commented Mar 12, 2023 • edited

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023 • edited

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023

bropines commented Mar 12, 2023

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023 • edited

bropines commented Mar 12, 2023

bropines commented Mar 12, 2023

rom1v commented Mar 12, 2023

bropines commented Mar 12, 2023

drobotk commented Mar 13, 2023

rom1v commented Mar 14, 2023 • edited

drobotk commented Mar 15, 2023 • edited

rom1v commented Mar 16, 2023

bropines commented Mar 16, 2023 • edited

yume-chan commented Mar 17, 2023

rom1v commented Mar 17, 2023

bropines commented Mar 17, 2023

rom1v commented Mar 17, 2023

rom1v commented Mar 17, 2023

rom1v commented Mar 17, 2023

bropines commented Mar 12, 2023 •

edited

bropines commented Mar 12, 2023 •

edited

bropines commented Mar 12, 2023 •

edited

rom1v commented Mar 14, 2023 •

edited

drobotk commented Mar 15, 2023 •

edited

bropines commented Mar 16, 2023 •

edited