Skip to content
This repository has been archived by the owner on Oct 24, 2021. It is now read-only.

Feature request: Audio through DS4 headphone jack #17

Open
H3mul opened this issue Mar 24, 2015 · 224 comments
Open

Feature request: Audio through DS4 headphone jack #17

H3mul opened this issue Mar 24, 2015 · 224 comments

Comments

@H3mul
Copy link

H3mul commented Mar 24, 2015

Please considering working in this direction at some point, if it is at all possible. Would be incredibly useful, especially over Bluetooth.

@PTF-PeterFlynn
Copy link

Seconded. This would be an excellent feature.

@DerekTurtleRoe
Copy link

I hate to tell you, but I'm not sure it's possible since the DS4 audio is handled by the PS4 mostly (from what reverse-engineered data we have found so far). Either that, or it is handled through Bluetooth, and that would be very difficult since Bluetooth sucks for bandwidth.

It would be kind of silly too, since all computers have a 3.5mm headphone jack on them. Even if you wanted to use the controller from far away, there are wireless headsets too.

I don't know, I'd have to do more research and capture more packets from the DS4...

@H3mul
Copy link
Author

H3mul commented Apr 20, 2015

Well, the PS4 clearly doesn't have bandwidth issues with using the DS4 bluetooth for both audio input/output streaming and controller events, according to user reviews (I dont own a PS4 myself).

As for reverse engineering, I found this: http://eleccelerator.com/wiki/index.php?title=DualShock_4
In the Bluetooth section, its mentioned that the controller advertises two devices, and uses one for audio. Hope this helps.

@Jays2Kings
Copy link
Owner

As vgturtle said, audio data is handled completely differently, and I don't have the tools to reverse engineer how it works. I can't say by myself that this feature will ever be added.

@H3mul
Copy link
Author

H3mul commented Apr 20, 2015

Thanks for considering it anyway

@DerekTurtleRoe
Copy link

@HeMu1 When I was talking about bandwidth, I was talking about the PC handling all of it, and that Windows Bluetooth stack doesn't really like that. The PS4 Bluetooth may be custom made, and be able to handle that while a PC might not.

Emulating two devices is tricky, especially with audio in the mix. You would have to dynamically analyze, convert, send, and receive audio data if it were to work just like the PS4.

With all that said, I have been looking at the controller dumps that people have made and I am currently trying to see if I can find out where audio is data is sent/kept/received/whatever.

This is all done in my free time though, which at this point in my life is very limited. But I am working on it.

@buzzcut2k15
Copy link

+1

This feature would be awesome and add to those reasons for using a PS4 controller with a PC - and supporting software :)

I would certainly pay for this feature if it meant that I had one less wire to worry about..

Here's to hoping that this feature gains traction..

@DerekTurtleRoe
Copy link

I can't seem to access the audio at all through my PC, it seems like the PS4 OS and drivers probably handle all that work. The Bluetooth seems standard, but the audio doesn't show up at all. I have tried everything I can think of.

Does anybody have any Bluetooth sniffers or anything?

@OscBacon
Copy link

Hi vgturtle127,
I know that Wireshark allows you to sniff many different Bluetooth profiles : https://www.wireshark.org/docs/dfref/#section_b
I would really enjoy it if there was a way to use the speaker on the DS4 and the earphone jack.
I don't know much about sniffing and what exactly would be needed to do this and help you, but if this could help further advance the development of these features and you are willing to; please tell us exactly what is needed.

@DerekTurtleRoe
Copy link

Wireshark allows you to sniff compatible wireless adapters. I would need to get a compatible device, something like this:

https://www.cacetech.com/products/catalog/product_info.php?products_id=69

I have controllers, so all I would need is a Bluetooth sniffer and some time and patience. I have confidence I could figure something out, or at least get some idea of what is happening. I could probably at least dump some stuff that would help people figure it out.

Some information has been gathered, but most of it was through USB or reverse-engineering, I believe.

http://eleccelerator.com/wiki/index.php?title=DualShock_4

Here is some good info, but nothing that helps us at the moment...

@OscBacon
Copy link

What about using a rooted android device instead?
On Nov 12, 2015 04:20, "vgturtle127" notifications@github.com wrote:

Wireshark allows you to sniff compatible wireless adapters. I would need
to get a compatible device, something like this:

https://www.cacetech.com/products/catalog/product_info.php?products_id=69

I have controllers, so all I would need is a Bluetooth sniffer and some
time and patience. I have confidence I could figure something out, or at
least get some idea of what is happening. I could probably at least dump
some stuff that would help people figure it out.

Some information has been gathered, but most of it was through USB or
reverse-engineering, I believe.


Reply to this email directly or view it on GitHub
#17 (comment)
.

@DerekTurtleRoe
Copy link

I'm not sure if that would work or not, but unfortunately I don't have an Android device to test. 😞

@kevinrodriguez-io
Copy link

What's the thing with the android device?
Why is it needed?

@DerekTurtleRoe
Copy link

It's not "needed". He was saying I could use an Android device as a Bluetooth sniffer.

@Anoneom
Copy link

Anoneom commented Nov 23, 2015

I dont know if it's like that for everybody but i sometimes get the audiodevice listed as one that i would be able to connect to in my bluetooth settings on Win 10. I havent figured out when the device appears but i can try to reproduce it if someone thinks it would help. I have of course tried pairing with it without success.

@DerekTurtleRoe
Copy link

Can you upload a screenshot here? That seems interesting. I would also like to know what Bluetooth stack and chipset you are using.

@Anoneom
Copy link

Anoneom commented Nov 25, 2015

I don't know exactly how i did it but I'm messing around with it trying to get it to happen again :P could you ELI5 how to best give you info on stack and stuff, cause I'm a noob :) I know for sure that the audio device was from the DS4 though because i live far from people and it appeared and disappeared when i turned on and off controller :)

@DerekTurtleRoe
Copy link

Well, what bluetooth adapter are you using? Are you using a USB dongle or built-in bluetooth?

@jspinella
Copy link

I think Anoneom is talking about this, I was able to see two devices when attempting to pair the Dualshock 4 (and yes, this second audio device only appeared when the DS4 was on):

capture

capture2

Like Anoneom, I can't get it to pair. I'm on Windows 10 via Bootcamp on a 2015 15" MacBook Pro.

@DerekTurtleRoe
Copy link

Is RECAM4AZJX02485 the device that comes up?

I can't find any information on the MacBook Bluetooth chipset or anything. 😞

If you could check the device manager and give me any information pertaining to the Bluetooth device that would be great.

@jspinella
Copy link

Yes, RECA is the device that pops up along with the PS4 controller ("Wireless Controller"). You're not able to see it on your setup? You may have to be on Windows 10, or maybe you need an adapter with Bluetooth 4.0+ (since it offers increased bandwidth that may be necessary for carrying audio AND controller AND light bar data)... In any event, this is with a Broadcom BCM943602CS (AC WiFi, Bluetooth 4.1).

https://wikidevi.com/wiki/Broadcom_BCM943602CS

capture3

Let me know if I can be of further help!

@DerekTurtleRoe
Copy link

I am on Windows 10, I just don't have any Bluetooth adapters or anything. I always use USB when I use my PS4 controller. 😄

Thanks for the information!

We definitely need Bluetooth 4.0, since that is what the PS4 has. The PS4 may use WiFi Direct or something for the light bar and audio data, or some proprietary equivalent. I kind of hope not since that would be much harder to sniff, but if I know Sony that spend a lot of time on security for stuff that doesn't really need it. 😃

Now if we could only connect or sniff the traffic that was passed along by the PS4. I really need to get a Bluetooth sniffer, I am getting more interested since it appears we may be able to connect to it from within Windows...

@jspinella
Copy link

I doubt the Dualshock 4 uses WiFi, I think it only has a Bluetooth radio, though admittedly good teardown information IDing the ICs is lacking on the Internet, but this might be useful:

http://mygaming.co.za/news/wp-content/uploads/2013/11/DualShock-4-PCB-bottom.png

The audio codec is on the controller's PCB, so audio processing is done on the controller, NOT on the PS4. This is good news (if you didn't have this information already).

A Bluetooth 4.0 USB adapter can be had for ~$15, and the BlueFruit Bluetooth 4.0 sniffer runs about $30, though Wireshark may work with one of those $15 adapters... You probably know more about that than I do. Anyway, is it a question of money? I'm a little surprised you don't have Bluetooth on your computer!

@DerekTurtleRoe
Copy link

@jamesspinella Good find about the audio IC! I had no idea based on previous tear downs!

I knew it didn't have WiFi, I just didn't know if it had some weird proprietary wireless communications stuff going on, this seems increasingly likely.

I could get a low cost adapter and try it, and then I would also have the benefit of having Bluetooth on my PC. However, that Bluetooth sniffer is for Bluetooth LE, not regular Bluetooth devices. 😞

Wireshark actually works on most devices, at least as far as I have tested. However, I can never install WinPCap, so I can never run Wireshark. I have been meaning to go report the bug...

It is only sort of a question of money, I was recently laid off and don't have any spending money. Bluetooth adapters aren't expensive, but if I do get one, I want one that supports as many versions of Bluetooth as I can. I'm OK with paying if it means I get quality.

I understand your surprise, I figured most motherboards would have support by now. Mine was a budget board, and so was my wireless adapter. So no Bluetooth for me! 😝

@jspinella
Copy link

I have a spare Bluetooth USB adapter, but it's Bluetooth 2.1, so I doubt that would work for you... But is there anything else I can do to help with this effort? (FYI I don't actually have a PS4 anymore)

@DerekTurtleRoe
Copy link

I will probably get this:

http://www.amazon.com/Plugable-Bluetooth-Adapter-Raspberry-Compatible/dp/B009ZIILLI/ref=sr_1_8?ie=UTF8&qid=1448850789&sr=8-8&keywords=bluetooth+usb+adapter

Either that, or something from Adafruit.

Who makes the spare adapter you have?

@jspinella
Copy link

Ah, that sounds like a solid choice. I have a Targus dongle (http://targus.com/us/usb-bluetooth-adapter), but again, it's Bluetooth 2.1 (+EDR!).

@DerekTurtleRoe
Copy link

@jamesspinella Actually, I may pick that one up too, since I don't know if I can do EDR on a Bluetooth 4.0 adapter.

@jspinella
Copy link

EDR just means enhanced data rate, it allowed for faster link speeds versus 2.0, and so technically is "included" in any Bluetooth 3.0 and 4.0 device. Kind of like MIMO, only some Wireless "G" devices have it, but anything N and newer has it.

@DerekTurtleRoe
Copy link

@jamesspinella Oh, OK. Good to know. Thanks, James! Bluetooth isn't my favorite thing in the world, if you couldn't tell. 😄

@DerekTurtleRoe
Copy link

@BOBCAMO
More info is always fine, but you can more or less do anything you want with the new wireless adapter, so I'm not going to worry about working on new stuff for DS4Windows.

Thanks, though. 😄

@terranovafe
Copy link

So I am kinda confused. Is audio working wireless with the use of the official sony ds4 dongle or not?
Can I listen to gaming audio or not ? Btw if yes is the quality good or not ?

I need to know asap please.

Same question if anyone knows if it is working in linux ?

@s-kostyuk
Copy link

@terranovafe looks like that audio IS supported, but ONLY via an official DS4 adapter: http://www.pcgamer.com/ds4windows-now-supports-sonys-official-bluetooth-adapter/

@s-kostyuk
Copy link

@terranovafe and about linux support: chrippa/ds4drv#76

@BOBCAMO
Copy link

BOBCAMO commented Jul 13, 2017

@vgturtle127 yeah, was thinking about trying to get one but no money to do so lol. also, your welcome :-)

@terranovafe Yes it does work on the Sony DS4 USB Dongle as @s-kostyuk linked to us. Quality? don't know but if i ever get one i will make sure to let ya know. you'll probably get it before i do lol. But i did read about that shortly before i first posted on here and Bluetooth can supposedly support High quality 7.1 if not better through it.(never tried, looked into it nor cared due to price lol.) supposedly on the PS4(don't have one) it's apparently better for some people using the DS4 controller's 3.5mm Jack than anything else. but haven't heard anything about how the quality is on PC with the DS4 Dongle except the couple video's i found before getting on here which.... didn't seem like they tried to test it. but from what i know, you will definitely be only using Stereo with it being a 3.5mm jack, unless you have some kind of a adapter for virtual or actual surround sound. i believe(could be wrong) you can use 3.5mm headsets(meaning with any inline mic e.g. RIG400HS) and everything is suppose to work. sorry if it's not actual info, but there might be some video's up right now with testings of the DS4 Dongle.

Added Note for anyone who uses steam and/or mainly uses it and would like to use your PS4/DS4 controller. Steam seems to fully support and utilize it VERY well(3.5mm jack being the only exception). didn't know about it til a while after looking stuff up and why i got a PS4 controller. but gotta go into big picture mode for some of it, especially first time use. i do switch between steam and DS4windows for controlling my DS4 depending on the game.

@sonicpo781
Copy link

H just so u know I just bought a DS4v2 controller. I plugged it into my computer and it came up with headset earphone (Wireless controller) and I immediately plugged in my earphones to my controller and it worked even without the dongle it worked and I don’t even have any software

@s-kostyuk
Copy link

s-kostyuk commented Jul 29, 2017

@sonicpo781 I found this feature too. Both Linux and Windows OS's successfully discovered gamepad as a gamepad itself and headset (stereo speakers + microphone) and it works just fine. The only problem is that wired connection is needed (via Micro-USB cable). And there is no support of headset via wireless Bluetooth connection, at least for now.

P.S. DS4v2 controller was tested

@BOBCAMO
Copy link

BOBCAMO commented Jul 29, 2017

huh, what versions of windows? or does it matter?
if it doesn't matter then it seems they may have implemented it to be more plug and play. mine is only a version 1 but there has been times when i try to re-pair it or even reset it then pair it i will notice the audio device come up then shortly after replaced by the controller.
But wouldn't surprise me since i'm finding out more and more steam user's are choosing DS4 for their controller.

And there is no support of headset via wireless Bluetooth connection

Yeah, since they went ahead and already made the USB dongle for it they stopped their so if you do want BT usage of the same you gotta spend more lol. ah... god gaming has gone down hill...

@s-kostyuk
Copy link

s-kostyuk commented Jul 29, 2017

@BOBCAMO mine is Windows 10 with latest updates. Steam is installed too. But, as was said, headset is recognized only if gamepad is connected by Micro-USB cable

@BOBCAMO
Copy link

BOBCAMO commented Jul 29, 2017

@s-kostyuk
Ah ok, yeah must be something they implemented in the new versions then because mine doesn't do that. it has been able to be used with just plugging it in as a controller but depends on what i'm using at that point. then again, i was thinking it might have been a windows 10 thing but you said the same things work on linux so that kinda throws that thought out the window lol.
Thanks for the update and notification guy's. those who would want to use this will now know.

For me though, only using it as a controller and... when i got mine brand new and messed with other's controller's... usb only is kind of a no-go due to it always feeling like the port was made broken... all of them i've tried feels overly wiggly and like it was plugged in and then stepped on... so i try to ONLY use USB to correct an error of what ever or to charge. other wise to try and keep the USB port in as best condition as i can i only use it through BT.
Sorry, just pointing things out that i've noticed lol.

@sonicpo781
Copy link

sonicpo781 commented Aug 2, 2017 via email

@sonicpo781
Copy link

sonicpo781 commented Aug 2, 2017 via email

@DS4FW
Copy link

DS4FW commented Dec 8, 2017

Dumped DS4 firmware, might be of use to someone
https://mega.nz/#!gXw2HL4Q!0eLiPdOLm4z9UlGuMMcHg7ZLIrOqykwTQNTakqt99So

@DerekTurtleRoe
Copy link

DerekTurtleRoe commented Dec 9, 2017

@DS4FW Cool, thanks! I will take a look. Do you know anything about the firmware? Like who developed it, or anything?

EDIT: Nevermind, Sony is all over it.

@quenbyako
Copy link

quenbyako commented Jan 27, 2019

Guys, i don't know, may be you made this feature instead, but:

I working on linux (ubuntun 16.04), and when i connecting my ds4, i see 1 bluetooth device (wireless controller, who knows 😉), but 2 gamepads in devices, first is legacy xbox gamepad, second is position and acceleration controller.

I think, that may beeee (only may be) ds4 is not only 2 gamepads in one device, but wireless speaker too. Thinking, it cause ps4 based on bsd, so linux get all devices correctly without any additional software. If this issue still related, i can test this theory on my linux laptop 🤔🤔🤔

@AllanPinheiroDeLima
Copy link

I'm confused. This thread is still alive ? Because, when connecting via cable I do have audio working natively. On Windows it just popped out as two devices. One for audio and one for controller.

Anyway, I know that most we talking about is about bluetooth, but if processing is made through the controller, maybe looking at windows drivers/dll's may give an idea about how audio is handled outside.

I mean,if windows only sends RAW data to the controller, would be possible to make the hardware receive raw sound data through bluetooth and see what happens, even if it is for testing purposes

If there is something I can do to help, let me know

@hamzaavvan
Copy link

Hey @vgturtle127 if you need any help regarding this issue, I'll love to do it

@Okami3814
Copy link

Would it be possible to at least integrate Ds4 with the ps4 bt adapter, the one sony sells. I have one but i cannot get controller input together with sound, and when i manage to get audio to work with that native adapter, it's cut off when i try to use DS4

@DerekTurtleRoe
Copy link

Windows has better support for the PS4 controller natively now since Steam supports it and the PS4 controller is supported by games as well.

@hamzaavvan I appreciate it, like I said I may come back to this at some point, but life has made me very busy. I haven't even logged into this account for months. 😢

@Muhlawor
Copy link

Muhlawor commented Feb 13, 2020

I'm confused. This thread is still alive ? Because, when connecting via cable I do have audio working natively. On Windows it just popped out as two devices. One for audio and one for controller.

Only works with v2 version, the original doesn't show up.

@hamzaavvan
Copy link

Windows has better support for the PS4 controller natively now since Steam supports it and the PS4 controller is supported by games as well.

@hamzaavvan I appreciate it, like I said I may come back to this at some point, but life has made me very busy. I haven't even logged into this account for months. 😢

@vgturtle127 I can understand

@haywirephoenix
Copy link

Ryochan7#1268

@merelyigor
Copy link

topic live)

@makeway4pK
Copy link

Haven't you guys seen this yet?: https://www.psdevwiki.com/ps4/DS4-BT

This page seems to detail everything about the packet formats received/transmitted by the DS4 and yes, it lists it as a gamepad and audio device separately (see Class of Device).
Bluetooth packet data formats are also detailed very well.

I even came across a section 0x14 marked 'Contains sound', apparently uses SBC codec to encode audio.

SBC never gave me lag-less audio on smartphone games but if the DS4 is operating at a higher baud rate than BT headphones, near instant audio might be possible on the DS4 making it even more valuable than a dedicated BT headphone

@xillmera
Copy link

xillmera commented May 22, 2021

@vgturtle127
Hello, I’ve found this paper about this problem helpful. If u r need (engl)translate - I can make it. Text about reversingeneering of captued sound packages from DualShock 4 and description of information composition in it. It’s material, like I can see, directly for this problem.

@DerekTurtleRoe
Copy link

@xillmera Thanks for that, I'll take a look at it. Most of that information is available via the PS4 dev wiki and other links already posted though.

@mirh
Copy link

mirh commented May 22, 2021

That's indeed a link that was already posted in this very thread

@mika-n
Copy link

mika-n commented May 27, 2021

#654

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests