Support for Opus codec #133

ghost · 2017-02-04T11:24:50Z

Any plans? My .opus files are not recognized when scanning.

mherger · 2017-02-04T20:18:15Z

I'm sorry, no plans. Maybe you could ask Andy, author of the Audio::Scan module we're using:

https://github.com/andygrundman/Audio-Scan

andygrundman · 2017-02-05T10:39:48Z

I'll comment here to keep the discussion in one place. So, the good news is that adding Opus support to Audio::Scan would not be much work, probably about on the level of the work that was done for DSD support recently. There would be 4 bits of work needed in Audio::Scan:

Parse the info header. https://wiki.xiph.org/OggOpus#Packet_Organization
Parse the comments (tags). No extra work as the comments are Vorbis comments.
Seek offset calculation, which may or may not work just like in Ogg files.
Comprehensive test suite. Probably start with https://people.xiph.org/~greg/opus_testvectors/

After all this stuff, it's relatively easy to add to LMS as a new transcoded file format.

All that being said, can you explain your use case a bit? Are these your own encoded Opus files or are they from somewhere else? If they are your own, why do you prefer Opus over FLAC? I think Opus is great for things like low-latency voice chat, but I don't see a reason to use it for music. I'm not trying to discourage you, just pointing out that the chances of this getting worked on are pretty slim (no pun intended).

ghost · 2017-02-05T11:05:14Z

Thanks Andy, my case is pretty simple:
I encoded the files myself (on Windows) using the downloads from xiph.org.
I'm simply trying to get the best possible sound quality for a given bitrate (=Opus codec?), because I have a couple of (Rockbox-based) players with limits on the SDHC-card size - and they play Opus just fine.
I just bought a couple of cheap Raspberry Pi's where I use PiCorePlayer - I really like the combination, so
why not use the Opus files on the pi's, instead of having all my music duplicated using another codec?
And last, but not least: I'm 65, so lossless encoding is only used for archiving purposes :-)

mherger · 2017-02-22T04:39:35Z

FWIW: somebody seems to have patched Audio::Scan to support Opus: https://github.com/jrmuizel/AudioScan-opus/.

Somebody else further developed LMS support: http://forums.slimdevices.com/showthread.php?t=107011

ghost · 2017-02-22T08:32:19Z

Thanks a lot, I'll follow the discussion(s)

tschlotfeldt · 2017-03-11T13:17:06Z

Hi, just for the question "Why to support Opus?" Because it is the standard of the future. Opus will also be the standard of the broadcasting industry as all new hardware in this business will support Opus.

See this posting on the mozilla blog: https://hacks.mozilla.org/2012/09/its-opus-it-rocks-and-now-its-an-audio-codec-standard/

andygrundman · 2017-11-25T00:28:49Z

Reposting from the Audio-Scan issue, for the benefit of those watching this one:

After reviewing the existing Opus patch, I can't accept it. The samplerate is hardcoded to 48000 when the format definitely supports more than one samplerate. If anyone would like to continue work on Opus support, please fork this repo and do so via a pull request. I also can't stress enough that a proper set of tests is essential, with test files that cover the range of possible Opus encoding options.

my_hv_store( info, "samplerate", newSViv(48000) );
samplerate = 48000;

andygrundman · 2018-07-10T03:17:19Z

Hi guys, I changed my mind about Opus and merged Jeff's great patch into Audio-Scan 1.01. Hope this helps!

https://github.com/andygrundman/Audio-Scan
https://metacpan.org/release/Audio-Scan

ghost · 2018-07-14T19:01:19Z

I'm reopening this, now that Andy has been kind enough to take the initial, important step.

ghost · 2018-10-01T19:32:24Z

Any change of plans to support opus in LMS?

mherger · 2018-10-01T19:52:14Z

You should be able to build this for your own use pretty easily. Did you try to do so? Head over to Andy‘s repository to get the latest and greatest.

ghost · 2018-10-03T10:50:37Z

Thanks Michael, but I'm not into development - I'm a github user because I want to be able to report issues and make feature requests, I only use Linux on my tiny PCPs (normal desktop is Windows).

I realize that you do this in your spare time, that there are tons of real problems for you to deal with, and that implementing just another lossy codec doesn't exactly get top priority, so please close the issue with whatever code you find suitable.

mherger · 2018-10-05T06:15:10Z

Assuming PCP refers to piCorePlayer, you might want want to get in touch with @paul-1 and ask him whether an update would be possible. He's the guy behind LMS on pCP (and many more aspects of pCP).

paul-1 · 2018-10-05T12:53:20Z

Audio Scan is a pretty easy update. If we do update it, will LMS/Squeezelite handle playing OPUS files?

mherger · 2018-10-05T12:59:55Z

Good point!... There's a "patch" for LMS available in https://forums.slimdevices.com/showthread.php?107011.

paul-1 · 2018-10-05T16:31:40Z

The patch is going to be harder to deal with unless that's something you can merge into 7.9.2

Can you do module checks to enable the opus file type?

if Audio::Scan >= 1.01 then 'ops' => 'Slim::Formats::OggOpus',

mherger · 2018-10-05T19:38:48Z

I consider adding this to 7.9.2, as it's rather lightweight anyway. Would our recent sox builds support decoding Opus?

mherger · 2018-10-05T19:40:54Z

@grummisch - could you please provide a sample file?

paul-1 · 2018-10-06T03:21:27Z

libopus is available to be easily added, but I'm not sure the version of sox in LMS allows for extra codecs dynamically loaded. @ralph-irving?

ghost · 2018-10-06T08:16:38Z

Sample file:
take_your_finger_from_my_hair.zip
There you are - just a quick one, can easily supply more

ralph-irving · 2018-10-06T12:47:46Z

Yes, we would need to rebuild the sox binaries with opus support. I already have a modified buildme.sh to include opus support in sox, been using it since Roland0 posted the howto on the forum. Traveling ATM so can't attach it.

ralph-irving · 2018-10-09T15:37:17Z

I've created the branch https://github.com/piCorePlayer/slimserver-vendor/tree/soxopus containing the sox build script changes to include opus. @paul-1 would you test the buildme-pcp.sh script? I can rebuild the sox binaries for LMS over the next few days if the plan is to move forward with opus support.

paul-1 · 2018-10-09T16:59:42Z

Thanks Ralphy, now I’m traveling. I’ll be able to do it later in the week. @mherger. Any chance you can make the LMS mods for this? A separate test branch would make it easier for me to build a full test package.

mherger · 2018-10-10T04:44:20Z

@paul-1 I might be a bit busy this week, too. But I'd let you know. Thanks!

ralph-irving · 2018-10-10T15:15:16Z

As I build the sox-dsd-opus binaries I'm uploading them to https://sourceforge.net/projects/lmsclients/files/utility/sox-opus/20181010-9da8441/ I will post another update once complete.

paul-1 · 2018-10-12T03:05:11Z

I built the new sox, seemed to check out fine, it was able to read the opus sample file. As soon as LMS updates are made, will do a full test.

Will require an update to Audio::Scan >= 1.01 to work.

paul-1 · 2018-10-13T14:09:10Z

Works fine here.

paul-1 · 2018-10-13T19:33:11Z

I wasn't looking closely enough, infact tracks are missed. All tracks are found by the scanner, identified as Audio, but some of the tracks don't end up in the database. No errors are in the log.

paul-1 · 2018-10-14T16:15:53Z

@ralph-irving There is some info missing in the Metadata,

This is basically the first thing done after getting the tags from the file (Slim::Formats::Ogg)
return unless $info->{song_length_ms};

I wrote a quick program to pull the tags out (Using Audio::Scan), you can see that tag missing from the track that wasn't added. Not sure yet if it is the encoder, or Audio::Scan. Do you have a different MetaData reader?

Track: /mnt/data/Music/Carol King/Tapestry/009-WillYouLoveMeTomorrow.opus
ALLPICTURES => ARRAY(0xac7e70)
TITLE => Will You Love Me Tomorrow?
ENCODER => opusenc from opus-tools 0.2
VENDOR => libopus 1.2.1, libopusenc 0.2.1
DATE => 1971
TRACKNUMBER => 09
ENCODER_OPTIONS => --bitrate 192 --vbr --music
GENRE => Pop
ARTIST => Carole King
ALBUM => Tapestry (opus)
samplerate => 48000
version => 1
channels => 2
file_size => 6503669
audio_size => 6452652
bitrate_average => 204816
stereo => 1
audio_offset => 51017
jenkins_hash => 608158155
song_length_ms => 252036
serial_number => 1418794509
input_samplerate => 48000
preskip => 312

Track: /mnt/data/Music/Carol King/Tapestry/010-SmackwaterJack.opus
ALLPICTURES => ARRAY(0xac8248)
TITLE => Smackwater Jack
VENDOR => libopus 1.2.1, libopusenc 0.2.1
ENCODER => opusenc from opus-tools 0.2
TRACKNUMBER => 10
DATE => 1971
GENRE => Pop
ENCODER_OPTIONS => --bitrate 192 --vbr --music
ALBUM => Tapestry (opus)
ARTIST => Carole King
preskip => 312
serial_number => 1833061797
input_samplerate => 48000
jenkins_hash => 2860671313
audio_offset => 51017
stereo => 1
audio_size => 5549081
version => 1
channels => 2
file_size => 5600098
samplerate => 48000

andygrundman · 2018-10-14T16:34:05Z

It’s probably an Audio::Scan issue if that field is missing. I’ll take a look if you can send me those files.

ralph-irving · 2018-10-14T18:04:48Z

The opus encoder transfers the flac tags to the opus file automatically, but the length is not a flac tag.

@paul-1 I just have the opusinfo tool.
$ opusinfo 009-WillYouLoveMeTomorrow.opus
Processing file "009-WillYouLoveMeTomorrow.opus"...

New logical stream (#1, serial: 5491160d): type opus
Encoded with libopus 1.2.1, libopusenc 0.2.1
User comments section follows...
ENCODER=opusenc from opus-tools 0.2
METADATA_BLOCK_PICTURE=3|image/jpeg||500x500x24|<37268 bytes of image data>
ENCODER_OPTIONS=--bitrate 192 --vbr --music
ARTIST=Carole King
DATE=1971
GENRE=Pop
TITLE=Will You Love Me Tomorrow?
TRACKNUMBER=09
ALBUM=Tapestry (opus)
Opus stream 1:
Pre-skip: 312
Playback gain: 0 dB
Channels: 2
Original sample rate: 48000 Hz
Packet duration: 20.0ms (max), 20.0ms (avg), 20.0ms (min)
Page duration: 1000.0ms (max), 996.3ms (avg), 60.0ms (min)
Total data length: 6503669 bytes (overhead: 1.34%)
Playback length: 4m:12.036s
Average bitrate: 206.4 kbit/s, w/o overhead: 203.7 kbit/s
Logical stream 1 ended

$ opusinfo 010-SmackwaterJack.opus
Processing file "010-SmackwaterJack.opus"...

New logical stream (#1, serial: 6d424da5): type opus
Encoded with libopus 1.2.1, libopusenc 0.2.1
User comments section follows...
ENCODER=opusenc from opus-tools 0.2
METADATA_BLOCK_PICTURE=3|image/jpeg||500x500x24|<37268 bytes of image data>
ENCODER_OPTIONS=--bitrate 192 --vbr --music
ARTIST=Carole King
DATE=1971
GENRE=Pop
TITLE=Smackwater Jack
TRACKNUMBER=10
ALBUM=Tapestry (opus)
Opus stream 1:
Pre-skip: 312
Playback gain: 0 dB
Channels: 2
Original sample rate: 48000 Hz
Packet duration: 20.0ms (max), 20.0ms (avg), 20.0ms (min)
Page duration: 1000.0ms (max), 999.7ms (avg), 940.0ms (min)
Total data length: 5600098 bytes (overhead: 1.46%)
Playback length: 3m:41.916s
Average bitrate: 201.9 kbit/s, w/o overhead: 198.9 kbit/s
Logical stream 1 ended

andygrundman · 2018-10-14T18:59:55Z

Thanks, this is definitely an issue with Audio::Scan, it doesn't always parse the Ogg packets properly. Specifically, final_serialno is sometimes read from the wrong point in a packet which causes the duration to not be set. I'll see if I can figure it out.

paul-1 · 2018-10-15T00:12:02Z

A rainy day here, so I played with the code..... There is a problem with the buffer logic, where the opus.c seeks to the end of the file, and then steps backwards through the file to find the last packet header. I started to go cross-eyed looking at the code, so I just increased the buffer so that it "should" be large enough to find the last header.

This takes care of the test files not reading.......but obviously is just a band-aid.

 diff Audio-Scan-1.01/src/opus.c opus.c
254c254
<   DEBUG_TRACE("Buffer clear");
---
>   DEBUG_TRACE("Buffer clear\n");
267c267
< #define BUF_SIZE 8500 // from vlc
---
> #define BUF_SIZE 17000 // from vlc

andygrundman · 2018-10-16T01:15:37Z

I checked in a minimalist fix, the root cause was simply that the buffer was not being cleared when seeking further back into the file. I left the buffer size at 8500 because it helps test the seek code, but I don't know where this number came from. Looking at the opusfile library, 64K seems to be the right value to use, because there is no blocksize hint as there is in Vorbis.

I still want to do some more cleanup work on this, but hopefully it will be able to scan all your files now.

paul-1 · 2018-10-16T02:15:33Z

1.02 Looks good on my end.

* add binaries for macOS 64-bit * disable native Opus streaming * add strings for the File Formats settings * require Audio::Scan 1.02

michaelherger · 2018-10-16T08:40:48Z

Thanks a lot all of you guys! I merged the necessary changes to public/7.9.

Binaries remain to be added/updated. I only added macOS binaries so far. Will add more when needed and available :-).

mherger · 2018-10-16T08:42:15Z

BTW: this was one of the nicest LMS collaborations I've seen in a while, from contributors old and new ;-)

ralph-irving · 2018-10-16T14:33:13Z

@michaelherger I uploaded a zip with all the sox-opus-binaries to the picoreplayer dropbox share a few days ago and submitted the PR for the sox opus source changes.

paul-1 · 2018-10-17T00:23:37Z

@grummisch The pCP binary package has been updated.

Assuming your running pCP 4.0.0......first thing, do a nightly update on LMS. Then on the pCP web page, on the LMS tab, there is a button to "Update Libs"

After all the updates are done, you should be good with your opus files. If you have problems, please respond in the pCP support thread. https://forums.slimdevices.com/showthread.php?109404-ANNOUNCE-piCorePlayer-4-0-0

ghost · 2018-10-18T14:06:17Z

I'm on pCP 4.0.0 - unfortunately I'm stuck already on the nightly update:

Only place I could find the words nightly update was on the pCP web page, on the LMS tab;
I press the Nightly Update button - result:

No Update file was found, Please check LMS Server configuration.
Click Configure Below.
Then go to Advanced Tab, Software Updates Dropdown Box.
Make sure Automatic Updates and Frequency are set to your needs, or Check for Updates Manually.

My Software Updates settings:
Don't check for software updates, Do not automatically download updates

Clicking the Check for updates now button:

A new version of Logitech Media Server is available (7.9.0). Click here to download.

When the link is clicked:

New tab named Index of /LogitechMediaServer_v7.9.1 opens
Some LogitechMediaServer-7.9.1* files are shown, all dated 17-Apr-2018

I assume I'm in the wrong place, and go no further...

Sorry about the fuss, normally I only do pCP release updates...

michaelherger · 2018-10-18T14:12:12Z

Did you try this procedure? https://www.picoreplayer.org/how_to_upgrade_lms.shtml

ghost · 2018-10-18T15:09:24Z

NO!
After that hint everything progressed fine.
I can only second your remark about collaboration, it has been amazing to be at sideline and watch all you good folks work together on this - thank you all!

mherger · 2018-10-18T15:11:23Z

@grummisch good to hear you're all set!

@paul-1 I think there's a problem right now for people who want to install LMS on pCP without the manual procedure. There's been a report in the forum, too (http://forums.slimdevices.com/showthread.php?t=109613)

paul-1 · 2018-10-18T15:29:22Z

Why would lms require the new audio scan? On pcp they will have to update the binaries separately.

…

Sent from my iPhone On Oct 18, 2018, at 11:11 AM, Michael Herger <notifications@github.com<mailto:notifications@github.com>> wrote: @grummisch<https://github.com/grummisch> good to hear you're all set! @paul-1<https://github.com/paul-1> I think there's a problem right now for people who want to install LMS on pCP without the manual procedure. There's been a report in the forum, too (http://forums.slimdevices.com/showthread.php?t=109613) — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#133 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AGLG8d0lTrJxwvN3ENBxDTLAsvmOryzRks5umJokgaJpZM4L3IBr>.

michaelherger · 2018-10-18T16:01:39Z

The problem is the Audio/Scan.pm included with LMS is expecting 0.93. But the binary LMS finds is 1.02. You'd have to include the Perl part with your bundle and put it in the arch specific folder. This way it takes precedence over the one included with LMS.

paul-1 · 2018-10-18T17:50:38Z

I do have Scan.pm included in the new binary package

…

Sent from my phone

________________________________ From: michaelherger <notifications@github.com> Sent: Thursday, October 18, 2018 12:02 PM To: Logitech/slimserver Cc: paul-1; Mention Subject: Re: [Logitech/slimserver] Support for Opus codec (#133) The problem is the Audio/Scan.pm included with LMS is expecting 0.93. But the binary LMS finds is 1.02. You'd have to include the Perl part with your bundle and put it in the arch specific folder. This way it takes precedence over the one included with LMS. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#133 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AGLG8SAsxx3FQG9DHItxovrdhY6gIIeLks5umKX-gaJpZM4L3IBr>.

ghost · 2018-10-22T10:12:33Z

Would it be possible to also provide an opusdec binary until squeezelite gets Opus support?
(See https://code.google.com/archive/p/squeezelite/issues/74 - waiting for Opus support in LMS)
Reason: limit network traffic on my minimalist setup of pi-zero Ws connected by WLAN

ralph-irving · 2018-10-22T11:42:30Z

The sox binaries included with the latest LMS 7.9.2 already have support for decoding opus streams. There are no plans to add opus support to squeezelite. Not sure why you're referencing squeezelite on googlecode. Current development for squeezelite is on github https://github.com/ralph-irving/squeezelite

ghost · 2018-10-22T13:35:43Z

I know decoding is supported, but FLAC uses more network bandwith than Opus, and I suppose the LMS server itself is loaded more because of the Opus->FLAC conversion(s). I'm aware that the players then probably have a much easier task decoding FLAC instead of Opus.
No Opus support plans for Squeezelite: then I'd really like an opusdec binary to be provided - it surely must have been built during the testing.
Sorry about the Squeezelite homepage fuzz, should have spent more time searching.

mherger · 2018-10-22T13:41:24Z

With all due respect: get a Pi3b and you're all set. We've gone a long way already to implement this rather exotic request. Let's not over-optimize either.

domcote · 2022-06-25T11:39:27Z

Hi folks, sorry to post this to the developer forum, but I'm not getting any resonance on the user forum: https://forums.slimdevices.com/showthread.php?107011-Howto-play-Ogg-Opus-files/page4

My main questions / challenges:
1.) The majority of my opus files don't get picked up by the scanner. They appear to be simply ignored. (see thread and log extract on slimdevices)
2.) On files that do scan, Replay Gain tags are ignored. (I can potentially work around this. 1.) is more urgent)

I tend to agree with ghost tbh, opus is one of the best (ie quality for bandwidth) and most future proof lossless audio codecs around and it is the new internet standard. I'd love to see LMS include fully functional support for it.
(transcoding from opus to FLAC seems to work great on my setup, btw)

pls lmk how I can support troubleshooting. Glad to help.

ralph-irving · 2024-05-10T17:36:12Z

From the Audio::Scan perl module version 1.08 or newer has improved ogg/opus scanning support, but not all platforms include the latest release, which is actually 1.10. See https://github.com/LMS-Community/Audio-Scan

barolo · 2024-05-10T17:58:24Z

From the Audio::Scan perl module version 1.08 or newer has improved ogg/opus scanning support, but not all platforms include the latest release, which is actually 1.10. See https://github.com/LMS-Community/Audio-Scan

Yeah, I've deleted my comment shortly after posting it. The issue was with sox not being installed.

andygrundman mentioned this issue Feb 5, 2017

Opus codec support andygrundman/Audio-Scan#1

Closed

ghost closed this as completed Feb 7, 2017

ghost reopened this Jul 14, 2018

mherger added a commit that referenced this issue Oct 12, 2018

#133 Add support for Opus codec

1852286

Will require an update to Audio::Scan >= 1.01 to work.

mherger added a commit that referenced this issue Oct 16, 2018

#133 Add Opus support

bc1e2d5

* add binaries for macOS 64-bit * disable native Opus streaming * add strings for the File Formats settings * require Audio::Scan 1.02

mherger closed this as completed Oct 16, 2018

mherger added a commit that referenced this issue Oct 16, 2018

#133 add more updated sox binaries - thanks @ralph-irving

696836f

Support for Opus codec #133

Support for Opus codec #133

Comments

ghost commented Feb 4, 2017

mherger commented Feb 4, 2017

andygrundman commented Feb 5, 2017

ghost commented Feb 5, 2017

mherger commented Feb 22, 2017

ghost commented Feb 22, 2017

tschlotfeldt commented Mar 11, 2017

andygrundman commented Nov 25, 2017 • edited Loading

andygrundman commented Jul 10, 2018

ghost commented Jul 14, 2018

ghost commented Oct 1, 2018

mherger commented Oct 1, 2018

ghost commented Oct 3, 2018

mherger commented Oct 5, 2018 • edited Loading

paul-1 commented Oct 5, 2018

mherger commented Oct 5, 2018

paul-1 commented Oct 5, 2018

mherger commented Oct 5, 2018

mherger commented Oct 5, 2018

paul-1 commented Oct 6, 2018

ghost commented Oct 6, 2018

ralph-irving commented Oct 6, 2018

ralph-irving commented Oct 9, 2018 • edited Loading

paul-1 commented Oct 9, 2018

mherger commented Oct 10, 2018 • edited Loading

ralph-irving commented Oct 10, 2018

paul-1 commented Oct 12, 2018

paul-1 commented Oct 13, 2018

paul-1 commented Oct 13, 2018

paul-1 commented Oct 14, 2018 • edited Loading

andygrundman commented Oct 14, 2018

ralph-irving commented Oct 14, 2018 • edited Loading

andygrundman commented Oct 14, 2018

paul-1 commented Oct 15, 2018

andygrundman commented Oct 16, 2018

paul-1 commented Oct 16, 2018

michaelherger commented Oct 16, 2018

mherger commented Oct 16, 2018

ralph-irving commented Oct 16, 2018

paul-1 commented Oct 17, 2018

ghost commented Oct 18, 2018

michaelherger commented Oct 18, 2018

ghost commented Oct 18, 2018

mherger commented Oct 18, 2018

paul-1 commented Oct 18, 2018 via email

michaelherger commented Oct 18, 2018

paul-1 commented Oct 18, 2018 via email

ghost commented Oct 22, 2018

ralph-irving commented Oct 22, 2018

ghost commented Oct 22, 2018

mherger commented Oct 22, 2018

domcote commented Jun 25, 2022 • edited Loading

ralph-irving commented May 10, 2024

barolo commented May 10, 2024

andygrundman commented Nov 25, 2017 •

edited

Loading

mherger commented Oct 5, 2018 •

edited

Loading

ralph-irving commented Oct 9, 2018 •

edited

Loading

mherger commented Oct 10, 2018 •

edited

Loading

paul-1 commented Oct 14, 2018 •

edited

Loading

ralph-irving commented Oct 14, 2018 •

edited

Loading

domcote commented Jun 25, 2022 •

edited

Loading