OBS crash: Buffer overflow detected

[theCalcaholic]

Description

After installing the StreamFX plugin, obs crashes with the following log output:

Attempted path: share/obs/obs-studio/locale/en-US.ini
Attempted path: /usr/share/obs/obs-studio/locale/en-US.ini
Attempted path: share/obs/obs-studio/locale.ini
Attempted path: /usr/share/obs/obs-studio/locale.ini
Attempted path: share/obs/obs-studio/themes/Dark.qss
Attempted path: /usr/share/obs/obs-studio/themes/Dark.qss
info: CPU Name: Intel(R) Core(TM) i7-8650U CPU @ 1.90GHz
info: CPU Speed: 3229.129MHz
info: Physical Cores: 4, Logical Cores: 8
info: Physical Memory: 31864MB Total, 19088MB Free
info: Kernel Version: Linux 5.3.0-7648-generic
info: Distribution: "Ubuntu" "18.04"
info: Portable mode: false
QMetaObject::connectSlotsByName: No matching signal for on_advAudioProps_clicked()
QMetaObject::connectSlotsByName: No matching signal for on_advAudioProps_destroyed()
QMetaObject::connectSlotsByName: No matching signal for on_program_customContextMenuRequested(QPoint)
info: OBS 0.0.1 (linux)
info: ---------------------------------
info: ---------------------------------
info: audio settings reset:
        samples per sec: 44100
        speakers:        2
info: ---------------------------------
info: Initializing OpenGL...
info: OpenGL version: 3.2.0 NVIDIA 440.59
info: ---------------------------------
info: video settings reset:
        base resolution:   1920x1080
        output resolution: 1920x1080
        downscale filter:  Bicubic
        fps:               30/1
        format:            NV12
info: Audio monitoring device:
        name: Default
        id: default
info: ---------------------------------
libDeckLinkAPI.so: cannot open shared object file: No such file or directory
info: No blackmagic support
info: NVENC supported
info: VLC found, VLC video source enabled
info: [StreamFX] Loading Version 0.8.0.0b3-c0ee969e
*** buffer overflow detected ***: obs terminated
Aborted (core dumped)

System Information

• Software Version: I tested with the gcc version of v0.8.0b3 from the GH releases as well as building myself from master (ref a26827f)
• Operating System: Ubuntu 18.04
• Kernel Version: 5.3.0
• CPU: Intel i7-8650U
• GPU: Intel Corporation UHD Graphics 620 / NVIDIA Corporation GP108M [GeForce MX150]
• RAM: 32GB

Note: I also tested the 'clang' version from the releases page, which failed with the error described in #155

[theCalcaholic]

I just noticed, that my hardware doesn't fullfill the minimum requirements for StreamFX. Closing the issue...

[Xaymar]

Your hardware is within the specs, at least if nothing else is also using that GPU. Did you have any filters or similar enabled at the time of testing?

[theCalcaholic]

I attempted to start OBS once again after deleting all sources (so I basically had an entirely empty scene).
Still with the same result.

Is there an easy way to rule out a graphics driver issue? As you might now, Nvidia Optimus on Linux is a pain in the ass :P

[skeletonbow]

Use the Upload Last Log feature in OBS Help menu, and post the URL here, that might help determine possible problems.

[theCalcaholic]

@skeletonbow I had a look at the log files. Unfortunately, there's even less information than in the startup output (stdout):

10:54:45.732: CPU Name: Intel(R) Core(TM) i7-8650U CPU @ 1.90GHz
10:54:45.732: CPU Speed: 1467.289MHz
10:54:45.732: Physical Cores: 4, Logical Cores: 8
10:54:45.732: Physical Memory: 31863MB Total, 12004MB Free
10:54:45.732: Kernel Version: Linux 5.3.0-7648-generic
10:54:45.732: Distribution: "Ubuntu" "18.04"
10:54:45.733: Portable mode: false
10:54:45.747: OBS 0.0.1 (linux)
10:54:45.747: ---------------------------------
10:54:45.748: ---------------------------------
10:54:45.748: audio settings reset:
10:54:45.748: 	samples per sec: 44100
10:54:45.748: 	speakers:        2
10:54:45.756: ---------------------------------
10:54:45.756: Initializing OpenGL...
10:54:45.786: OpenGL version: 4.5 (Core Profile) Mesa 19.2.8
10:54:45.796: ---------------------------------
10:54:45.796: video settings reset:
10:54:45.796: 	base resolution:   1920x1080
10:54:45.796: 	output resolution: 1920x1080
10:54:45.796: 	downscale filter:  Bicubic
10:54:45.796: 	fps:               30/1
10:54:45.796: 	format:            NV12
10:54:45.796: Audio monitoring device:
10:54:45.796: 	name: Default
10:54:45.796: 	id: default
10:54:45.796: ---------------------------------
10:54:45.805: No blackmagic support
10:54:45.826: NVENC supported
10:54:45.837: VLC found, VLC video source enabled
10:54:45.858: [StreamFX] Loading Version 0.8.0.0b3-c0ee969e

[Xaymar]

Does OBS not create crash logs on linux? On Windows it creates extensive crash logs that include a stack trace.

[theCalcaholic]

Sooo... I built StreamFX from source again (this time with obs-studio; previously I tried to build it as standalone) and that works.

Let me know if you plan to troubleshoot this further and if I can be of any assistance. If not, as far as I'm concerned, this ticket can be closed.

Thanks for your help, anyways :)

[Xaymar]

@theCalcaholic Which GCC version did you originally use? gcc8 is for 18.04, gcc9 is for 19.10 and beyond.

[theCalcaholic]

I was using gcc8

[Xaymar]

Does this still happen with the recent binaries?

[Xaymar]

Given the lack of a reply for more than 14 days, I assume this is no longer the case. Closing.