Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ASR] snips-asr Crashes at Startup (Kaldi -> ParseOptions -> Read?) #156

Closed
zaripych opened this issue Jun 25, 2019 · 9 comments

Comments

@zaripych
Copy link

commented Jun 25, 2019

What's the issue?
snips-asr process crash at the start, intermittent

I'm running Snips in a Docker container, which I know is not officially supported, so maybe the crash is specific to Docker environment. I will try this without Docker container and see if I can reproduce the crash.

The issue seems to be intermittent and happens only on startup. Once started, the service doesn't seem to crash until next restart.

Use Cases Impacted
ASR

How to reproduce
Can provide you with a Docker container image and a Dockerfile.

Expected behavior
Should not crash, should report an error if there are configuration issues.

Version and Environment
Docker, Linux x64.

# docker exec snips apt list --installed | grep snips

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

snips-asr/unknown,now 0.63.2 amd64 [installed,automatic]
snips-audio-server/unknown,now 0.63.2 amd64 [installed,automatic]
snips-dialogue/unknown,now 0.63.2 amd64 [installed,automatic]
snips-hotword/unknown,now 0.63.2 amd64 [installed,automatic]
snips-injection/unknown,now 0.63.2 amd64 [installed,automatic]
snips-kaldi-atlas/unknown,now 0.24.2 amd64 [installed,automatic]
snips-nlu/unknown,now 0.63.2 amd64 [installed,automatic]
snips-platform-common/unknown,now 0.63.2 amd64 [installed,automatic]
snips-platform-demo/unknown,now 0.63.2 amd64 [installed]
snips-platform-voice/unknown,now 0.63.2 amd64 [installed]
snips-skill-server/unknown,now 0.63.2 amd64 [installed]
snips-template/unknown,now 0.63.2 amd64 [installed]
snips-tts/unknown,now 0.63.2 amd64 [installed]
snips-watch/unknown,now 0.63.2 amd64 [installed]

Logs

DEBUG:snips_common_cli::cli: conf lookup: snips-asr.assistant -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.assistant -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.model -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.model -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.beam_size -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.beam_size -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.max_active -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.max_active -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.min_active -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.min_active -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.lattice_beam_size -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.lattice_beam_size -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.acoustic_scale -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.acoustic_scale -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.use_final_probs -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.use_final_probs -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.endpointing -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.endpointing -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.partial -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.partial -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.partial_period_ms -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.partial_period_ms -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.no_snips_audio_server_replay -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.no_snips_audio_server_replay -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.bus -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.bus -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.mqtt -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.mqtt -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.mqtt_username -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.mqtt_username -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.mqtt_password -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.mqtt_password -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.mqtt_tls_hostname -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.mqtt_tls_hostname -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.user_dir -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.user_dir -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.thread_number -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.thread_number -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-asr.audio -> Ok(None)
DEBUG:snips_common_cli::cli: conf lookup: snips-common.audio -> Ok(None)
INFO:snips_asr_hermes::handler: Loading model
INFO:snips_asr_hermes::handler: Loading model
DEBUG:snips_injection_lib::injectable: computing injections dirname from reference dir "/usr/share/snips/assistant"DEBUG:snips_injection_lib::injectable: computing injections dirname from reference dir "/usr/share/snips/assistant"INFO:snips_asr_hermes::handler      : Using model from "/usr/share/snips/assistant/custom_asr"INFO:snips_asr_hermes::handler      : Using model from "/usr/share/snips/assistant/custom_asr"DEBUG:snips_kaldi::version           : checking version libsnips_kaldi 0.24.2, me 0.24.3
DEBUG:snips_kaldi::logs              : setup log handler
INFO:snips_asr_hermes::handler      : Loading model
DEBUG:snips_kaldi::version           : checking version libsnips_kaldi 0.24.2, me 0.24.3
DEBUG:snips_injection_lib::injectable: computing injections dirname from reference dir "/usr/share/snips/assistant"DEBUG:snips_kaldi::decode::model     : Loading dynamic ASR model
INFO:snips_asr_hermes::handler      : Using model from "/usr/share/snips/assistant/custom_asr"INFO:snips_asr_hermes::handler      : Loading model
DEBUG:snips_kaldi::version           : checking version libsnips_kaldi 0.24.2, me 0.24.3
DEBUG:snips_injection_lib::injectable: computing injections dirname from reference dir "/usr/share/snips/assistant"INFO:snips_asr_hermes::handler      : Loading model
DEBUG:snips_kaldi::decode::model     : Loading dynamic ASR model
DEBUG:snips_injection_lib::injectable: computing injections dirname from reference dir "/usr/share/snips/assistant"INFO:snips_asr_hermes::handler      : Loading model
DEBUG:snips_kaldi::decode::model     : Loading dynamic ASR model
INFO:snips_asr_hermes::handler      : Using model from "/usr/share/snips/assistant/custom_asr"DEBUG:snips_injection_lib::injectable: computing injections dirname from reference dir "/usr/share/snips/assistant"INFO:snips_asr_hermes::handler      : Using model from "/usr/share/snips/assistant/custom_asr"DEBUG:snips_kaldi::version           : checking version libsnips_kaldi 0.24.2, me 0.24.3
INFO:snips_asr_hermes::handler      : Using model from "/usr/share/snips/assistant/custom_asr"DEBUG:snips_kaldi::version           : checking version libsnips_kaldi 0.24.2, me 0.24.3
DEBUG:snips_kaldi::version           : checking version libsnips_kaldi 0.24.2, me 0.24.3
DEBUG:snips_kaldi::decode::model     : Loading dynamic ASR model
DEBUG:snips_kaldi::decode::model     : Loading dynamic ASR model
DEBUG:snips_kaldi::decode::model     : Loading dynamic ASR model
INFO:snips_kaldi::decode::model     : Loading model v2
INFO:snips_kaldi::decode::model     : Loading model v2
INFO:snips_kaldi::decode::model     : Loading model v2
INFO:snips_kaldi::decode::model     : Loading model v2
INFO:snips_kaldi::decode::model     : Loading model v2
INFO:snips_kaldi::decode::model     : Loading model v2
DEBUG:snips_kaldi::logs              : Removing 0 orphan components.
DEBUG:snips_kaldi::logs              : left_fst_filename : /usr/share/snips/assistant/custom_asr/l.snips
DEBUG:snips_kaldi::logs              : right_fst_filename : /usr/share/snips/assistant/custom_asr/r.snips
DEBUG:snips_kaldi::logs              : ASR model fully loaded
INFO:snips_asr_hermes::handler      : Preparing decoder
DEBUG:snips_kaldi::decode::model     : Decoder started with decoder config DecoderConfig { beam_size: 12.0, max_active: 2500, min_active: 200, lattice_beam_size: 4.0, acoustic_scale: 0.83, use_final_probs: true, mbr_config: Some(MbrConfig { unk_threshold: 0.3, unk_proba: 0.5 }) } and endpointing rules EndpointingConfiguration { container: {"rule5": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 0.0, max_relative_cost: 10000000000.0, min_utterance_length: 10.0 }, "rule3": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 1.0, max_relative_cost: 8.0, min_utterance_length: 0.0 }, "rule1": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 4.0, max_relative_cost: 10000000000.0, min_utterance_length: 0.0 }, "rule2": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.7, max_relative_cost: 5.5, min_utterance_length: 0.0 }, "rule4": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.5, max_relative_cost: 2.5, min_utterance_length: 0.0 }} }
DEBUG:snips_kaldi::logs              : Removing 0 orphan components.
DEBUG:snips_kaldi::logs              : left_fst_filename : /usr/share/snips/assistant/custom_asr/l.snips
DEBUG:snips_kaldi::logs              : right_fst_filename : /usr/share/snips/assistant/custom_asr/r.snips
DEBUG:snips_kaldi::logs              : ASR model fully loaded
INFO:snips_asr_hermes::handler      : Preparing decoder
DEBUG:snips_kaldi::decode::model     : Decoder started with decoder config DecoderConfig { beam_size: 12.0, max_active: 2500, min_active: 200, lattice_beam_size: 4.0, acoustic_scale: 0.83, use_final_probs: true, mbr_config: Some(MbrConfig { unk_threshold: 0.3, unk_proba: 0.5 }) } and endpointing rules EndpointingConfiguration { container: {"rule2": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.7, max_relative_cost: 5.5, min_utterance_length: 0.0 }, "rule4": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.5, max_relative_cost: 2.5, min_utterance_length: 0.0 }, "rule1": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 4.0, max_relative_cost: 10000000000.0, min_utterance_length: 0.0 }, "rule5": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 0.0, max_relative_cost: 10000000000.0, min_utterance_length: 10.0 }, "rule3": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 1.0, max_relative_cost: 8.0, min_utterance_length: 0.0 }} }
DEBUG:snips_kaldi::logs              : Removing 0 orphan components.
DEBUG:snips_kaldi::logs              : Removing 0 orphan components.
DEBUG:snips_kaldi::logs              : left_fst_filename : /usr/share/snips/assistant/custom_asr/l.snips
DEBUG:snips_kaldi::logs              : left_fst_filename : /usr/share/snips/assistant/custom_asr/l.snips
DEBUG:snips_kaldi::logs              : right_fst_filename : /usr/share/snips/assistant/custom_asr/r.snips
DEBUG:snips_kaldi::logs              : right_fst_filename : /usr/share/snips/assistant/custom_asr/r.snips
DEBUG:snips_kaldi::logs              : Removing 0 orphan components.
DEBUG:snips_kaldi::logs              : left_fst_filename : /usr/share/snips/assistant/custom_asr/l.snips
DEBUG:snips_kaldi::logs              : right_fst_filename : /usr/share/snips/assistant/custom_asr/r.snips
DEBUG:snips_kaldi::logs              : Removing 0 orphan components.
DEBUG:snips_kaldi::logs              : left_fst_filename : /usr/share/snips/assistant/custom_asr/l.snips
DEBUG:snips_kaldi::logs              : right_fst_filename : /usr/share/snips/assistant/custom_asr/r.snips
DEBUG:snips_kaldi::logs              : ASR model fully loaded
DEBUG:snips_kaldi::logs              : ASR model fully loaded
*** Error in `snips-asr': double free or corruption (fasttop): 0x00007f9d10053de0 ***
INFO:snips_asr_hermes::handler      : Preparing decoder
DEBUG:snips_kaldi::decode::model     : Decoder started with decoder config DecoderConfig { beam_size: 12.0, max_active: 2500, min_active: 200, lattice_beam_size: 4.0, acoustic_scale: 0.83, use_final_probs: true, mbr_config: Some(MbrConfig { unk_threshold: 0.3, unk_proba: 0.5 }) } and endpointing rules EndpointingConfiguration { container: {"rule4": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.5, max_relative_cost: 2.5, min_utterance_length: 0.0 }, "rule3": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 1.0, max_relative_cost: 8.0, min_utterance_length: 0.0 }, "rule5": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 0.0, max_relative_cost: 10000000000.0, min_utterance_length: 10.0 }, "rule2": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.7, max_relative_cost: 5.5, min_utterance_length: 0.0 }, "rule1": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 4.0, max_relative_cost: 10000000000.0, min_utterance_length: 0.0 }} }
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x70bfb)[0x7f9d2f8f8bfb]
/lib/x86_64-linux-gnu/libc.so.6(+0x76fc6)[0x7f9d2f8fefc6]
/lib/x86_64-linux-gnu/libc.so.6(+0x7780e)[0x7f9d2f8ff80e]
/usr/lib/libsnips_kaldi.so(_ZN5kaldi12ParseOptions4ReadEiPKPKc+0xec)[0x7f9d3084b4bc]
/usr/lib/libsnips_kaldi.so(_ZN5kaldi11ReadOptionsERNS_12ParseOptionsESt6vectorINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaIS8_EE+0x18d)[0x7f9d307ba8fd]
/usr/lib/libsnips_kaldi.so(_ZN5kaldi10NNet3Model15FinalizeLoadingEPK33OnlineIvectorExtractionParameters+0x4b5)[0x7f9d307bafb5]
DEBUG:snips_kaldi::logs              : ASR model fully loaded
/usr/lib/libsnips_kaldi.so(_ZN5kaldi24CreateNnet3ModelVersion2EPNS_19NnetModelParametersEPK33OnlineIvectorExtractionParametersRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESC_PSB_SD_SD_PKSt6vectorISt4pairIjSA_ESaISG_EEmb+0x2e3)[0x7f9d30782de3]
DEBUG:snips_kaldi::logs              : ASR model fully loaded
INFO:snips_asr_hermes::handler      : Preparing decoder
INFO:snips_asr_hermes::handler      : Preparing decoder
DEBUG:snips_kaldi::decode::model     : Decoder started with decoder config DecoderConfig { beam_size: 12.0, max_active: 2500, min_active: 200, lattice_beam_size: 4.0, acoustic_scale: 0.83, use_final_probs: true, mbr_config: Some(MbrConfig { unk_threshold: 0.3, unk_proba: 0.5 }) } and endpointing rules EndpointingConfiguration { container: {"rule3": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 1.0, max_relative_cost: 8.0, min_utterance_length: 0.0 }, "rule1": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 4.0, max_relative_cost: 10000000000.0, min_utterance_length: 0.0 }, "rule4": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.5, max_relative_cost: 2.5, min_utterance_length: 0.0 }, "rule2": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.7, max_relative_cost: 5.5, min_utterance_length: 0.0 }, "rule5": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 0.0, max_relative_cost: 10000000000.0, min_utterance_length: 10.0 }} }
DEBUG:snips_kaldi::decode::model     : Decoder started with decoder config DecoderConfig { beam_size: 12.0, max_active: 2500, min_active: 200, lattice_beam_size: 4.0, acoustic_scale: 0.83, use_final_probs: true, mbr_config: Some(MbrConfig { unk_threshold: 0.3, unk_proba: 0.5 }) } and endpointing rules EndpointingConfiguration { container: {"rule5": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 0.0, max_relative_cost: 10000000000.0, min_utterance_length: 10.0 }, "rule3": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 1.0, max_relative_cost: 8.0, min_utterance_length: 0.0 }, "rule2": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.7, max_relative_cost: 5.5, min_utterance_length: 0.0 }, "rule1": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 4.0, max_relative_cost: 10000000000.0, min_utterance_length: 0.0 }, "rule4": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.5, max_relative_cost: 2.5, min_utterance_length: 0.0 }} }
/usr/lib/libsnips_kaldi.so(nnet3model_create_dynamic_v2+0x45d)[0x7f9d3070c95d]
snips-asr(+0x2a6fc7)[0x5635ed73cfc7]
snips-asr(+0x25348f)[0x5635ed6e948f]
snips-asr(+0x4bcc5)[0x5635ed4e1cc5]
snips-asr(+0x52466)[0x5635ed4e8466]
snips-asr(+0x3afe9a)[0x5635ed845e9a]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x74a4)[0x7f9d2fe454a4]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f9d2f970d0f]
======= Memory map: ========
5635ed496000-5635ed98d000 r-xp 00000000 103:02 4065286                   /usr/bin/snips-asr
5635edb8c000-5635edbc0000 r--p 004f6000 103:02 4065286                   /usr/bin/snips-asr
5635edbc0000-5635edbc1000 rw-p 0052a000 103:02 4065286                   /usr/bin/snips-asr
5635edf83000-5635edfc2000 rw-p 00000000 00:00 0                          [heap]
7f9d04000000-7f9d04029000 rw-p 00000000 00:00 0 
7f9d04029000-7f9d08000000 ---p 00000000 00:00 0 
7f9d08000000-7f9d08021000 rw-p 00000000 00:00 0 
7f9d08021000-7f9d0c000000 ---p 00000000 00:00 0 
7f9d0dd43000-7f9d0e3df000 rw-p 00000000 00:00 0 
7f9d0e462000-7f9d10000000 rw-p 00000000 00:00 0 
7f9d10000000-7f9d1020f000 rw-p 00000000 00:00 0 
7f9d1020f000-7f9d14000000 ---p 00000000 00:00 0 
7f9d14000000-7f9d141c9000 rw-p 00000000 00:00 0 
7f9d141c9000-7f9d18000000 ---p 00000000 00:00 0 
7f9d18000000-7f9d181c9000 rw-p 00000000 00:00 0 
7f9d181c9000-7f9d1c000000 ---p 00000000 00:00 0 
7f9d1c000000-7f9d1c1c9000 rw-p 00000000 00:00 0 
7f9d1c1c9000-7f9d20000000 ---p 00000000 00:00 0 
7f9d20000000-7f9d201c9000 rw-p 00000000 00:00 0 
7f9d201c9000-7f9d24000000 ---p 00000000 00:00 0 
7f9d24000000-7f9d24210000 rw-p 00000000 00:00 0 
7f9d24210000-7f9d28000000 ---p 00000000 00:00 0 
7f9d28000000-7f9d28021000 rw-p 00000000 00:00 0 
7f9d28021000-7f9d2c000000 ---p 00000000 00:00 0 
7f9d2c002000-7f9d2ce51000 rw-p 00000000 00:00 0 
7f9d2ce51000-7f9d2ce52000 ---p 00000000 00:00 0 
7f9d2ce52000-7f9d2d052000 rw-p 00000000 00:00 0 
7f9d2d052000-7f9d2d053000 ---p 00000000 00:00 0 
7f9d2d053000-7f9d2d253000 rw-p 00000000 00:00 0 
7f9d2d253000-7f9d2d254000 ---p 00000000 00:00 0 
7f9d2d254000-7f9d2d454000 rw-p 00000000 00:00 0 
7f9d2d454000-7f9d2d455000 ---p 00000000 00:00 0 
7f9d2d455000-7f9d2d655000 rw-p 00000000 00:00 0 
7f9d2d655000-7f9d2d656000 ---p 00000000 00:00 0 
7f9d2d656000-7f9d2d856000 rw-p 00000000 00:00 0 
7f9d2d856000-7f9d2d857000 ---p 00000000 00:00 0 
7f9d2d857000-7f9d2da57000 rw-p 00000000 00:00 0 
7f9d2da57000-7f9d2da58000 ---p 00000000 00:00 0 
7f9d2da58000-7f9d2dc58000 rw-p 00000000 00:00 0 
7f9d2dc58000-7f9d2dc59000 ---p 00000000 00:00 0 
7f9d2dc59000-7f9d2de59000 rw-p 00000000 00:00 0 
7f9d2de59000-7f9d2de63000 r-xp 00000000 103:02 10097716                  /lib/x86_64-linux-gnu/libnss_files-2.24.so
7f9d2de63000-7f9d2e063000 ---p 0000a000 103:02 10097716                  /lib/x86_64-linux-gnu/libnss_files-2.24.so
7f9d2e063000-7f9d2e064000 r--p 0000a000 103:02 10097716                  /lib/x86_64-linux-gnu/libnss_files-2.24.so
7f9d2e064000-7f9d2e065000 rw-p 0000b000 103:02 10097716                  /lib/x86_64-linux-gnu/libnss_files-2.24.so
7f9d2e065000-7f9d2e06b000 rw-p 00000000 00:00 0 
7f9d2e06b000-7f9d2e0a9000 r-xp 00000000 103:02 4065379                   /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
7f9d2e0a9000-7f9d2e2a8000 ---p 0003e000 103:02 4065379                   /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
7f9d2e2a8000-7f9d2e2a9000 r--p 0003d000 103:02 4065379                   /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
7f9d2e2a9000-7f9d2e2aa000 rw-p 0003e000 103:02 4065379                   /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
7f9d2e2aa000-7f9d2e2ca000 r-xp 00000000 103:02 4065323                   /usr/lib/atlas-base/libf77blas.so.3.0
7f9d2e2ca000-7f9d2e4c9000 ---p 00020000 103:02 4065323                   /usr/lib/atlas-base/libf77blas.so.3.0
7f9d2e4c9000-7f9d2e4ca000 r--p 0001f000 103:02 4065323                   /usr/lib/atlas-base/libf77blas.so.3.0
7f9d2e4ca000-7f9d2e4cb000 rw-p 00020000 103:02 4065323                   /usr/lib/atlas-base/libf77blas.so.3.0
7f9d2e4cb000-7f9d2e5ef000 r-xp 00000000 103:02 4065358                   /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
7f9d2e5ef000-7f9d2e7ee000 ---p 00124000 103:02 4065358                   /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
7f9d2e7ee000-7f9d2e7ef000 r--p 00123000 103:02 4065358                   /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
7f9d2e7ef000-7f9d2e7f1000 rw-p 00124000 103:02 4065358                   /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
7f9d2e7f1000-7f9d2eb7d000 r-xp 00000000 103:02 4065319                   /usr/lib/atlas-base/libatlas.so.3.0
7f9d2eb7d000-7f9d2ed7c000 ---p 0038c000 103:02 4065319                   /usr/lib/atlas-base/libatlas.so.3.0
7f9d2ed7c000-7f9d2ed80000 r--p 0038b000 103:02 4065319                   /usr/lib/atlas-base/libatlas.so.3.0
7f9d2ed80000-7f9d2ed84000 rw-p 0038f000 103:02 4065319                   /usr/lib/atlas-base/libatlas.so.3.0
7f9d2ed84000-7f9d2eef6000 r-xp 00000000 103:02 10226525                  /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
7f9d2eef6000-7f9d2f0f6000 ---p 00172000 103:02 10226525                  /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
7f9d2f0f6000-7f9d2f100000 r--p 00172000 103:02 10226525                  /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
7f9d2f100000-7f9d2f102000 rw-p 0017c000 103:02 10226525                  /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
7f9d2f102000-7f9d2f106000 rw-p 00000000 00:00 0 
7f9d2f106000-7f9d2f161000 r-xp 00000000 103:02 4065325                   /usr/lib/atlas-base/liblapack_atlas.so.3.0
7f9d2f161000-7f9d2f360000 ---p 0005b000 103:02 4065325                   /usr/lib/atlas-base/liblapack_atlas.so.3.0
7f9d2f360000-7f9d2f361000 r--p 0005a000 103:02 4065325                   /usr/lib/atlas-base/liblapack_atlas.so.3.0
7f9d2f361000-7f9d2f362000 rw-p 0005b000 103:02 4065325                   /usr/lib/atlas-base/liblapack_atlas.so.3.0
7f9d2f362000-7f9d2f383000 r-xp 00000000 103:02 4065321                   /usr/lib/atlas-base/libcblas.so.3.0
7f9d2f383000-7f9d2f582000 ---p 00021000 103:02 4065321                   /usr/lib/atlas-base/libcblas.so.3.0
7f9d2f582000-7f9d2f583000 r--p 00020000 103:02 4065321                   /usr/lib/atlas-base/libcblas.so.3.0
7f9d2f583000-7f9d2f584000 rw-p 00021000 103:02 4065321                   /usr/lib/atlas-base/libcblas.so.3.0
7f9d2f584000-7f9d2f687000 r-xp 00000000 103:02 10097701                  /lib/x86_64-linux-gnu/libm-2.24.so
7f9d2f687000-7f9d2f886000 ---p 00103000 103:02 10097701                  /lib/x86_64-linux-gnu/libm-2.24.so
7f9d2f886000-7f9d2f887000 r--p 00102000 103:02 10097701                  /lib/x86_64-linux-gnu/libm-2.24.so
7f9d2f887000-7f9d2f888000 rw-p 00103000 103:02 10097701                  /lib/x86_64-linux-gnu/libm-2.24.so
7f9d2f888000-7f9d2fa1d000 r-xp 00000000 103:02 10097676                  /lib/x86_64-linux-gnu/libc-2.24.so
7f9d2fa1d000-7f9d2fc1d000 ---p 00195000 103:02 10097676                  /lib/x86_64-linux-gnu/libc-2.24.so
7f9d2fc1d000-7f9d2fc21000 r--p 00195000 103:02 10097676                  /lib/x86_64-linux-gnu/libc-2.24.so
7f9d2fc21000-7f9d2fc23000 rw-p 00199000 103:02 10097676                  /lib/x86_64-linux-gnu/libc-2.24.so
7f9d2fc23000-7f9d2fc27000 rw-p 00000000 00:00 0 
7f9d2fc27000-7f9d2fc3d000 r-xp 00000000 103:02 10097694                  /lib/x86_64-linux-gnu/libgcc_s.so.1
7f9d2fc3d000-7f9d2fe3c000 ---p 00016000 103:02 10097694                  /lib/x86_64-linux-gnu/libgcc_s.so.1
7f9d2fe3c000-7f9d2fe3d000 r--p 00015000 103:02 10097694                  /lib/x86_64-linux-gnu/libgcc_s.so.1
7f9d2fe3d000-7f9d2fe3e000 rw-p 00016000 103:02 10097694                  /lib/x86_64-linux-gnu/libgcc_s.so.1
7f9d2fe3e000-7f9d2fe56000 r-xp 00000000 103:02 10097733                  /lib/x86_64-linux-gnu/libpthread-2.24.so
7f9d2fe56000-7f9d30055000 ---p 00018000 103:02 10097733                  /lib/x86_64-linux-gnu/libpthread-2.24.so
7f9d30055000-7f9d30056000 r--p 00017000 103:02 10097733                  /lib/x86_64-linux-gnu/libpthread-2.24.so
7f9d30056000-7f9d30057000 rw-p 00018000 103:02 10097733                  /lib/x86_64-linux-gnu/libpthread-2.24.so
7f9d30057000-7f9d3005b000 rw-p 00000000 00:00 0 
7f9d3005b000-7f9d30062000 r-xp 00000000 103:02 10097737                  /lib/x86_64-linux-gnu/librt-2.24.so
7f9d30062000-7f9d30261000 ---p 00007000 103:02 10097737                  /lib/x86_64-linux-gnu/librt-2.24.so
7f9d30261000-7f9d30262000 r--p 00006000 103:02 10097737                  /lib/x86_64-linux-gnu/librt-2.24.so
7f9d30262000-7f9d30263000 rw-p 00007000 103:02 10097737                  /lib/x86_64-linux-gnu/librt-2.24.so
7f9d30263000-7f9d30266000 r-xp 00000000 103:02 10097686                  /lib/x86_64-linux-gnu/libdl-2.24.so
7f9d30266000-7f9d30465000 ---p 00003000 103:02 10097686                  /lib/x86_64-linux-gnu/libdl-2.24.so
7f9d30465000-7f9d30466000 r--p 00002000 103:02 10097686                  /lib/x86_64-linux-gnu/libdl-2.24.so
7f9d30466000-7f9d30467000 rw-p 00003000 103:02 10097686                  /lib/x86_64-linux-gnu/libdl-2.24.so
7f9d30467000-7f9d30ccb000 r-xp 00000000 103:02 4065332                   /usr/lib/libsnips_kaldi.so
7f9d30ccb000-7f9d30ecb000 ---p 00864000 103:02 4065332                   /usr/lib/libsnips_kaldi.so
7f9d30ecb000-7f9d30ee4000 r--p 00864000 103:02 4065332                   /usr/lib/libsnips_kaldi.so
7f9d30ee4000-7f9d30eee000 rw-p 0087d000 103:02 4065332                   /usr/lib/libsnips_kaldi.so
7f9d30eee000-7f9d30eef000 rw-p 00000000 00:00 0 
7f9d30eef000-7f9d30f12000 r-xp 00000000 103:02 10097658                  /lib/x86_64-linux-gnu/ld-2.24.so
7f9d30f2a000-7f9d31112000 rw-p 00000000 00:00 0 
7f9d31112000-7f9d31113000 r--p 00023000 103:02 10097658                  /lib/x86_64-linux-gnu/ld-2.24.so
7f9d31113000-7f9d31114000 rw-p 00024000 103:02 10097658                  /lib/x86_64-linux-gnu/ld-2.24.so
7f9d31114000-7f9d31115000 rw-p 00000000 00:00 0 
7ffcfbf12000-7ffcfbf33000 rw-p 00000000 00:00 0                          [stack]
7ffcfbfb2000-7ffcfbfb5000 r--p 00000000 00:00 0                          [vvar]
7ffcfbfb5000-7ffcfbfb7000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

Additional information

My start script:

#!/bin/bash
mosquitto -d

snips-audio-server -v 2> /var/log/snips-audio-server.log &
snips_audio_server_pid=$!

sleep 5

snips-asr -v 2> /var/log/snips-asr.log &
snips_asr_pid=$!

wait "$snips_audio_server_pid" "$snips_asr_pid"

Workaround
Restart until it starts.

@zaripych zaripych added the type: bug label Jun 25, 2019
@zaripych zaripych changed the title [ASR] `snips-asr` Crashes at Startup (Kaldi -> ParseOptions -> Read?) [ASR] snips-asr Crashes at Startup (Kaldi -> ParseOptions -> Read?) Jun 25, 2019
@cpoisson cpoisson added the ASR label Jun 25, 2019
@cpoisson

This comment has been minimized.

Copy link
Collaborator

commented Jun 25, 2019

Thanks for your report @zaripych,

We have seen this problem once but could not reproduce it.

On which linux distro is based your docker image?

@zaripych

This comment has been minimized.

Copy link
Author

commented Jun 25, 2019

@cpoisson
It's Debian based.

I pushed the image to aimeeblue/snips-asr-crash if you rather not rebuild yourself. The GPG key retrieval is flaky, so the docker build ... fails from time to time.

Here is my Dockerfile:

FROM debian:stretch-slim

ENV TZ=Australia/Sydney

RUN set -x && \ 
  ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone

RUN set -x \
  && sed -i "s#deb http://deb.debian.org/debian stretch main#deb http://deb.debian.org/debian stretch main non-free#g" /etc/apt/sources.list \
  && sed -i "s#deb http://security.debian.org/debian-security stretch/updates main#deb http://security.debian.org/debian-security stretch/updates main non-free#g" /etc/apt/sources.list \
  && sed -i "s#deb http://deb.debian.org/debian stretch-updates main#deb http://deb.debian.org/debian stretch-updates main non-free#g" /etc/apt/sources.list \
  && apt-get update && apt-get dist-upgrade -y \
  && apt-get install -y dirmngr apt-transport-https \
  && bash -c  'echo "deb https://debian.snips.ai/stretch stable main" > /etc/apt/sources.list.d/snips.list' \
  && apt-key adv --keyserver pgp.mit.edu --recv-keys F727C778CCB0A455 \
  && apt-get update 

RUN set -x && \
  apt-get install -y alsa-utils snips-platform-voice snips-platform-demo snips-tts snips-watch snips-skill-server snips-template curl unzip procps

EXPOSE 1883/tcp

COPY start.sh start.sh

CMD ["bash", "./start.sh"]

And start.sh:

#!/bin/bash
mosquitto -d

snips-audio-server -v 2> /var/log/snips-audio-server.log &
snips_audio_server_pid=$!

snips-asr -v 2> /var/log/snips-asr.log &
snips_asr_pid=$!

wait "$snips_audio_server_pid" "$snips_asr_pid"

And my docker-compose.yml:

version: "3"
services:
  snips:
    image: "aimeeblue/snips-asr-crash"
    container_name: snips
    privileged: true
    ports:
      - "1883:1883"
    volumes:
      - /etc/asound.conf:/etc/asound.conf
      - /dev/snd:/dev/snd
      - ./log:/var/log/
      - ./snips.toml:/etc/snips.toml

My snips.toml is empty placeholder from documentation.

@zaripych

This comment has been minimized.

Copy link
Author

commented Jun 25, 2019

To reproduce I just run docker-compose up -d, check logs. Then run docker-compose down and then up again until I see the error. Sometimes it crashes all the time, sometimes it's difficult to reproduce.

I was able to reproduce it on two separate machines with similar alsaconfig.

@cpoisson

This comment has been minimized.

Copy link
Collaborator

commented Jul 15, 2019

I reproduced it again on 18.04 yesterday.

Seems that the crash appears since release 1.2.1 (0.63.2).

We have a refactoring ongoing on this side to improve the multithreading mechanism used for model management in snips-asr.

@cpoisson

This comment has been minimized.

Copy link
Collaborator

commented Jul 15, 2019

Thread 7 "asr.handler.4" received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fffdffff700 (LWP 12218)]
tcache_get (tc_idx=0) at malloc.c:2943
2943	malloc.c: No such file or directory.
(gdb) bt
#0  tcache_get (tc_idx=0) at malloc.c:2943
#1  __GI___libc_malloc (bytes=19) at malloc.c:3050
#2  0x00007ffff5c08258 in operator new(unsigned long) ()
   from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#3  0x00007ffff77317b8 in kaldi::ParseOptions::Read(int, char const* const*) ()
   from /usr/lib/libsnips_kaldi.so
#4  0x00007ffff76a08fd in kaldi::ReadOptions(kaldi::ParseOptions&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >) ()
   from /usr/lib/libsnips_kaldi.so
#5  0x00007ffff76a0fb5 in kaldi::NNet3Model::FinalizeLoading(OnlineIvectorExtractionParameters const*) () from /usr/lib/libsnips_kaldi.so
#6  0x00007ffff7668de3 in kaldi::CreateNnet3ModelVersion2(kaldi::NnetModelParameters*, OnlineIvectorExtractionParameters const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const*, std::vector<std::pair<unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::pair<unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > > const*, unsigned long, bool) () from /usr/lib/libsnips_kaldi.so
#7  0x00007ffff75f295d in nnet3model_create_dynamic_v2 ()
   from /usr/lib/libsnips_kaldi.so
#8  0x000055555580385a in ?? ()
#9  0x00005555557b13a0 in ?? ()
#10 0x00005555555a1056 in ?? ()
#11 0x00005555555a37f9 in ?? ()
#12 0x000055555590a2df in ?? ()
#13 0x000055555590c1bc in ?? ()
#14 0x00007ffff6d296db in start_thread (arg=0x7fffdffff700) at pthread_create.c:463
#15 0x00007ffff683a88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
@cpoisson

This comment has been minimized.

Copy link
Collaborator

commented Jul 18, 2019

@zaripych ,

We are still investigating this one,

Meanwhile, I think I found a workaround.
There s a race condition at initialisation between the threads running the asr decoding.

The number of thread used is half the number of cpu cores available.

A solution (seems to work on my side) is to keep them as low as 2 maximum using --thread_number 2 option of snips-asr. (thread_number=2 in /etc/snips.toml)

Can you try that on your side?

Another information, the crash only occurs when the host is a X86 debian like linux (ubuntu, debian)

Running debian stretch docker on MacOS, I cannot reproduce the issue.

@mryshakow

This comment has been minimized.

Copy link

commented Jul 19, 2019

I can reproduce a similiar issue by using injection. Using the this addon snips-openhab will cause the following log every time on start up.

System: Docker, based on debian:stretch-slim
Host: Ubuntu 19.04

Snips Installed Packages:

  • snips-analytics/unknown,now 0.63.2 amd64 [installed]
  • snips-asr/unknown,now 0.63.2 amd64 [installed,automatic]
  • snips-audio-server/unknown,now 0.63.2 amd64 [installed,automatic]
  • snips-dialogue/unknown,now 0.63.2 amd64 [installed,automatic]
  • snips-hotword/unknown,now 0.63.2 amd64 [installed,automatic]
  • snips-injection/unknown,now 0.63.2 amd64 [installed]
  • snips-kaldi-atlas/unknown,now 0.24.2 amd64 [installed]
  • snips-nlu/unknown,now 0.63.2 amd64 [installed,automatic]
  • snips-platform-common/unknown,now 0.63.2 amd64 [installed]
  • snips-platform-voice/unknown,now 0.63.2 amd64 [installed]
  • snips-skill-server/unknown,now 0.63.2 amd64 [installed]
  • snips-template/unknown,now 0.63.2 amd64 [installed]
  • snips-tts/unknown,now 0.63.2 amd64 [installed]
  • snips-watch/unknown,now 0.63.2 amd64 [installed]
mryshakow@srv:/mnt/raid/homeauto/snips-docker$ sudo docker-compose up
Creating snipsaisrv ... done
Attaching to snipsaisrv
snipsaisrv | Cloning into '/usr/share/snips/assistant'...
snipsaisrv | INFO:snips_actions_templates_engine_lib: parsing snippets for app "/usr/share/snips/assistant/snippets/Alpha200.OpenHAB"
snipsaisrv | Cloning into 'snips-openhab'...
snipsaisrv | Run setup.sh in ./snips-openhab
snipsaisrv | Already using interpreter /usr/bin/python3
snipsaisrv | Using base prefix '/usr'
snipsaisrv | New python executable in /var/lib/snips/skills/snips-openhab/venv/bin/python3
snipsaisrv | Also creating executable in /var/lib/snips/skills/snips-openhab/venv/bin/python
snipsaisrv | Installing setuptools, pip, wheel...
snipsaisrv | done.
snipsaisrv | Running virtualenv with interpreter /usr/bin/python3
snipsaisrv | Collecting requests (from -r requirements.txt (line 1))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)
snipsaisrv | Collecting hermes-python>=0.7.0 (from -r requirements.txt (line 2))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/4b/73/3d6d355da471db3b9a362eb35db5b1d1339d0df14ff0d4a8de401084133a/hermes_python-0.7.0-cp35-cp35m-manylinux1_x86_64.whl (2.8MB)
snipsaisrv | Collecting gender-determinator==0.2.1 (from -r requirements.txt (line 3))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/b0/42/9dc26fb9dae1c5349cf24cefd8276cce80fecfca6786f6afcedd6fdf0d67/gender-determinator-0.2.1.tar.gz (121kB)
snipsaisrv | Collecting toml>=0.10.0 (from -r requirements.txt (line 4))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/a2/12/ced7105d2de62fa7c8fb5fce92cc4ce66b57c95fb875e9318dba7f8c5db0/toml-0.10.0-py2.py3-none-any.whl
snipsaisrv | Collecting chardet<3.1.0,>=3.0.2 (from requests->-r requirements.txt (line 1))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
snipsaisrv | Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 1))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/69/1b/b853c7a9d4f6a6d00749e94eb6f3a041e342a885b87340b79c1ef73e3a78/certifi-2019.6.16-py2.py3-none-any.whl (157kB)
snipsaisrv | Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->-r requirements.txt (line 1))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl (150kB)
snipsaisrv | Collecting idna<2.9,>=2.5 (from requests->-r requirements.txt (line 1))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)
snipsaisrv | Collecting future (from hermes-python>=0.7.0->-r requirements.txt (line 2))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/90/52/e20466b85000a181e1e144fd8305caf2cf475e2f9674e797b222f8105f5f/future-0.17.1.tar.gz (829kB)
snipsaisrv | Collecting six (from hermes-python>=0.7.0->-r requirements.txt (line 2))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
snipsaisrv | Collecting typing (from hermes-python>=0.7.0->-r requirements.txt (line 2))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/28/b8/a1d6b7cf322f91305bcb5e7d8f6c3028954d1e3e716cddc1cdce2ac63247/typing-3.7.4-py3-none-any.whl
snipsaisrv | Collecting enum34 (from hermes-python>=0.7.0->-r requirements.txt (line 2))
snipsaisrv |   Downloading https://files.pythonhosted.org/packages/af/42/cb9355df32c69b553e72a2e28daee25d1611d2c0d9c272aa1d34204205b2/enum34-1.1.6-py3-none-any.whl
snipsaisrv | Building wheels for collected packages: gender-determinator, future
snipsaisrv |   Building wheel for gender-determinator (setup.py): started
snipsaisrv |   Building wheel for gender-determinator (setup.py): finished with status 'done'
snipsaisrv |   Stored in directory: /root/.cache/pip/wheels/2c/9c/67/02c2e76993afe6d1c160e9cce289b37ba5e2dab27e6c0a723f
snipsaisrv |   Building wheel for future (setup.py): started
snipsaisrv |   Building wheel for future (setup.py): finished with status 'done'
snipsaisrv |   Stored in directory: /root/.cache/pip/wheels/0c/61/d2/d6b7317325828fbb39ee6ad559dbe4664d0896da4721bf379e
snipsaisrv | Successfully built gender-determinator future
snipsaisrv | Installing collected packages: chardet, certifi, urllib3, idna, requests, future, six, typing, enum34, hermes-python, gender-determinator, toml
snipsaisrv | Successfully installed certifi-2019.6.16 chardet-3.0.4 enum34-1.1.6 future-0.17.1 gender-determinator-0.2.1 hermes-python-0.7.0 idna-2.8 requests-2.22.0 six-1.12.0 toml-0.10.0 typing-3.7.4 urllib3-1.25.3
snipsaisrv | INFO:snips_analytics_hermes: The analytics service is temporarily disabled
snipsaisrv | INFO:snips_dialogue_hermes: Loading the configuration file
snipsaisrv | [05:35:17] Watching on localhost:1883 (MQTT)
snipsaisrv | INFO:snips_nlu_hermes: loading nlu engine "/usr/share/snips/assistant/nlu_engine"
snipsaisrv | INFO:snips_skill_server_lib::runner: searching dir for actions: /var/lib/snips/skills/snips-openhab
snipsaisrv | INFO:snips_skill_server_lib::runner: found action "/var/lib/snips/skills/snips-openhab/action-openHAB.py"
snipsaisrv | INFO:snips_tts_hermes: starting with provider PicoTts
snipsaisrv | INFO:snips_audio_server_cli: Starting audio server on mqtt for site server
snipsaisrv | INFO:snips_broadcast_mqtt_server: Starting broadcasting audio on hermes as site "server"
snipsaisrv | INFO:snips_injection_hermes: Launch with assistant "/usr/share/snips/assistant" and user dir "/var/lib/snips/"
snipsaisrv | INFO:snips_asr_hermes::handler: Loading model
snipsaisrv | INFO:snips_asr_hermes::handler: Using model from "/usr/share/snips/assistant/custom_asr"
snipsaisrv | INFO:snips_asr_hermes::handler: Loading model
snipsaisrv | INFO:snips_asr_hermes::handler: Using model from "/usr/share/snips/assistant/custom_asr"
snipsaisrv | INFO:snips_asr_hermes::handler: Loading model
snipsaisrv | INFO:snips_asr_hermes::handler: Using model from "/usr/share/snips/assistant/custom_asr"
snipsaisrv | INFO:snips_asr_hermes::handler: Loading model
snipsaisrv | INFO:snips_asr_hermes::handler: Using model from "/usr/share/snips/assistant/custom_asr"
snipsaisrv | INFO:snips_dialogue_lib::config: Loading language de
snipsaisrv | INFO:snips_dialogue_hermes     : Starting...
snipsaisrv | INFO:snips_nlu_lib::resources::loading: Loading stemmer ("/usr/share/snips/assistant/nlu_engine/resources/de/stemming/stems.txt") ...
snipsaisrv | INFO:snips_kaldi::decode::model: Loading model v2
snipsaisrv | INFO:snips_kaldi::decode::model: Loading model v2
snipsaisrv | INFO:snips_kaldi::decode::model: Loading model v2
snipsaisrv | INFO:snips_kaldi::decode::model: Loading model v2
snipsaisrv | INFO:snips_asr_hermes::handler : Preparing decoder
snipsaisrv | INFO:snips_nlu_lib::resources::loading: Stemmer loaded
snipsaisrv | INFO:snips_nlu_lib::resources::loading: Loading gazetteer 'top_200000_words_stemmed' ("/usr/share/snips/assistant/nlu_engine/resources/de/gazetteers/top_200000_words_stemmed.txt") ...
snipsaisrv | INFO:snips_asr_hermes::handler : Preparing decoder
snipsaisrv | INFO:snips_asr_hermes::handler : Preparing decoder
snipsaisrv | INFO:snips_asr_hermes::handler : Preparing decoder
snipsaisrv | INFO:snips_nlu_lib::resources::loading: Gazetteer 'top_200000_words_stemmed' loaded
snipsaisrv | INFO:snips_nlu_lib::resources::loading: Loading stop words ("/usr/share/snips/assistant/nlu_engine/resources/de/stop_words.txt") ...
snipsaisrv | INFO:snips_nlu_lib::resources::loading: Stop words loaded
snipsaisrv | INFO:snips_nlu_lib::entity_parser::builtin_entity_parser: Loading builtin entity parser ("/usr/share/snips/assistant/nlu_engine/builtin_entity_parser") ...
snipsaisrv | INFO:snips_nlu_lib::entity_parser::builtin_entity_parser: Builtin entity parser loaded
snipsaisrv | INFO:snips_nlu_lib::entity_parser::custom_entity_parser : Loading custom entity parser ("/usr/share/snips/assistant/nlu_engine/custom_entity_parser") ...
snipsaisrv | INFO:snips_nlu_lib::entity_parser::custom_entity_parser : Custom entity parser loaded
snipsaisrv | INFO:snips_nlu_lib::intent_parser::deterministic_intent_parser: Loading deterministic intent parser ("/usr/share/snips/assistant/nlu_engine/deterministic_intent_parser") ...
snipsaisrv | INFO:snips_nlu_lib::intent_parser::deterministic_intent_parser: Deterministic intent parser loaded
snipsaisrv | INFO:snips_nlu_lib::intent_classifier::log_reg_intent_classifier: Loading log reg intent classifier ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/intent_classifier") ...
snipsaisrv | INFO:snips_nlu_lib::intent_classifier::log_reg_intent_classifier: Log reg intent classifier loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_0") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_1") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_2") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_3") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_4") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_5") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_6") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_7") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_8") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_9") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_10") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/usr/share/snips/assistant/nlu_engine/probabilistic_intent_parser/slot_filler_11") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_hermes                                           : model loaded in 368 ms
snipsaisrv | INFO:snips_skill_server_lib::runner: [openHAB][out] yoooo: <hermes_python.ontology.injection.AddFromVanillaInjectionRequest object at 0x7f467f542d30>
snipsaisrv | [05:35:18] [Injection] an injection of 312 words for 2 entities has been requested
snipsaisrv | INFO:snips_asr_injection   : ASR Injections started
snipsaisrv | INFO:snips_asr_injection::core: Number of new words: 214
snipsaisrv | INFO:snips_asr_injection      : prepare_injections done in 0.001s.
snipsaisrv | INFO:snips_asr_injection      : Generating missing words pronunciations
snipsaisrv | [05:35:18] [Tts] was asked to register a wav of 358.0 kB with id 'success'
snipsaisrv | INFO:snips_asr_injection      : g2p done in 0.981s.
snipsaisrv | INFO:snips_asr_injection::model_version_2: Updating pronunciations' graph
snipsaisrv | INFO:snips_asr_injection::model_version_2: pronunciations' graph done in 0.100s.
snipsaisrv | INFO:snips_asr_injection::model_version_2: Updating entities' graph
snipsaisrv | INFO:snips_asr_injection::model_version_2: Entity device done in 0.008s.
snipsaisrv | INFO:snips_asr_injection::model_version_2: Entity room done in 0.003s.
snipsaisrv | INFO:snips_asr_injection::model_version_2: entities' graph done in 0.015s.
snipsaisrv | INFO:snips_asr_injection::core           : Injections performed with success
snipsaisrv | INFO:snips_asr_injection                 : ASR injections done
snipsaisrv | INFO:snips_nlu_lib::injection::injection : Starting injection...
snipsaisrv | INFO:snips_nlu_lib::injection::injection : Retrieving parsers paths...
snipsaisrv | INFO:snips_nlu_lib::resources::loading   : Loading stemmer ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818.xAT2Mm2otRt4/nlu_engine/resources/de/stemming/stems.txt") ...
snipsaisrv | INFO:snips_nlu_lib::resources::loading   : Stemmer loaded
snipsaisrv | INFO:snips_nlu_lib::resources::loading   : Loading gazetteer 'top_200000_words_stemmed' ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818.xAT2Mm2otRt4/nlu_engine/resources/de/gazetteers/top_200000_words_stemmed.txt") ...
snipsaisrv | INFO:snips_nlu_lib::resources::loading   : Gazetteer 'top_200000_words_stemmed' loaded
snipsaisrv | INFO:snips_nlu_lib::resources::loading   : Loading stop words ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818.xAT2Mm2otRt4/nlu_engine/resources/de/stop_words.txt") ...
snipsaisrv | INFO:snips_nlu_lib::resources::loading   : Stop words loaded
snipsaisrv | INFO:snips_nlu_lib::entity_parser::builtin_entity_parser: Loading builtin entity parser ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818.xAT2Mm2otRt4/nlu_engine/builtin_entity_parser") ...
snipsaisrv | INFO:snips_nlu_lib::entity_parser::builtin_entity_parser: Builtin entity parser loaded
snipsaisrv | INFO:snips_nlu_lib::entity_parser::custom_entity_parser : Loading custom entity parser ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818.xAT2Mm2otRt4/nlu_engine/custom_entity_parser") ...
snipsaisrv | INFO:snips_nlu_lib::entity_parser::custom_entity_parser : Custom entity parser loaded
snipsaisrv | INFO:snips_nlu_lib::injection::injection                : Normalizing injected values...
snipsaisrv | INFO:snips_nlu_lib::injection::injection                : Injecting values for entity 'room'
snipsaisrv | INFO:snips_nlu_lib::injection::injection                : Injecting values for entity 'device'
snipsaisrv | INFO:snips_nlu_lib::injection::injection                : Injection performed with success !
snipsaisrv | INFO:snips_injection_lib::prepare                       : injection succeed
snipsaisrv | [05:35:19] [Asr] was asked to reload its model
snipsaisrv | INFO:snips_asr_hermes::handler : Loading model
snipsaisrv | INFO:snips_asr_hermes::handler : Using model from "/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/asr"
snipsaisrv | INFO:snips_asr_hermes::handler : Loading model
snipsaisrv | INFO:snips_asr_hermes::handler : Using model from "/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/asr"
snipsaisrv | INFO:snips_asr_hermes::handler : Loading model
snipsaisrv | INFO:snips_asr_hermes::handler : Loading model
snipsaisrv | INFO:snips_asr_hermes::handler : Using model from "/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/asr"
snipsaisrv | INFO:snips_asr_hermes::handler : Using model from "/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/asr"
snipsaisrv | INFO:snips_kaldi::decode::model: Loading model v2
snipsaisrv | INFO:snips_kaldi::decode::model: Loading model v2
snipsaisrv | INFO:snips_kaldi::decode::model: Loading model v2
snipsaisrv | INFO:snips_kaldi::decode::model: Loading model v2
snipsaisrv | INFO:snips_nlu_hermes                                           : reload nlu engine event received
snipsaisrv | [05:35:19] [Nlu] was asked to reload its engine
snipsaisrv | INFO:snips_nlu_hermes                                           : loading nlu engine "/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine"
snipsaisrv | INFO:snips_nlu_lib::resources::loading                          : Loading stemmer ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/resources/de/stemming/stems.txt") ...
snipsaisrv | *** Error in `snips-asr': double free or corruption (fasttop): 0x00007fdcd02177c0 ***
snipsaisrv | INFO:snips_asr_hermes::handler : Preparing decoder
snipsaisrv | INFO:snips_asr_hermes::handler : Preparing decoder
snipsaisrv | ======= Backtrace: =========
snipsaisrv | /lib/x86_64-linux-gnu/libc.so.6(+0x70bfb)[0x7fdcf18eebfb]
snipsaisrv | /lib/x86_64-linux-gnu/libc.so.6(+0x76fc6)[0x7fdcf18f4fc6]
snipsaisrv | /lib/x86_64-linux-gnu/libc.so.6(+0x7780e)[0x7fdcf18f580e]
snipsaisrv | /usr/lib/libsnips_kaldi.so(_ZN5kaldi12ParseOptions4ReadEiPKPKc+0xec)[0x7fdcf28414bc]
snipsaisrv | /usr/lib/libsnips_kaldi.so(_ZN5kaldi11ReadOptionsERNS_12ParseOptionsESt6vectorINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaIS8_EE+0x18d)[0x7fdcf27b08fd]
snipsaisrv | /usr/lib/libsnips_kaldi.so(_ZN5kaldi10NNet3Model15FinalizeLoadingEPK33OnlineIvectorExtractionParameters+0x4b5)[0x7fdcf27b0fb5]
snipsaisrv | /usr/lib/libsnips_kaldi.so(_ZN5kaldi24CreateNnet3ModelVersion2EPNS_19NnetModelParametersEPK33OnlineIvectorExtractionParametersRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESC_PSB_SD_SD_PKSt6vectorISt4pairIjSA_ESaISG_EEmb+0x2e3)[0x7fdcf2778de3]
snipsaisrv | /usr/lib/libsnips_kaldi.so(nnet3model_create_dynamic_v2+0x45d)[0x7fdcf270295d]
snipsaisrv | snips-asr(+0x2a6fc7)[0x55ea7433efc7]
snipsaisrv | snips-asr(+0x25348f)[0x55ea742eb48f]
snipsaisrv | snips-asr(+0x4bcc5)[0x55ea740e3cc5]
snipsaisrv | snips-asr(+0x52466)[0x55ea740ea466]
snipsaisrv | snips-asr(+0x3afe9a)[0x55ea74447e9a]
snipsaisrv | /lib/x86_64-linux-gnu/libpthread.so.0(+0x74a4)[0x7fdcf1e3b4a4]
snipsaisrv | /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7fdcf1966d0f]
snipsaisrv | ======= Memory map: ========
snipsaisrv | 55ea74098000-55ea7458f000 r-xp 00000000 fd:00 8521530                    /usr/bin/snips-asr
snipsaisrv | 55ea7478e000-55ea747c2000 r--p 004f6000 fd:00 8521530                    /usr/bin/snips-asr
snipsaisrv | 55ea747c2000-55ea747c3000 rw-p 0052a000 fd:00 8521530                    /usr/bin/snips-asr
snipsaisrv | 55ea74a1f000-55ea74a61000 rw-p 00000000 00:00 0                          [heap]
snipsaisrv | 7fdcd0000000-7fdcd0bdc000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcd0bdc000-7fdcd4000000 ---p 00000000 00:00 0
snipsaisrv | 7fdcd4000000-7fdcd4033000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcd4033000-7fdcd8000000 ---p 00000000 00:00 0
snipsaisrv | 7fdcd8000000-7fdcd8c23000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcd8c23000-7fdcdc000000 ---p 00000000 00:00 0
snipsaisrv | 7fdcdc000000-7fdcdcc23000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcdcc23000-7fdce0000000 ---p 00000000 00:00 0
snipsaisrv | 7fdce0000000-7fdce0c23000 rw-p 00000000 00:00 0
snipsaisrv | 7fdce0c23000-7fdce4000000 ---p 00000000 00:00 0
snipsaisrv | 7fdce4000000-7fdce4021000 rw-p 00000000 00:00 0
snipsaisrv | 7fdce4021000-7fdce8000000 ---p 00000000 00:00 0
snipsaisrv | 7fdce8000000-7fdce8021000 rw-p 00000000 00:00 0
snipsaisrv | 7fdce8021000-7fdcec000000 ---p 00000000 00:00 0
snipsaisrv | 7fdcef249000-7fdcef24a000 ---p 00000000 00:00 0
snipsaisrv | 7fdcef24a000-7fdcef44a000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcef44a000-7fdcef44b000 ---p 00000000 00:00 0
snipsaisrv | 7fdcef44b000-7fdcef64b000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcef64b000-7fdcef64c000 ---p 00000000 00:00 0
snipsaisrv | 7fdcef64c000-7fdcef84c000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcef84c000-7fdcef84d000 ---p 00000000 00:00 0
snipsaisrv | 7fdcef84d000-7fdcefa4d000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcefa4d000-7fdcefa4e000 ---p 00000000 00:00 0
snipsaisrv | 7fdcefa4e000-7fdcefc4e000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcefc4e000-7fdcefc4f000 ---p 00000000 00:00 0
snipsaisrv | 7fdcefc4f000-7fdcefe4f000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcefe4f000-7fdcefe59000 r-xp 00000000 fd:00 6029847                    /lib/x86_64-linux-gnu/libnss_files-2.24.so
snipsaisrv | 7fdcefe59000-7fdcf0059000 ---p 0000a000 fd:00 6029847                    /lib/x86_64-linux-gnu/libnss_files-2.24.so
snipsaisrv | 7fdcf0059000-7fdcf005a000 r--p 0000a000 fd:00 6029847                    /lib/x86_64-linux-gnu/libnss_files-2.24.so
snipsaisrv | 7fdcf005a000-7fdcf005b000 rw-p 0000b000 fd:00 6029847                    /lib/x86_64-linux-gnu/libnss_files-2.24.so
snipsaisrv | 7fdcf005b000-7fdcf0061000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcf0061000-7fdcf009f000 r-xp 00000000 fd:00 8660025                    /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
snipsaisrv | 7fdcf009f000-7fdcf029e000 ---p 0003e000 fd:00 8660025                    /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
snipsaisrv | 7fdcf029e000-7fdcf029f000 r--p 0003d000 fd:00 8660025                    /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
snipsaisrv | 7fdcf029f000-7fdcf02a0000 rw-p 0003e000 fd:00 8660025                    /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
snipsaisrv | 7fdcf02a0000-7fdcf02c0000 r-xp 00000000 fd:00 8656818                    /usr/lib/atlas-base/libf77blas.so.3.0
snipsaisrv | 7fdcf02c0000-7fdcf04bf000 ---p 00020000 fd:00 8656818                    /usr/lib/atlas-base/libf77blas.so.3.0
snipsaisrv | 7fdcf04bf000-7fdcf04c0000 r--p 0001f000 fd:00 8656818                    /usr/lib/atlas-base/libf77blas.so.3.0
snipsaisrv | 7fdcf04c0000-7fdcf04c1000 rw-p 00020000 fd:00 8656818                    /usr/lib/atlas-base/libf77blas.so.3.0
snipsaisrv | 7fdcf04c1000-7fdcf05e5000 r-xp 00000000 fd:00 8659935                    /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
snipsaisrv | 7fdcf05e5000-7fdcf07e4000 ---p 00124000 fd:00 8659935                    /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
snipsaisrv | 7fdcf07e4000-7fdcf07e5000 r--p 00123000 fd:00 8659935                    /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
snipsaisrv | 7fdcf07e5000-7fdcf07e7000 rw-p 00124000 fd:00 8659935                    /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0
snipsaisrv | 7fdcf07e7000-7fdcf0b73000 r-xp 00000000 fd:00 8656814                    /usr/lib/atlas-base/libatlas.so.3.0
snipsaisrv | 7fdcf0b73000-7fdcf0d72000 ---p 0038c000 fd:00 8656814                    /usr/lib/atlas-base/libatlas.so.3.0
snipsaisrv | 7fdcf0d72000-7fdcf0d76000 r--p 0038b000 fd:00 8656814                    /usr/lib/atlas-base/libatlas.so.3.0
snipsaisrv | 7fdcf0d76000-7fdcf0d7a000 rw-p 0038f000 fd:00 8656814                    /usr/lib/atlas-base/libatlas.so.3.0
snipsaisrv | 7fdcf0d7a000-7fdcf0eec000 r-xp 00000000 fd:00 6030561                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
snipsaisrv | 7fdcf0eec000-7fdcf10ec000 ---p 00172000 fd:00 6030561                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
snipsaisrv | 7fdcf10ec000-7fdcf10f6000 r--p 00172000 fd:00 6030561                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
snipsaisrv | 7fdcf10f6000-7fdcf10f8000 rw-p 0017c000 fd:00 6030561                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
snipsaisrv | 7fdcf10f8000-7fdcf10fc000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcf10fc000-7fdcf1157000 r-xp 00000000 fd:00 8656820                    /usr/lib/atlas-base/liblapack_atlas.so.3.0
snipsaisrv | 7fdcf1157000-7fdcf1356000 ---p 0005b000 fd:00 8656820                    /usr/lib/atlas-base/liblapack_atlas.so.3.0
snipsaisrv | 7fdcf1356000-7fdcf1357000 r--p 0005a000 fd:00 8656820                    /usr/lib/atlas-base/liblapack_atlas.so.3.0
snipsaisrv | 7fdcf1357000-7fdcf1358000 rw-p 0005b000 fd:00 8656820                    /usr/lib/atlas-base/liblapack_atlas.so.3.0
snipsaisrv | 7fdcf1358000-7fdcf1379000 r-xp 00000000 fd:00 8656816                    /usr/lib/atlas-base/libcblas.so.3.0
snipsaisrv | 7fdcf1379000-7fdcf1578000 ---p 00021000 fd:00 8656816                    /usr/lib/atlas-base/libcblas.so.3.0
snipsaisrv | 7fdcf1578000-7fdcf1579000 r--p 00020000 fd:00 8656816                    /usr/lib/atlas-base/libcblas.so.3.0
snipsaisrv | 7fdcf1579000-7fdcf157a000 rw-p 00021000 fd:00 8656816                    /usr/lib/atlas-base/libcblas.so.3.0
snipsaisrv | 7fdcf157a000-7fdcf167d000 r-xp 00000000 fd:00 6029832                    /lib/x86_64-linux-gnu/libm-2.24.so
snipsaisrv | 7fdcf167d000-7fdcf187c000 ---p 00103000 fd:00 6029832                    /lib/x86_64-linux-gnu/libm-2.24.so
snipsaisrv | 7fdcf187c000-7fdcf187d000 r--p 00102000 fd:00 6029832                    /lib/x86_64-linux-gnu/libm-2.24.so
snipsaisrv | 7fdcf187d000-7fdcf187e000 rw-p 00103000 fd:00 6029832                    /lib/x86_64-linux-gnu/libm-2.24.so
snipsaisrv | 7fdcf187e000-7fdcf1a13000 r-xp 00000000 fd:00 6029807                    /lib/x86_64-linux-gnu/libc-2.24.so
snipsaisrv | 7fdcf1a13000-7fdcf1c13000 ---p 00195000 fd:00 6029807                    /lib/x86_64-linux-gnu/libc-2.24.so
snipsaisrv | 7fdcf1c13000-7fdcf1c17000 r--p 00195000 fd:00 6029807                    /lib/x86_64-linux-gnu/libc-2.24.so
snipsaisrv | 7fdcf1c17000-7fdcf1c19000 rw-p 00199000 fd:00 6029807                    /lib/x86_64-linux-gnu/libc-2.24.so
snipsaisrv | 7fdcf1c19000-7fdcf1c1d000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcf1c1d000-7fdcf1c33000 r-xp 00000000 fd:00 6029825                    /lib/x86_64-linux-gnu/libgcc_s.so.1
snipsaisrv | 7fdcf1c33000-7fdcf1e32000 ---p 00016000 fd:00 6029825                    /lib/x86_64-linux-gnu/libgcc_s.so.1
snipsaisrv | 7fdcf1e32000-7fdcf1e33000 r--p 00015000 fd:00 6029825                    /lib/x86_64-linux-gnu/libgcc_s.so.1
snipsaisrv | 7fdcf1e33000-7fdcf1e34000 rw-p 00016000 fd:00 6029825                    /lib/x86_64-linux-gnu/libgcc_s.so.1
snipsaisrv | 7fdcf1e34000-7fdcf1e4c000 r-xp 00000000 fd:00 6029864                    /lib/x86_64-linux-gnu/libpthread-2.24.so
snipsaisrv | 7fdcf1e4c000-7fdcf204b000 ---p 00018000 fd:00 6029864                    /lib/x86_64-linux-gnu/libpthread-2.24.so
snipsaisrv | 7fdcf204b000-7fdcf204c000 r--p 00017000 fd:00 6029864                    /lib/x86_64-linux-gnu/libpthread-2.24.so
snipsaisrv | 7fdcf204c000-7fdcf204d000 rw-p 00018000 fd:00 6029864                    /lib/x86_64-linux-gnu/libpthread-2.24.so
snipsaisrv | 7fdcf204d000-7fdcf2051000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcf2051000-7fdcf2058000 r-xp 00000000 fd:00 6029868                    /lib/x86_64-linux-gnu/librt-2.24.so
snipsaisrv | 7fdcf2058000-7fdcf2257000 ---p 00007000 fd:00 6029868                    /lib/x86_64-linux-gnu/librt-2.24.so
snipsaisrv | 7fdcf2257000-7fdcf2258000 r--p 00006000 fd:00 6029868                    /lib/x86_64-linux-gnu/librt-2.24.so
snipsaisrv | 7fdcf2258000-7fdcf2259000 rw-p 00007000 fd:00 6029868                    /lib/x86_64-linux-gnu/librt-2.24.so
snipsaisrv | 7fdcf2259000-7fdcf225c000 r-xp 00000000 fd:00 6029817                    /lib/x86_64-linux-gnu/libdl-2.24.so
snipsaisrv | 7fdcf225c000-7fdcf245b000 ---p 00003000 fd:00 6029817                    /lib/x86_64-linux-gnu/libdl-2.24.so
snipsaisrv | 7fdcf245b000-7fdcf245c000 r--p 00002000 fd:00 6029817                    /lib/x86_64-linux-gnu/libdl-2.24.so
snipsaisrv | 7fdcf245c000-7fdcf245d000 rw-p 00003000 fd:00 6029817                    /lib/x86_64-linux-gnu/libdl-2.24.so
snipsaisrv | 7fdcf245d000-7fdcf2cc1000 r-xp 00000000 fd:00 8657307                    /usr/lib/libsnips_kaldi.so
snipsaisrv | 7fdcf2cc1000-7fdcf2ec1000 ---p 00864000 fd:00 8657307                    /usr/lib/libsnips_kaldi.so
snipsaisrv | 7fdcf2ec1000-7fdcf2eda000 r--p 00864000 fd:00 8657307                    /usr/lib/libsnips_kaldi.so
snipsaisrv | 7fdcf2eda000-7fdcf2ee4000 rw-p 0087d000 fd:00 8657307                    /usr/lib/libsnips_kaldi.so
snipsaisrv | 7fdcf2ee4000-7fdcf2ee5000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcf2ee5000-7fdcf2f08000 r-xp 00000000 fd:00 6029789                    /lib/x86_64-linux-gnu/ld-2.24.so
snipsaisrv | 7fdcf30e7000-7fdcf3108000 rw-p 00000000 00:00 0
snipsaisrv | 7fdcf3108000-7fdcf3109000 r--p 00023000 fd:00 6029789                    /lib/x86_64-linux-gnu/ld-2.24.so
snipsaisrv | 7fdcf3109000-7fdcf310a000 rw-p 00024000 fd:00 6029789                    /lib/x86_64-linux-gnu/ld-2.24.so
snipsaisrv | 7fdcf310a000-7fdcf310b000 rw-p 00000000 00:00 0
snipsaisrv | 7fffa2a5e000-7fffa2a7f000 rw-p 00000000 00:00 0                          [stack]
snipsaisrv | 7fffa2ad3000-7fffa2ad6000 r--p 00000000 00:00 0                          [vvar]
snipsaisrv | 7fffa2ad6000-7fffa2ad7000 r-xp 00000000 00:00 0                          [vdso]
snipsaisrv | ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
snipsaisrv | INFO:snips_nlu_lib::resources::loading                          : Stemmer loaded
snipsaisrv | INFO:snips_nlu_lib::resources::loading                          : Loading gazetteer 'top_200000_words_stemmed' ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/resources/de/gazetteers/top_200000_words_stemmed.txt") ...
snipsaisrv | INFO:snips_nlu_lib::resources::loading                          : Gazetteer 'top_200000_words_stemmed' loaded
snipsaisrv | INFO:snips_nlu_lib::resources::loading                          : Loading stop words ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/resources/de/stop_words.txt") ...
snipsaisrv | INFO:snips_nlu_lib::resources::loading                          : Stop words loaded
snipsaisrv | INFO:snips_nlu_lib::entity_parser::builtin_entity_parser        : Loading builtin entity parser ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/builtin_entity_parser") ...
snipsaisrv | INFO:snips_nlu_lib::entity_parser::builtin_entity_parser        : Builtin entity parser loaded
snipsaisrv | INFO:snips_nlu_lib::entity_parser::custom_entity_parser         : Loading custom entity parser ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/custom_entity_parser") ...
snipsaisrv | INFO:snips_nlu_lib::entity_parser::custom_entity_parser         : Custom entity parser loaded
snipsaisrv | INFO:snips_nlu_lib::intent_parser::deterministic_intent_parser  : Loading deterministic intent parser ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/deterministic_intent_parser") ...
snipsaisrv | INFO:snips_nlu_lib::intent_parser::deterministic_intent_parser  : Deterministic intent parser loaded
snipsaisrv | INFO:snips_nlu_lib::intent_classifier::log_reg_intent_classifier: Loading log reg intent classifier ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/intent_classifier") ...
snipsaisrv | INFO:snips_nlu_lib::intent_classifier::log_reg_intent_classifier: Log reg intent classifier loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_0") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_1") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_2") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_3") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_4") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_5") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_6") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_7") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_8") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_9") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_10") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : Loading CRF slot filler ("/var/lib/snips/injections/20190718T033501893861239/inj_20190718T033518084044818/nlu_engine/probabilistic_intent_parser/slot_filler_11") ...
snipsaisrv | INFO:snips_nlu_lib::slot_filler::crf_slot_filler                : CRF slot filler loaded
snipsaisrv | INFO:snips_nlu_hermes                                           : model loaded in 331 ms

I´m going to try the workaround mentioned by @cpoisson and will feedback later.

Update: The workaround did the trick. Thank you!

@cpoisson cpoisson removed the ASR label Aug 2, 2019
@cpoisson

This comment has been minimized.

Copy link
Collaborator

commented Aug 7, 2019

👍 The next release will fix this crash.

@cpoisson cpoisson added the sub: asr label Sep 12, 2019
@cpoisson

This comment has been minimized.

Copy link
Collaborator

commented Oct 2, 2019

Fixed in version 1.3.0

@cpoisson cpoisson closed this Oct 2, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants
You can’t perform that action at this time.