lwa

Forum Replies Created

Viewing 1 post (of 1 total)
Advertisement: “RuleORama is an OpenEars™ plugin that lets you create rules-based grammars for fixed phrase recognition, fast enough for RapidEars!”

  • Author
    Posts
  • July 24, 2013 at 7:56 pm in reply to: Audio driver issues in combination with AirPlay #1017754
    lwa
    Participant

    Hi there!

    I’m encountering the exact same problem when using OpenEars with AirPlay. Everything will be working fine and then the mic metering level gets stuck, just as described by OP.

    I did create a method that detects when the mic input level is stuck and attempts to stopListening and then restart the listen loop. However it still sometimes results in a crash after a few failed attempts to start listening.

    Using OpenEars 1.3.1.

    Can you explain again what you think the problem is? If we are having some sort of buffer underrun is there something we can do to recover from this without restarting the recognition loop?

    This thread has already been a big help, thanks for all you do!

    Here’s some of the console output I get during the crash with openEarsLogging turned on:

    // log begins during speech detection, everything is working, my comments after double forward slashes (//)

    2013-07-24 12:38:19:459 MYApp[26052:6659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-94.7090 _lastDBLevel:-94.7090 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:19:557 MYApp[26052:6403] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-94.9730 _lastDBLevel:-94.9730 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:19:656 MYApp[26052:6403] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-94.8460 _lastDBLevel:-94.8460 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:19:758 MYApp[26052:6403] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-94.4064 _lastDBLevel:-94.4064 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:19:909 MYApp[26052:6403] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.0656 _lastDBLevel:-95.0656 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:20:007 MYApp[26052:6403] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.9674 _lastDBLevel:-95.9674 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:20:106 MYApp[26052:6403] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-96.2689 _lastDBLevel:-96.2689 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:20.135 MYApp[26052:19617] Stopping audio unit.
    2013-07-24 12:38:20:162 MYApp[26052:2311] -[ABVoiceController pocketsphinxDidDetectFinishedSpeech] [Line 1931] Pocketsphinx has detected a second of silence, concluding an utterance.
    2013-07-24 12:38:20.320 MYApp[26052:19617] Audio Output Unit stopped, cleaning up variable states.
    2013-07-24 12:38:20.321 MYApp[26052:19617] Processing speech, please wait...
    INFO: cmn_prior.c(121): cmn_prior_update: from < 47.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 >
    INFO: cmn_prior.c(139): cmn_prior_update: to < 57.36 1.00 -0.51 -0.90 -3.25 -1.78 -1.20 -0.18 -0.32 -0.49 -0.66 -0.13 -0.73 >
    INFO: ngram_search_fwdtree.c(1549): 3679 words recognized (11/fr)
    INFO: ngram_search_fwdtree.c(1551): 395354 senones evaluated (1133/fr)
    INFO: ngram_search_fwdtree.c(1553): 210247 channels searched (602/fr), 48472 1st, 57139 last
    INFO: ngram_search_fwdtree.c(1557): 6451 words for which last channels evaluated (18/fr)
    INFO: ngram_search_fwdtree.c(1560): 13560 candidate words for entering last phone (38/fr)
    INFO: ngram_search_fwdtree.c(1562): fwdtree 4.82 CPU 1.380 xRT
    INFO: ngram_search_fwdtree.c(1565): fwdtree 4.34 wall 1.245 xRT
    INFO: ngram_search_fwdflat.c(302): Utterance vocabulary contains 43 words
    INFO: ngram_search_fwdflat.c(937): 1396 words recognized (4/fr)
    INFO: ngram_search_fwdflat.c(939): 142302 senones evaluated (408/fr)
    INFO: ngram_search_fwdflat.c(941): 109974 channels searched (315/fr)
    INFO: ngram_search_fwdflat.c(943): 5548 words searched (15/fr)
    INFO: ngram_search_fwdflat.c(945): 3994 word transitions (11/fr)
    INFO: ngram_search_fwdflat.c(948): fwdflat 0.92 CPU 0.265 xRT
    INFO: ngram_search_fwdflat.c(951): fwdflat 0.63 wall 0.181 xRT
    INFO: ngram_search.c(1266): lattice start node <s>.0 end node </s>.338
    INFO: ngram_search.c(1294): Eliminated 0 nodes before end node
    INFO: ngram_search.c(1399): Lattice has 199 nodes, 233 links
    INFO: ps_lattice.c(1367): Normalizer P(O) = alpha(</s>:338:347) = -2171041
    INFO: ps_lattice.c(1405): Joint P(O,S) = -2185482 P(S|O) = -14441
    INFO: ngram_search.c(888): bestpath 0.01 CPU 0.004 xRT
    INFO: ngram_search.c(891): bestpath 0.01 wall 0.004 xRT
    2013-07-24 12:38:20.990 MYApp[26052:19617] Pocketsphinx heard "THREE TWO ZERO TURN LEFT HEADING ZERO NINER ZERO" with a score of (-14441) and an utterance ID of 000000000.
    2013-07-24 12:38:21.004 MYApp[26052:907] Flite sending interrupt speech request.
    2013-07-24 12:38:21.012 MYApp[26052:19617] Checking and resetting all audio session settings.
    2013-07-24 12:38:21.014 MYApp[26052:19617] audioCategory is correct, we will leave it as it is.
    2013-07-24 12:38:21.016 MYApp[26052:19617] bluetoothInput is correct, we will leave it as it is.
    2013-07-24 12:38:21.017 MYApp[26052:19617] categoryDefaultToSpeaker is correct, we will leave it as it is.
    2013-07-24 12:38:21.018 MYApp[26052:19617] preferredBufferSize is correct, we will leave it as it is.
    2013-07-24 12:38:21.019 MYApp[26052:19617] preferredSampleRateCheck is correct, we will leave it as it is.
    2013-07-24 12:38:21.020 MYApp[26052:19617] Setting the variables for the device and starting it.
    2013-07-24 12:38:21.022 MYApp[26052:19617] Looping through ringbuffer sections and pre-allocating them.
    2013-07-24 12:38:21.025 MYApp[26052:19617] Started audio output unit.
    2013-07-24 12:38:21.027 MYApp[26052:19617] Listening.
    2013-07-24 12:38:21:038 MYApp[26052:2311] -[ABVoiceController pocketsphinxDidStartListening] [Line 1900] Pocketsphinx is now listening.
    2013-07-24 12:38:21:043 MYApp[26052:2311] -[ABVoiceController pocketsphinxDidSuspendRecognition] [Line 1957] Pocketsphinx has suspended recognition.
    2013-07-24 12:38:21:733 MYApp[26052:2311] -[ABVoiceController foundBestCommands:] [Line 559] BestHypothesis found at 0:THREE TWO ZERO TURN LEFT HEADING ZERO NINER ZERO
    2013-07-24 12:38:22:919 MYApp[26052:2311] -[ABVoiceController pocketsphinxDidResumeRecognition] [Line 1977] Pocketsphinx has resumed recognition.
    2013-07-24 12:38:22:927 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.1051 _lastDBLevel:-95.1051 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:23:071 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-94.6765 _lastDBLevel:-94.6765 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:23:170 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.5424 _lastDBLevel:-95.5424 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:23:270 MYApp[26052:6659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-93.9535 _lastDBLevel:-93.9535 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:23:374 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-93.3490 _lastDBLevel:-93.3490 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:23:470 MYApp[26052:6659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-92.5605 _lastDBLevel:-92.5605 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:23:572 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-62.6581 _lastDBLevel:-62.6581 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:23:721 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-120.0000 _lastDBLevel:-120.0000 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:23.753 MYApp[26052:19617] Speech detected...
    2013-07-24 12:38:23:766 MYApp[26052:2311] -[ABVoiceController pocketsphinxDidDetectSpeech] [Line 1921] Pocketsphinx has detected speech.
    2013-07-24 12:38:23:772 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-120.0000 _lastDBLevel:-120.0000 numberOfUpdatesWhereDBHasNotChanged:2
    2013-07-24 12:38:23:820 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-120.0000 _lastDBLevel:-120.0000 numberOfUpdatesWhereDBHasNotChanged:3
    2013-07-24 12:38:23:922 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-82.6187 _lastDBLevel:-82.6187 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:24:022 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-66.8673 _lastDBLevel:-66.8673 numberOfUpdatesWhereDBHasNotChanged:1

    // ... snip

    numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:075 MYApp[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6743 _lastDBLevel:-95.6743 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:219 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-94.7920 _lastDBLevel:-94.7920 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:323 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.3689 _lastDBLevel:-95.3689 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:420 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-93.7682 _lastDBLevel:-93.7682 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:519 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-94.6447 _lastDBLevel:-94.6447 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:620 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6000 _lastDBLevel:-95.6000 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:727 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.4275 _lastDBLevel:-95.4275 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:869 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:30:920 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:2
    2013-07-24 12:38:30:970 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:3
    2013-07-24 12:38:31:022 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:4
    2013-07-24 12:38:31:071 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:5

    /// STUCK INPUT LEVEL!!

    2013-07-24 12:38:31:120 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:6
    2013-07-24 12:38:41.622 MYApp[26052:19617] Stopping audio unit.
    2013-07-24 12:38:41:624 MYApp[26052:2311] -[ABVoiceController pocketsphinxDidSuspendRecognition] [Line 1957] Pocketsphinx has suspended recognition.
    2013-07-24 12:38:41.812 MYApp[26052:19617] Audio Output Unit stopped, cleaning up variable states.
    2013-07-24 12:38:41.813 MYApp[26052:19617] Processing speech, please wait...
    INFO: cmn_prior.c(121): cmn_prior_update: from < 54.14 1.28 -0.52 -0.77 -2.78 -1.89 -1.16 -0.37 -0.11 -0.45 -0.44 -0.19 -0.62 >
    INFO: cmn_prior.c(139): cmn_prior_update: to < 49.66 0.98 -0.34 -0.43 -2.22 -1.67 -0.90 -0.65 -0.23 -0.37 -0.32 -0.23 -0.58 >
    INFO: ngram_search_fwdtree.c(1549): 6883 words recognized (10/fr)
    INFO: ngram_search_fwdtree.c(1551): 728982 senones evaluated (1027/fr)
    INFO: ngram_search_fwdtree.c(1553): 352874 channels searched (497/fr), 99277 1st, 51002 last
    INFO: ngram_search_fwdtree.c(1557): 11534 words for which last channels evaluated (16/fr)
    INFO: ngram_search_fwdtree.c(1560): 18842 candidate words for entering last phone (26/fr)
    INFO: ngram_search_fwdtree.c(1562): fwdtree 16.74 CPU 2.357 xRT
    INFO: ngram_search_fwdtree.c(1565): fwdtree 18.20 wall 2.564 xRT
    INFO: ngram_search_fwdflat.c(302): Utterance vocabulary contains 40 words
    INFO: ngram_search_fwdflat.c(937): 1836 words recognized (3/fr)
    INFO: ngram_search_fwdflat.c(939): 109907 senones evaluated (155/fr)
    INFO: ngram_search_fwdflat.c(941): 85776 channels searched (120/fr)
    INFO: ngram_search_fwdflat.c(943): 5339 words searched (7/fr)
    INFO: ngram_search_fwdflat.c(945): 3361 word transitions (4/fr)
    INFO: ngram_search_fwdflat.c(948): fwdflat 1.03 CPU 0.145 xRT
    INFO: ngram_search_fwdflat.c(951): fwdflat 0.63 wall 0.089 xRT
    2013-07-24 12:38:42.462 MYApp[26052:19617] Checking and resetting all audio session settings.
    2013-07-24 12:38:42.465 MYApp[26052:19617] audioCategory is correct, we will leave it as it is.
    2013-07-24 12:38:42.467 MYApp[26052:19617] bluetoothInput is correct, we will leave it as it is.
    2013-07-24 12:38:42.469 MYApp[26052:19617] categoryDefaultToSpeaker is correct, we will leave it as it is.
    2013-07-24 12:38:42.470 MYApp[26052:19617] preferredBufferSize is correct, we will leave it as it is.
    2013-07-24 12:38:42.471 MYApp[26052:19617] preferredSampleRateCheck is correct, we will leave it as it is.
    2013-07-24 12:38:42.472 MYApp[26052:19617] Setting the variables for the device and starting it.
    2013-07-24 12:38:42.473 MYApp[26052:19617] Looping through ringbuffer sections and pre-allocating them.
    2013-07-24 12:38:42:909 MYApp[26052:2311] -[ABVoiceController pocketsphinxDidResumeRecognition] [Line 1977] Pocketsphinx has resumed recognition.

    // ABLE TO RESUME RECOGNITION AGAIN

    2013-07-24 12:38:42:910 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:1
    2013-07-24 12:38:42:964 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:2
    2013-07-24 12:38:43:010 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:3
    2013-07-24 12:38:43:061 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:4
    2013-07-24 12:38:43:114 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:5
    2013-07-24 12:38:43:160 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:6
    2013-07-24 12:38:43:209 MYApp[26052:102227] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427

    // ... snip ...

    2013-07-24 12:38:47:410 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:3
    2013-07-24 12:38:47:471 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:4
    2013-07-24 12:38:47:510 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:5
    2013-07-24 12:38:47:561 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:6
    2013-07-24 12:38:47:610 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:7
    2013-07-24 12:38:47:664 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:8

    // UNTIL EVENTUALLY IT CRASHES

    2013-07-24 12:38:47.692 ATCVoice[26052:19617] 12:38:47.692 <0x6b8c000> AUIOClient_StartIO failed (2003329396)
    2013-07-24 12:38:47.693 ATCVoice[26052:19617] Couldn't start audio unit output: 2003329396
    2013-07-24 12:38:47.694 ATCVoice[26052:19617] startRecording failed
    2013-07-24 12:38:47.695 ATCVoice[26052:19617] Listening.
    2013-07-24 12:38:47.696 ATCVoice[26052:19617] cont_ad_read failed
    2013-07-24 12:38:47:707 ATCVoice[26052:2311] -[ABPTTButtonMenuItemImage pocketSphinxContinuousSetupDidFail] [Line 350] pocketSphinxContinuousSetupDidFail in ABPTTButtonMenuImage
    2013-07-24 12:38:57:484 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:9
    2013-07-24 12:38:57:489 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:10
    2013-07-24 12:38:57:509 ATCVoice[26052:102659] -[ABPTTButtonMenuItemImage updateMetering] [Line 118] dbLevel:-95.6427 _lastDBLevel:-95.6427 numberOfUpdatesWhereDBHasNotChanged:11
    INFO: ngram_search_fwdtree.c(430): TOTAL fwdtree 21.55 CPU 2.039 xRT
    INFO: ngram_search_fwdtree.c(433): TOTAL fwdtree 22.55 wall 2.133 xRT
    INFO: ngram_search_fwdflat.c(174): TOTAL fwdflat 1.95 CPU 0.185 xRT
    INFO: ngram_search_fwdflat.c(177): TOTAL fwdflat 1.26 wall 0.120 xRT
    INFO: ngram_search.c(317): TOTAL bestpath 0.01 CPU 0.001 xRT
    INFO: ngram_search.c(320): TOTAL bestpath 0.01 wall 0.001 xRT
    ATCVoice(26052,0x6b8c000) malloc: *** error for object 0x87c087c: pointer being freed was not allocated
    *** set a breakpoint in malloc_error_break to debug

  • Author
    Posts
Viewing 1 post (of 1 total)