Reply To: OpenEars doesn't stop recognition loop immediately on iPhone 4

Home Forums OpenEars OpenEars doesn't stop recognition loop immediately on iPhone 4 Reply To: OpenEars doesn't stop recognition loop immediately on iPhone 4

#1021158
Harz
Participant

Thanks a lot for your help. We appreciate your advice and suggestions. Soon we’ll regenerate our model to 8kHz and test performance again. In any way it will be nice to realize possibility to stop delayed recognition, because it’s don’t take any sense, but spend too much time. Here is log from iPhone 4. As you can see, delay between sending stopListenning and actually it’s stopping is about 3 minutes.

2014-05-07 16:36:59.904 MyApp[2864:907] ‘Open Ears’ has been Initialized
2014-05-07 16:36:59.924 MyApp[2864:907] Starting OpenEars logging for OpenEars version 1.7 on 32-bit device: iPhone running iOS version: 6.100000
2014-05-07 16:37:01.531 MyApp[2864:907] Bundle Name : Model
2014-05-07 16:37:01.534 MyApp[2864:907] OE Ext : Model Path is /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle
2014-05-07 16:37:01.537 MyApp[2864:907] OE Ext : Model Path is /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle
2014-05-07 16:37:01.563 MyApp[2864:907] Accuracy set to 10.
2014-05-07 16:37:01.566 MyApp[2864:907] OE Ext : Model Path is /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle
2014-05-07 16:37:01.573 MyApp[2864:907] setting sample rate to 16000
2014-05-07 16:37:01.584 MyApp[2864:907] The audio session has never been initialized so we will do that now.
2014-05-07 16:37:01.585 MyApp[2864:907] Checking and resetting all audio session settings.
2014-05-07 16:37:01.588 MyApp[2864:907] audioCategory is incorrect, we will change it.
2014-05-07 16:37:01.590 MyApp[2864:907] audioCategory is now on the correct setting of kAudioSessionCategory_PlayAndRecord.
2014-05-07 16:37:01.592 MyApp[2864:907] bluetoothInput is incorrect, we will change it.
2014-05-07 16:37:01.593 MyApp[2864:907] bluetooth input is now on the correct setting of 1.
2014-05-07 16:37:01.596 MyApp[2864:907] Output Device: ReceiverAndMicrophone.
2014-05-07 16:37:01.601 MyApp[2864:907] categoryDefaultToSpeaker is incorrect, we will change it.
2014-05-07 16:37:01.603 MyApp[2864:907] CategoryDefaultToSpeaker is now on the correct setting of 1.
2014-05-07 16:37:01.605 MyApp[2864:907] preferredBufferSize is incorrect, we will change it.
2014-05-07 16:37:01.607 MyApp[2864:907] PreferredBufferSize is now on the correct setting of 0.128000.
2014-05-07 16:37:01.609 MyApp[2864:907] preferredSampleRateCheck is incorrect, we will change it.
2014-05-07 16:37:01.651 MyApp[2864:907] preferred hardware sample rate is now on the correct setting of 16000.000000.
2014-05-07 16:37:01.756 MyApp[2864:907] AudioSessionManager startAudioSession has reached the end of the initialization.
2014-05-07 16:37:01.758 MyApp[2864:907] Exiting startAudioSession.
2014-05-07 16:37:01.772 MyApp[2864:5c03] setSecondsOfSilence value of 0.000000 was too large or too small or was NULL, using default of 0.700000.
2014-05-07 16:37:01.813 MyApp[2864:5c03] Project has these words or phrases in its dictionary:
[del]
…and 2775 more.
2014-05-07 16:37:01.819 MyApp[2864:5c03] Recognition loop has started
2014-05-07 16:37:01.884 MyApp[2864:907] Audio route has changed for the following reason:
2014-05-07 16:37:01.885 MyApp[2864:907] There has been a change of category
2014-05-07 16:37:01.887 MyApp[2864:907] The previous audio route was Speaker
2014-05-07 16:37:01.900 MyApp[2864:907] This is not a case in which OpenEars performs a route change voluntarily. At the close of this function, the audio route is SpeakerAndMicrophone
INFO: file_omitted(0): Parsing command line:
\
-lm /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle/base.lm.dmp \
-dict /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle/base.dic \
-hmm /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle \
-lw 6.5 \
-samprate 16000 \
-rawlogdir /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Library/Caches

Current configuration:
[NAME] [DEFLT] [VALUE]
-adchdr 0 0
-adcin no no
-agc none none
-agcthresh 2.0 2.000000e+00
-align
-alpha 0.97 9.700000e-01
-arcdumpdir
-ascale 20.0 2.000000e+01
-aw 1 1
-backtrace no no
-beam 1e-48 1.000000e-48
-bestpath yes yes
-bestpathlw 9.5 9.500000e+00
-bghist no no
-cepdir
-cepext .mfc .mfc
-ceplen 13 13
-cmn current current
-cmninit 8.0 8.0
-compallsen no no
-ctl
-ctlcount -1 -1
-ctlincr 1 1
-ctloffset 0 0
-debug 0
-dict /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle/base.dic
-dictcase no no
-dither no no
-doublebw no no
-ds 1 1
-fdict
-feat 1s_c_d_dd 1s_c_d_dd
-featparams
-fillprob 1e-8 1.000000e-08
-frate 100 100
-fsg
-fsgusealtpron yes yes
-fsgusefiller yes yes
-fwdflat yes yes
-fwdflatbeam 1e-64 1.000000e-64
-fwdflatlw 8.5 8.500000e+00
-fwdflatsfwin 25 25
-fwdflatwbeam 7e-29 7.000000e-29
-fwdtree yes yes
-fwdtreelm
-hmm /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle
-hyp
-hypprefix
-input_endian little little
-jsgf
-kdmaxbbi -1 -1
-kdmaxdepth 0 0
-kdtree
-latsize 512 512
-lda
-ldadim 0 0
-lextreedump 0 0
-lifter 0 0
-lm /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle/base.lm.dmp
-lmctl
-lmname default default
-logbase 1.0001 1.000100e+00
-logfn
-logspec no no
-lowerf 133.33334 1.333333e+02
-lpbeam 1e-40 1.000000e-40
-lponlybeam 7e-29 7.000000e-29
-lw 6.5 6.500000e+00
-maxhmmpf -1 -1
-maxnewoov 20 20
-maxsilfr -1 -1
-maxwpf 50 50
-mdef
-mean
-mfclogdir
-min_endfr 0 0
-mixw
-mixwfloor 0.0000001 1.000000e-07
-mllr
-mmap yes yes
-ncep 13 13
-nfft 512 512
-nfilt 40 40
-nwpen 1.0 1.000000e+00
-pbeam 1e-48 1.000000e-48
-pip 1.0 1.000000e+00
-pl_beam 1e-10 1.000000e-10
-pl_pbeam 1e-5 1.000000e-05
-pl_window 0 0
-rawlogdir /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Library/Caches
-remove_dc no no
-round_filters yes yes
-samprate 16000 1.600000e+04
-seed -1 -1
-sendump
-senlogdir
-senmgau
-silprob 0.005 5.000000e-03
-smoothspec no no
-svspec
-tmat
-tmatfloor 0.0001 1.000000e-04
-topn 4 4
-topn_beam 0 0
-toprule
-transform legacy legacy
-unit_area yes yes
-upperf 6855.4976 6.855498e+03
-usewdphones no no
-uw 1.0 1.000000e+00
-var
-varfloor 0.0001 1.000000e-04
-varnorm no no
-verbose no no
-vm
-warp_params
-warp_type inverse_linear inverse_linear
-wbeam 7e-29 7.000000e-29
-wip 0.65 6.500000e-01
-wlen 0.025625 2.562500e-02

INFO: file_omitted(0): Parsing command line:
\
-nfilt 40 \
-lowerf 133.3334 \
-upperf 6855.4976 \
-feat s2_4x \
-agc none \
-cmn current \
-varnorm no \
-fwdflat yes

Current configuration:
[NAME] [DEFLT] [VALUE]
-agc none none
-agcthresh 2.0 2.000000e+00
-alpha 0.97 9.700000e-01
-ceplen 13 13
-cmn current current
-cmninit 8.0 8.0
-dither no no
-doublebw no no
-feat 1s_c_d_dd s2_4x
-frate 100 100
-input_endian little little
-lda
-ldadim 0 0
-lifter 0 0
-logspec no no
-lowerf 133.33334 1.333334e+02
-ncep 13 13
-nfft 512 512
-nfilt 40 40
-remove_dc no no
-round_filters yes yes
-samprate 16000 1.600000e+04
-seed -1 -1
-smoothspec no no
-svspec
-transform legacy legacy
-unit_area yes yes
-upperf 6855.4976 6.855498e+03
-varnorm no no
-verbose no no
-warp_params
-warp_type inverse_linear inverse_linear
-wlen 0.025625 2.562500e-02

INFO: file_omitted(0): Parsed model-specific feature parameters from /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle/feat.params
INFO: file_omitted(0): Reading HMM transition probability matrices: /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle/transition_matrices
INFO: file_omitted(0): Loading senones from dump file /var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/Model.bundle/sendump
INFO: file_omitted(0): BEGIN FILE FORMAT DESCRIPTION
INFO: file_omitted(0): Rows: 64, Columns: 6147
INFO: file_omitted(0): Using memory-mapped I/O for senones
INFO: file_omitted(0): Building PID tables for dictionary
INFO: file_omitted(0): Allocating 49^3 * 2 bytes (229 KiB) for word-initial triphones
INFO: file_omitted(0): Allocated 29008 bytes (28 KiB) for word-final triphones
INFO: file_omitted(0): Allocated 29008 bytes (28 KiB) for single-phone word triphones
INFO: file_omitted(0): No \data\ mark in LM file
INFO: file_omitted(0): Number of word mappings: 2522
INFO: file_omitted(0): Number of word mappings: 2522
INFO: file_omitted(0): Initialized arc buffer ‘fwdtree’, each arc occupies 12 bytes
2014-05-07 16:37:05.653 MyApp[2864:5c03] Warning: There is a request to use pathToTestFile but there isn’t a usable file at the location given (“/var/mobile/Applications/A786BFDD-68F9-4FAF-A535-47561B580771/Documents/test.wav”) so the live microphone will be used instead.
2014-05-07 16:37:05.662 MyApp[2864:5c03] Starting openAudioDevice on the device.
2014-05-07 16:37:05.666 MyApp[2864:5c03] Audio unit wrapper successfully created.
2014-05-07 16:37:05.678 MyApp[2864:5c03] Set audio route to SpeakerAndMicrophone
2014-05-07 16:37:05.683 MyApp[2864:5c03] Checking and resetting all audio session settings.
2014-05-07 16:37:05.687 MyApp[2864:5c03] audioCategory is correct, we will leave it as it is.
2014-05-07 16:37:05.692 MyApp[2864:5c03] bluetoothInput is correct, we will leave it as it is.
2014-05-07 16:37:05.696 MyApp[2864:5c03] Output Device: SpeakerAndMicrophone.
2014-05-07 16:37:05.700 MyApp[2864:5c03] categoryDefaultToSpeaker is correct, we will leave it as it is.
2014-05-07 16:37:05.704 MyApp[2864:5c03] preferredBufferSize is correct, we will leave it as it is.
2014-05-07 16:37:05.709 MyApp[2864:5c03] preferredSampleRateCheck is correct, we will leave it as it is.
2014-05-07 16:37:05.713 MyApp[2864:5c03] Setting the variables for the device and starting it.
2014-05-07 16:37:05.716 MyApp[2864:5c03] Looping through ringbuffer sections and pre-allocating them.
2014-05-07 16:37:06.316 MyApp[2864:5c03] Started audio output unit.
2014-05-07 16:37:06.319 MyApp[2864:5c03] Calibration has started
2014-05-07 16:37:08.528 MyApp[2864:5c03] Calibration has completed
2014-05-07 16:37:08.532 MyApp[2864:5c03] Listening.
2014-05-07 16:37:09.573 MyApp[2864:5c03] Speech detected…
INFO: file_omitted(0): arc_buffer_producer_start_utt
time delta 1399469829.599150 start 0000000
time delta 1399469829.602701 partial result fwdtree
partial: <s>:(0000000)
INFO: file_omitted(0): arc_buffer_consumer_start_utt
time delta 1399469829.609724 start 0000000
time delta 1399469829.633936 partial result fwdtree
[del]

2014-05-07 16:38:29.691 MyApp[2864:907] In ContinuousAudioUnit
INFO: file_omitted(0): cmn_prior_update: from < 14.39 -2.20 -0.33 0.33 -0.42 -0.08 -0.21 -0.08 -0.34 -0.05 -0.17 -0.12 -0.09 >
INFO: file_omitted(0): cmn_prior_update: to < 14.23 -2.12 -0.30 0.33 -0.37 -0.12 -0.21 -0.08 -0.34 -0.06 -0.18 -0.13 -0.08 >
[Here is delay!]
INFO: file_omitted(0): idx 8005 is final (8005)
INFO: file_omitted(0): fwdtree: marking arc buffer final
INFO: file_omitted(0): fwdtree: allocated 8192 arcs (96 KiB)
INFO: file_omitted(0): fwdtree: allocated 512 start frame entries (2 KiB)
INFO: file_omitted(0): Waiting for 1 consumers to finish
INFO: file_omitted(0): idx 8005 is final (8005)
2014-05-07 16:41:41.845 MyApp[2864:5c03] Stopping audio unit.
time delta 1399470101.847927 end 0000000
2014-05-07 16:41:41.913 MyApp[2864:5c03] Audio Output Unit stopped, cleaning up variable states.
2014-05-07 16:41:41.916 MyApp[2864:5c03] This device is not recording, so first we will set its recording status to 0
2014-05-07 16:41:41.918 MyApp[2864:5c03] The audio unit is running so we are going to dispose of its instance
INFO: file_omitted(0): fwdtree canceled
INFO: file_omitted(0): TOTAL fwdtree 270.115 wall 3.374 xRT
INFO: file_omitted(0): fwdflat canceled
INFO: file_omitted(0): TOTAL fwdflat 244.569 wall 3.055 xRT
2014-05-07 16:41:41.957 MyApp[2864:5c03] No longer listening.