Skip to content

Instantly share code, notes, and snippets.

@floweisshardt

floweisshardt/NMSP: connection forbidden

Created August 16, 2016 14:27
Show Gist options
  • Save floweisshardt/457e24a302db0f4b70591340092c1d90 to your computer and use it in GitHub Desktop.
Save floweisshardt/457e24a302db0f4b70591340092c1d90 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
NMSP: connection forbidden
[16/08/2016 16:23:05,466] WARN LoggerConfigurator - Unable to add socket writer
java.net.BindException: Address already in use
at java.net.PlainSocketImpl.socketBind(Native Method)
at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
at java.net.ServerSocket.bind(ServerSocket.java:376)
at java.net.ServerSocket.<init>(ServerSocket.java:237)
at java.net.ServerSocket.<init>(ServerSocket.java:128)
at de.semvox.commons.logging.LogMessageSocketWriter.<init>(SourceFile:67)
at de.semvox.commons.logging.LogMessageSocketWriter.<init>(SourceFile:78)
at de.semvox.odp.s3.config.LoggerConfigurator.onPlatformConfigurationUpdated(SourceFile:89)
at de.semvox.odp.s3.config.BasicConfigurationManager.firePlatformConfigurationUpdated(SourceFile:154)
at de.semvox.odp.s3.config.BasicConfigurationManager.loadPlatformConfiguration(SourceFile:89)
at de.semvox.odp.s3.PlatformLoader.a(SourceFile:108)
at de.semvox.odp.s3.PlatformLoader.setupPlatform(SourceFile:44)
at de.semvox.odp.s3.PlatformLoader.loadPlatform(SourceFile:129)
at de.semvox.odp.s3.PlatformLoader.loadPlatform(SourceFile:118)
at de.semvox.odp.s3.S3CoreLoader.main(SourceFile:6)
[16/08/2016 16:23:05,475] WARN HttpServerConfigurator - Unable to start HTTP server.
java.net.BindException: Address already in use
at java.net.PlainSocketImpl.socketBind(Native Method)
at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
at java.net.ServerSocket.bind(ServerSocket.java:376)
at java.net.ServerSocket.<init>(ServerSocket.java:237)
at java.net.ServerSocket.<init>(ServerSocket.java:128)
at de.semvox.commons.net.NanoHTTPD.<init>(SourceFile:209)
at de.semvox.commons.net.RestfulHttpServer.<init>(SourceFile:42)
at de.semvox.subcon.integration.http.server.SubConHttpServerFactory.startSystemFacadeServer(SourceFile:47)
at de.semvox.odp.s3.config.HttpServerConfigurator.onPlatformConfigurationUpdated(SourceFile:51)
at de.semvox.odp.s3.config.BasicConfigurationManager.firePlatformConfigurationUpdated(SourceFile:154)
at de.semvox.odp.s3.config.BasicConfigurationManager.loadPlatformConfiguration(SourceFile:89)
at de.semvox.odp.s3.PlatformLoader.a(SourceFile:108)
at de.semvox.odp.s3.PlatformLoader.setupPlatform(SourceFile:44)
at de.semvox.odp.s3.PlatformLoader.loadPlatform(SourceFile:129)
at de.semvox.odp.s3.PlatformLoader.loadPlatform(SourceFile:118)
at de.semvox.odp.s3.S3CoreLoader.main(SourceFile:6)
[16/08/2016 16:23:05,477] INFO PlatformLoader - Working directory: /home/msh/git/care-o-bot/src/msh_voice_control/msh_voice_control_standalone
[16/08/2016 16:23:05,478] INFO Java - java.version=1.7.0_101
[16/08/2016 16:23:05,478] INFO Java - java.vm.version=24.95-b01
[16/08/2016 16:23:05,479] INFO Java - os.arch=i386
[16/08/2016 16:23:05,479] INFO Java - sun.arch.data.model=32
[16/08/2016 16:23:05,483] INFO BuildInfo - de.semvox.odp.s3.s3-core_v10.4.1_b37_RELEASE
[16/08/2016 16:23:05,484] INFO PlatformLoader - RuntimeEnvironment[OperationalMode=[ManualAcceptanceTestMode], DeploymentType=Host, ActiveVariant=DEFAULT]
[16/08/2016 16:23:05,484] INFO PlatformFactory - Creating S3 platform...
[16/08/2016 16:23:05,495] DEBUG PlatformFactory - Platform class is: MshVoiceControlPlatform
[16/08/2016 16:23:05,498] INFO Middleware - Service registered: de.semvox.PlatformService
[16/08/2016 16:23:05,498] INFO PlatformFactory - S3 platform created.
[16/08/2016 16:23:05,499] INFO PlatformLoader - Loading S3 platform...
[16/08/2016 16:23:05,908] DEBUG Spijk - Created spijk of type r
[16/08/2016 16:23:06,052] INFO ResultProcessorFactory - Adding to filter chain: AssignRecognitionId
[16/08/2016 16:23:06,060] INFO ResultProcessorFactory - Adding to filter chain: RejectionFilter(de.semvox.asr.bridge.filter.gen.DefaultRejectionFilterDefinition)
[16/08/2016 16:23:06,062] INFO ResultProcessorFactory - Using merging strategy: EqualityMergingStrategy
[16/08/2016 16:23:06,067] INFO ResultProcessorFactory - Using filtering strategy: SimilarityWindowFilter(de.fraunhofer.ipa.MshVoiceControl.gen.MshVoiceControlSimilarityFilterDefinition)
[16/08/2016 16:23:06,072] INFO Middleware - Receiver registered: de.semvox.LifecycleReceiver
[16/08/2016 16:23:06,077] INFO Middleware - Service registered: de.semvox.ConnectivityManager
[16/08/2016 16:23:06,077] INFO Middleware - Receiver registered: de.semvox.ConnectivityManager
[16/08/2016 16:23:06,097] INFO LanguageManager - Initialized with locale: de-DE
[16/08/2016 16:23:06,098] INFO Middleware - Service registered: de.semvox.LanguageManager
[16/08/2016 16:23:06,098] INFO Middleware - Receiver registered: de.semvox.LanguageManager
[16/08/2016 16:23:06,101] INFO Middleware - Service registered: de.semvox.StickyEventStore
[16/08/2016 16:23:06,102] INFO Middleware - Receiver registered: de.semvox.StickyEventStore
[16/08/2016 16:23:06,338] DEBUG SQUINT:InteractionHistory - [#ECDBB6][register-with-short-term-memory] registering history manager
[16/08/2016 16:23:06,348] DEBUG SQUINT:HistoryContextProvider - [#ECDBB6][register-with-short-term-memory] registering history context provider
[16/08/2016 16:23:06,399] DEBUG SQUINT:HypoSelection - [#99FF99][init-hypo-selection] using default hypothesis selection definitions
[16/08/2016 16:23:06,477] INFO Middleware - Service registered: de.semvox.SQUINT
[16/08/2016 16:23:06,478] INFO Middleware - Receiver registered: de.semvox.SQUINT
[16/08/2016 16:23:06,479] INFO Middleware - Receiver registered: de.semvox.AudioReceiver
[16/08/2016 16:23:06,505] INFO Middleware - Service registered: de.semvox.SPIT
[16/08/2016 16:23:06,519] INFO Middleware - Service registered: de.semvox.SPIJK
[16/08/2016 16:23:06,524] INFO Middleware - Service registered: de.semvox.OutputService
[16/08/2016 16:23:06,561] INFO Middleware - Service registered: de.semvox.SystemClock
[16/08/2016 16:23:06,596] INFO Middleware - Service registered: de.semvox.ASR
[16/08/2016 16:23:06,614] INFO Middleware - Service registered: de.semvox.TTS
[16/08/2016 16:23:06,663] INFO Middleware - Service registered: de.semvox.UserManager
[16/08/2016 16:23:06,664] INFO Middleware - Receiver registered: de.semvox.UserManager
[16/08/2016 16:23:06,670] INFO Platform - Loading shipped bundles...
[16/08/2016 16:23:06,671] DEBUG BasicDirectoryManager - Trying to resolve bundle de.fraunhofer.ipa.bundles.deployment.gen.MshVoiceControl within JVM...
[16/08/2016 16:23:06,675] INFO BundleLoader - Loading bundle de.fraunhofer.ipa.bundles.MshVoiceControl.1.0.0-SNAPSHOT...
[16/08/2016 16:23:06,675] DEBUG BundleLoader - Instantiating bundle class de.fraunhofer.ipa.bundles.MshVoiceControl.MshVoiceControlBundle...
[16/08/2016 16:23:06,774] INFO MshVoiceControlBundle - [red] Checking mshvoicecontrol.use_hotword_recognition
[16/08/2016 16:23:06,775] INFO MshVoiceControlBundle - [red] Hotword Grammar is not used
[16/08/2016 16:23:06,969] DEBUG Spijk - Loading grammar 'MotionControlGrammar'
[16/08/2016 16:23:07,089] INFO Middleware - Received service request: LoadGrammar (from de.semvox.SPIJK)
[16/08/2016 16:23:07,091] INFO Middleware - Service 'de.semvox.ASR' handles request: LOAD_GRAMMAR=LoadGrammar
[16/08/2016 16:23:07,093] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, LoadGrammar
[16/08/2016 16:23:07,095] DEBUG Spijk - Configured roots: RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_FollowMe,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Stop,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss,RequestTask_Dismiss
[16/08/2016 16:23:07,095] DEBUG Spijk - Configured subs:
[16/08/2016 16:23:07,096] DEBUG Spijk - Configured slots:
[16/08/2016 16:23:07,096] DEBUG Spijk - Configured lifts:
[16/08/2016 16:23:07,096] DEBUG Spijk - Loading grammar 'ProductSearchGrammar'
[16/08/2016 16:23:07,101] INFO AsrBridge - Loading grammar: MotionControlGrammar (de-DE)
[16/08/2016 16:23:07,102] DEBUG AsrBridge - Creating context for MotionControlGrammar(de-DE)...
[16/08/2016 16:23:07,102] WARN AsrBridge - Current language 'none' does not match grammar language.
[16/08/2016 16:23:07,103] DEBUG AsrBridge - ASR not initialized to language de-DE. Postponing context creation...
[16/08/2016 16:23:07,359] INFO Middleware - Received service request: LoadGrammar (from de.semvox.SPIJK)
[16/08/2016 16:23:07,359] INFO Middleware - Service 'de.semvox.ASR' handles request: LOAD_GRAMMAR=LoadGrammar
[16/08/2016 16:23:07,361] INFO AsrBridge - Loading grammar: ProductSearchGrammar (de-DE)
[16/08/2016 16:23:07,362] DEBUG AsrBridge - Creating context for ProductSearchGrammar(de-DE)...
[16/08/2016 16:23:07,362] WARN AsrBridge - Current language 'none' does not match grammar language.
[16/08/2016 16:23:07,362] DEBUG AsrBridge - ASR not initialized to language de-DE. Postponing context creation...
[16/08/2016 16:23:07,363] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, LoadGrammar
[16/08/2016 16:23:07,364] DEBUG Spijk - Configured roots: RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch,RequestTask_ProductSearch
[16/08/2016 16:23:07,365] DEBUG Spijk - Configured subs: COULD_YOU,I_WANT,I_WANT,DET
[16/08/2016 16:23:07,365] DEBUG Spijk - Configured slots: SEARCHITEM
[16/08/2016 16:23:07,365] DEBUG Spijk - Configured lifts:
[16/08/2016 16:23:07,366] DEBUG Spijk - Loading grammar 'PartialUtteranceSearchItem'
[16/08/2016 16:23:07,374] INFO Middleware - Received service request: LoadGrammar (from de.semvox.SPIJK)
[16/08/2016 16:23:07,375] INFO Middleware - Service 'de.semvox.ASR' handles request: LOAD_GRAMMAR=LoadGrammar
[16/08/2016 16:23:07,376] INFO AsrBridge - Loading grammar: PartialUtteranceSearchItem (de-DE)
[16/08/2016 16:23:07,377] DEBUG AsrBridge - Creating context for PartialUtteranceSearchItem(de-DE)...
[16/08/2016 16:23:07,377] WARN AsrBridge - Current language 'none' does not match grammar language.
[16/08/2016 16:23:07,377] DEBUG AsrBridge - ASR not initialized to language de-DE. Postponing context creation...
[16/08/2016 16:23:07,378] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, LoadGrammar
[16/08/2016 16:23:07,379] DEBUG Spijk - Configured roots: PartialUtterance_SearchItem,PartialUtterance_SearchItem
[16/08/2016 16:23:07,379] DEBUG Spijk - Configured subs: COULD_YOU,I_WANT,I_WANT,DET
[16/08/2016 16:23:07,380] DEBUG Spijk - Configured slots: SEARCHITEM
[16/08/2016 16:23:07,380] DEBUG Spijk - Configured lifts:
[16/08/2016 16:23:07,381] DEBUG Spijk - Loading grammar 'ServicesGrammar'
[16/08/2016 16:23:07,403] INFO Middleware - Received service request: LoadGrammar (from de.semvox.SPIJK)
[16/08/2016 16:23:07,404] INFO Middleware - Service 'de.semvox.ASR' handles request: LOAD_GRAMMAR=LoadGrammar
[16/08/2016 16:23:07,404] INFO AsrBridge - Loading grammar: ServicesGrammar (de-DE)
[16/08/2016 16:23:07,405] DEBUG AsrBridge - Creating context for ServicesGrammar(de-DE)...
[16/08/2016 16:23:07,405] WARN AsrBridge - Current language 'none' does not match grammar language.
[16/08/2016 16:23:07,405] DEBUG AsrBridge - ASR not initialized to language de-DE. Postponing context creation...
[16/08/2016 16:23:07,417] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, LoadGrammar
[16/08/2016 16:23:07,418] DEBUG Spijk - Configured roots: RequestTask_Navigation_OnlinePickup,RequestTask_Navigation_OnlinePickup,RequestTask_Navigation_OnlinePickup,RequestTask_Navigation_OnlinePickup,RequestTask_Navigation_OnlinePickup,RequestTask_Navigation_WC,RequestTask_Navigation_Info,RequestTask_Navigation_Repair
[16/08/2016 16:23:07,419] DEBUG Spijk - Configured subs:
[16/08/2016 16:23:07,419] DEBUG Spijk - Configured slots:
[16/08/2016 16:23:07,419] DEBUG Spijk - Configured lifts:
[16/08/2016 16:23:07,420] DEBUG Spijk - Loading grammar 'SmallTalkGrammar'
[16/08/2016 16:23:07,560] INFO Middleware - Received service request: LoadGrammar (from de.semvox.SPIJK)
[16/08/2016 16:23:07,561] INFO Middleware - Service 'de.semvox.ASR' handles request: LOAD_GRAMMAR=LoadGrammar
[16/08/2016 16:23:07,561] INFO AsrBridge - Loading grammar: SmallTalkGrammar (de-DE)
[16/08/2016 16:23:07,562] DEBUG AsrBridge - Creating context for SmallTalkGrammar(de-DE)...
[16/08/2016 16:23:07,562] WARN AsrBridge - Current language 'none' does not match grammar language.
[16/08/2016 16:23:07,562] DEBUG AsrBridge - ASR not initialized to language de-DE. Postponing context creation...
[16/08/2016 16:23:07,566] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, LoadGrammar
[16/08/2016 16:23:07,577] DEBUG Spijk - Configured roots: RequestTask_StarWars,RequestTask_HowAreYou,RequestTask_HowAreYou,RequestTask_HowAreYou,RequestTask_HowAreYou,RequestTask_HowAreYou,RequestTask_Banana,RequestTask_HowOldAreYou,RequestTask_WhatCanYouDo,RequestTask_WhatCanYouDo,RequestTask_WhatCanYouDo,RequestTask_WhatCanYouDo,RequestTask_DoYouHaveaGirlFriends,RequestTask_DoYouHaveFriends,RequestTask_Wheather,RequestTask_Wheather,RequestTask_Wheather,RequestTask_Wheather,RequestTask_Home,RequestTask_Home,RequestTask_Creator,RequestTask_Creator,RequestTask_Creator,RequestTask_Origin,RequestTask_Origin,RequestTask_OriginName,RequestTask_OriginName,RequestTask_OriginName,RequestTask_Test,RequestTask_Hobbies,RequestTask_Hobbies,RequestTask_Date,RequestTask_Date,RequestTask_Thanks,RequestTask_Thanks,RequestTask_Thanks,RequestTask_Fired,RequestTask_Evening,RequestTask_Size,RequestTask_Universe,RequestTask_42,RequestTask_42,RequestTask_Money,RequestTask_Food,RequestTask_Food,RequestTask_Sad,RequestTask_Sad,RequestTask_Sad,RequestTask_Sad,RequestTask_Sad,RequestTask_Sad,RequestTask_Sad,RequestTask_Smart,RequestTask_Sing,RequestTask_Sing,RequestTask_HelloMe,RequestTask_Diet,RequestTask_Diet,RequestTask_Surprise,RequestTask_Surprise,RequestTask_Morning,RequestTask_Song,RequestTask_Colour,RequestTask_Cook,RequestTask_Joke,RequestTask_Joke,RequestTask_Pi,RequestTask_Pi,RequestTask_Pi,RequestTask_Now
[16/08/2016 16:23:07,577] DEBUG Spijk - Configured subs:
[16/08/2016 16:23:07,589] DEBUG Spijk - Configured slots:
[16/08/2016 16:23:07,590] DEBUG Spijk - Configured lifts:
[16/08/2016 16:23:07,590] DEBUG Spijk - Loading grammar 'DecisionGrammar'
[16/08/2016 16:23:07,600] INFO Middleware - Received service request: LoadGrammar (from de.semvox.SPIJK)
[16/08/2016 16:23:07,601] INFO Middleware - Service 'de.semvox.ASR' handles request: LOAD_GRAMMAR=LoadGrammar
[16/08/2016 16:23:07,614] INFO AsrBridge - Loading grammar: DecisionGrammar (de-DE)
[16/08/2016 16:23:07,614] DEBUG AsrBridge - Creating context for DecisionGrammar(de-DE)...
[16/08/2016 16:23:07,614] WARN AsrBridge - Current language 'none' does not match grammar language.
[16/08/2016 16:23:07,615] DEBUG AsrBridge - ASR not initialized to language de-DE. Postponing context creation...
[16/08/2016 16:23:07,616] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, LoadGrammar
[16/08/2016 16:23:07,616] DEBUG Spijk - Configured roots: RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_Yes,RequestTask_GetDecision_No,RequestTask_GetDecision_No,RequestTask_GetDecision_No,RequestTask_GetDecision_No,RequestTask_GetDecision_No,RequestTask_GetDecision_No,RequestTask_GetDecision_No,RequestTask_GetDecision_No,RequestTask_GetDecision_No,RequestTask_GetDecision_Undecided,RequestTask_GetDecision_Undecided,RequestTask_GetDecision_Undecided,RequestTask_GetDecision_Undecided,RequestTask_GetDecision_Undecided,RequestTask_GetDecision_Undecided,RequestTask_GetDecision_Undecided
[16/08/2016 16:23:07,617] DEBUG Spijk - Configured subs:
[16/08/2016 16:23:07,617] DEBUG Spijk - Configured slots:
[16/08/2016 16:23:07,618] DEBUG Spijk - Configured lifts:
[16/08/2016 16:23:07,877] DEBUG MshVoiceControlAdapter - Try to initialize...
[16/08/2016 16:23:07,878] INFO MshVoiceControlAdapter - [grey] key0: asr.data.locator
[16/08/2016 16:23:07,878] INFO MshVoiceControlAdapter - [grey] key1: dialog.asr-threshold-cloud
[16/08/2016 16:23:07,878] INFO MshVoiceControlAdapter - [grey] key2: runtime-environment.location
[16/08/2016 16:23:07,878] INFO MshVoiceControlAdapter - [grey] key3: asr.nmsp.rec.response-timeout
[16/08/2016 16:23:07,879] INFO MshVoiceControlAdapter - [grey] key4: asr.vocon.params.rec.default.LH_AUDIOSOURCE_PARAM_TIMEOUT
[16/08/2016 16:23:07,879] INFO MshVoiceControlAdapter - [grey] key5: use-connectivity-manager
[16/08/2016 16:23:07,879] INFO MshVoiceControlAdapter - [grey] key6: asr.vocon.params.rec.default.LH_FX_PARAM_TIMEOUT_SPEECH
[16/08/2016 16:23:07,879] INFO MshVoiceControlAdapter - [grey] key7: asr.hotword-threshold
[16/08/2016 16:23:07,880] INFO MshVoiceControlAdapter - [grey] key8: connectivity.check-urls
[16/08/2016 16:23:07,880] INFO MshVoiceControlAdapter - [grey] key9: asr.vocon.params.ctx.default.LH_CTX_PARAM_MAXNBEST
[16/08/2016 16:23:07,880] INFO MshVoiceControlAdapter - [grey] key10: asr.nmsp.port
[16/08/2016 16:23:07,880] INFO MshVoiceControlAdapter - [grey] key11: http.port
[16/08/2016 16:23:07,880] INFO MshVoiceControlAdapter - [grey] key12: wdir
[16/08/2016 16:23:07,881] INFO MshVoiceControlAdapter - [grey] key13: logging.level
[16/08/2016 16:23:07,881] INFO Middleware - Service registered: de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlService
[16/08/2016 16:23:07,881] INFO MshVoiceControlAdapter - [grey] key14: mshvoicecontrol.tts.output-path
[16/08/2016 16:23:07,882] INFO MshVoiceControlAdapter - [grey] key15: asr.audio.output-path
[16/08/2016 16:23:07,882] INFO MshVoiceControlAdapter - [grey] key16: mshvoicecontrol.use_hotword_recognition
[16/08/2016 16:23:07,882] INFO MshVoiceControlAdapter - [grey] key17: asr.vocon.params.ctx.default.LH_CTX_PARAM_MAXNBEST_SECONDPASS
[16/08/2016 16:23:07,883] INFO MshVoiceControlAdapter - [grey] key18: asr.filter.similarity.def
[16/08/2016 16:23:07,883] INFO MshVoiceControlAdapter - [grey] key19: asr.nmsp.connect-timeout
[16/08/2016 16:23:07,884] INFO MshVoiceControlAdapter - [grey] key20: system-locale
[16/08/2016 16:23:07,884] INFO Middleware - Receiver registered: de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlEventReceiver
[16/08/2016 16:23:07,884] INFO MshVoiceControlAdapter - [grey] key21: asr.filter.use-tags
[16/08/2016 16:23:07,885] INFO MshVoiceControlAdapter - [grey] key22: asr.nmsp.app-id
[16/08/2016 16:23:07,885] INFO MshVoiceControlAdapter - [grey] key23: __log
[16/08/2016 16:23:07,885] INFO MshVoiceControlAdapter - [grey] key24: asr.nmsp.host
[16/08/2016 16:23:07,886] INFO MshVoiceControlAdapter - [grey] key25: connectivity.check-interval
[16/08/2016 16:23:07,886] INFO Middleware - Receiver registered: de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlAbnormalSignalEventReceiver
[16/08/2016 16:23:07,886] INFO MshVoiceControlAdapter - [grey] key26: asr.min-acceptance-confidence
[16/08/2016 16:23:07,887] INFO MshVoiceControlAdapter - [grey] key27: init-system
[16/08/2016 16:23:07,887] INFO MshVoiceControlAdapter - [grey] key28: use-output-manager
[16/08/2016 16:23:07,888] INFO MshVoiceControlAdapter - [grey] key29: asr.audio.enable-dump
[16/08/2016 16:23:07,888] INFO MshVoiceControlAdapter - [grey] key30: build-infos
[16/08/2016 16:23:07,888] INFO MshVoiceControlAdapter - [grey] key31: logging.socket-port
[16/08/2016 16:23:07,889] INFO MshVoiceControlAdapter - [grey] key32: runtime-environment.locator
[16/08/2016 16:23:07,889] INFO MshVoiceControlAdapter - [grey] key33: logging.file-path
[16/08/2016 16:23:07,890] INFO MshVoiceControlAdapter - [grey] key34: logging.no-xml
[16/08/2016 16:23:07,890] INFO MshVoiceControlAdapter - [grey] key35: __name
[16/08/2016 16:23:07,890] INFO MshVoiceControlAdapter - [grey] key36: tts.data.voice-path
[16/08/2016 16:23:07,891] INFO MshVoiceControlAdapter - [grey] key37: asr.data.acmod.location.de-DE
[16/08/2016 16:23:07,891] INFO MshVoiceControlAdapter - [grey] key38: asr.nmsp.app-key
[16/08/2016 16:23:07,891] INFO MshVoiceControlAdapter - [grey] key39: asr.data.clc.location.de-DE
[16/08/2016 16:23:07,893] INFO MshVoiceControlAdapter - Initialized
[16/08/2016 16:23:07,893] DEBUG MshVoiceControlAdapter - Try to connect...
[16/08/2016 16:23:07,909] INFO Middleware - Receiver registered: de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver
[16/08/2016 16:23:07,913] INFO BundleLoader - Bundle de.fraunhofer.ipa.bundles.MshVoiceControl.1.0.0-SNAPSHOT loaded.
[16/08/2016 16:23:07,918] INFO Middleware - Received event: PlatformLoaded (from de.fraunhofer.ipa.MshVoiceControl.MshVoiceControlPlatform)
[16/08/2016 16:23:07,921] INFO MshVoiceControlPlatform - Initializing system...
[16/08/2016 16:23:07,922] INFO Middleware - Received event: InitializeSystem (from de.fraunhofer.ipa.MshVoiceControl.MshVoiceControlPlatform)
[16/08/2016 16:23:07,927] INFO PlatformLoader - S3 platform loaded.
[16/08/2016 16:23:07,927] INFO Middleware - Receiver 'de.semvox.StickyEventStore' handles token: InitializeSystem
[16/08/2016 16:23:07,927] DEBUG SituationalContext - Current configuration:
Static: [
]
Dynamic: [
]
Sticky Events: [
]
[16/08/2016 16:23:07,928] INFO Middleware - Received event: InitializeSystem (from de.semvox.StickyEventStore)
[16/08/2016 16:23:07,930] INFO Middleware - Receiver 'de.semvox.ConnectivityManager' handles token: InitializeSystem
[16/08/2016 16:23:07,931] INFO Middleware - Received event: InitializeSystem (from de.semvox.ConnectivityManager)
[16/08/2016 16:23:07,941] INFO Middleware - Receiver 'de.semvox.UserManager' handles token: InitializeSystem
[16/08/2016 16:23:07,945] INFO Middleware - Received event: UserPreferencesChanged (from de.semvox.UserManager)
[16/08/2016 16:23:07,947] INFO Middleware - Received event: InitializeSystem (from de.semvox.UserManager)
[16/08/2016 16:23:07,949] INFO Middleware - Receiver 'de.semvox.SQUINT' handles token: InitializeSystem
[16/08/2016 16:23:07,950] INFO Middleware - Received service request: Initialize (from de.semvox.SQUINT)
[16/08/2016 16:23:07,951] INFO Middleware - Service 'de.semvox.ASR' handles request: INITIALIZE=Initialize
[16/08/2016 16:23:07,953] INFO AsrBridge - Initializing ASR bridge with language 'de-DE'.
[16/08/2016 16:23:07,956] DEBUG SNC - Try to load libsnc...
[16/08/2016 16:23:07,957] INFO SNC - libsnc loaded
[16/08/2016 16:23:07,957] DEBUG SNC - SNC initialized
[16/08/2016 16:23:07,958] DEBUG SNC - Try to load libvocon4odp...
[16/08/2016 16:23:07,974] INFO SNC - libvocon4odp loaded
[16/08/2016 16:23:07,976] INFO SNC - Artifact 'vocon-jni-linux' validation passed
[16/08/2016 16:23:07,977] DEBUG VoConJNI-Linux - Create a Doug Lea heap instance
[16/08/2016 16:23:07,977] DEBUG VoConJNI-Linux - Heap initialized
[16/08/2016 16:23:07,977] DEBUG VoConJNI-Linux - Base initialized
[16/08/2016 16:23:07,978] INFO VoConJNI-Linux - VoCon Version: VoCon 3200 4.10.1 i86_linux2
[16/08/2016 16:23:07,983] DEBUG VoConJNI-Linux - ASR initialized
[16/08/2016 16:23:07,983] DEBUG VoConJNI-Linux - SEM initialized
[16/08/2016 16:23:07,984] DEBUG VoConJNI-Linux - DASR initialized
[16/08/2016 16:23:07,984] DEBUG VoConJNI-Linux - SSE initialized with DASR
[16/08/2016 16:23:07,984] DEBUG VoConJNI-Linux - NMSP initialized
[16/08/2016 16:23:08,046] INFO Middleware - Rived event: ConnectivityChanged (from de.semvox.ConnectivityManager)
[16/08/2016 16:23:08,181] DEBUG VoConJNI-Linux - AcMod initialized
[16/08/2016 16:23:08,183] DEBUG VoConJNI-Linux - Pron initialized
[16/08/2016 16:23:08,202] DEBUG VoConJNI-Linux - CLC created
[16/08/2016 16:23:08,203] DEBUG VoConJNI-Linux - ASR prepared
[16/08/2016 16:23:08,204] DEBUG VoConJNI-Linux - Gram2 initialized
[16/08/2016 16:23:08,205] DEBUG AsrBridge - Creating contexts for all 6 postponed grammars...
[16/08/2016 16:23:08,205] DEBUG AsrBridge - Creating context for ServicesGrammar(de-DE)...
[16/08/2016 16:23:08,205] DEBUG AsrBridge - Compiling BNF grammar:
#BNF+EMV2.1;
!grammar ServicesGrammar;
!start <RequestTask_Navigation_Info>;
!start <RequestTask_Navigation_WC>;
!start <RequestTask_Navigation_Repair>;
!start <RequestTask_Navigation_OnlinePickup>;
<RequestTask_Navigation_Info>:((!optional(<...>) (information|(info !optional((theke|stand)))|umtauschen) !optional(<...>)));
<RequestTask_Navigation_WC>:((!optional(<...>) (toilette|wc|klo|torlette|toiletten) !optional(<...>)));
<RequestTask_Navigation_Repair>:((!optional(<...>) ((Reparatur !optional(annahme))|reparieren|kaputt|Reklamation|reklamieren) !optional(<...>)));
<RequestTask_Navigation_OnlinePickup>:((!optional(<...>) !optional(online) (abholung|bestellung) !optional(<...>))|(!optional(<...>) (onlinebestellung|onlineabholung) !optional(<...>))|(!optional(<...>) internet <...>)|(!optional(<...>) abholen <...>)|(!optional(<...>) online <...>));
[16/08/2016 16:23:08,206] DEBUG VoConJNI-Linux - Grammar precompile...
[16/08/2016 16:23:08,227] DEBUG VoConJNI-Linux - Grammar precompile OK
[16/08/2016 16:23:08,228] DEBUG VoConJNI-Linux - Grammar compile...
[16/08/2016 16:23:08,233] DEBUG VoConJNI-Linux - Grammar compile OK
[16/08/2016 16:23:08,236] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST_SECONDPASS=3
[16/08/2016 16:23:08,237] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST=3
[16/08/2016 16:23:08,237] DEBUG AsrBridge - Creating context for ProductSearchGrammar(de-DE)...
[16/08/2016 16:23:08,237] DEBUG AsrBridge - Compiling BNF grammar:
#BNF+EMV2.1;
!grammar ProductSearchGrammar;
!start <RequestTask_ProductSearch>;
<RequestTask_ProductSearch>:((!optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(mal bitte !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(bitte !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(bitte (suche|such|suchen Sie) !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|((suche|such|suchen Sie) mal bitte !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|((suche|such|suchen Sie) !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(Ich suche !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|((suche|such|suchen Sie) !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> mal !optional(mir) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(<COULD_YOU> !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) mal bitte !optional((neuen|neue|neues)) <SEARCHITEM>)|((suche|such|suchen Sie) mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> !optional(mir) !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen) bitte)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) mal !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|((suche|such|suchen Sie) mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) bitte !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) mal <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(bitte mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<I_WANT> mal bitte !optional(mir) !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(<I_WANT> mal bitte !optional(mir) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(<I_WANT> mal !optional(mir) !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(<I_WANT> mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<DET> <SEARCHITEM> !optional(bitte))|(<I_WANT> bitte mal !optional(mir) !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(<I_WANT> bitte !optional(mir) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) !optional((neuen|neue|neues)) <SEARCHITEM>)|(bitte (suche|such|suchen Sie) !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM>)|(<COULD_YOU> mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|((suche|such|suchen Sie) bitte !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) bitte mal !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> !optional(mir) !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(bitte (suche|such|suchen Sie) mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) bitte <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> bitte !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) mal bitte <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) bitte mal <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> bitte !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<I_WANT> bitte mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) mal !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> !optional(mir) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen) bitte)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) mal !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|((suche|such|suchen Sie) bitte mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) mal <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(<I_WANT> mal !optional(mir) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen) bitte)|(Wo finde ich !optional((bei (euch|dir|Ihnen))) !optional((neuen|neue|neues)) <SEARCHITEM>)|((suche|such|suchen Sie) bitte !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) bitte mal <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(<COULD_YOU> mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(<COULD_YOU> mal bitte !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(bitte !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<I_WANT> mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(Wo kann ich !optional((bei (euch|dir|Ihnen))) !optional((neuen|neue|neues)) <SEARCHITEM> finden)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) mal bitte <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) mal <DET> !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(<COULD_YOU> !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(<COULD_YOU> mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(<COULD_YOU> !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(!optional((neuen|neue|neues)) <SEARCHITEM> !optional((ist|sind)))|(<COULD_YOU> bitte mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) !optional((neuen|neue|neues)) <SEARCHITEM>)|(bitte mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) mal <DET> !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(mal bitte !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(!optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(Wo kann ich !optional((bei (euch|dir|Ihnen))) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> finden)|(<SEARCHITEM> !optional(bitte))|(Wo finde ich !optional((bei (euch|dir|Ihnen))) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) mal !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|((suche|such|suchen Sie) bitte mal !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> bitte !optional(mir) !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(!optional(Wo) (Haben Sie|Habt Ihr|Hast du|(Gibt es !optional((bei (euch|dir|Ihnen))))) !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) bitte mal !optional((neuen|neue|neues)) <SEARCHITEM>)|((suche|such|suchen Sie) mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM>)|(<COULD_YOU> bitte !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|((suche|such|suchen Sie) mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(Ich suche !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> bitte mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<I_WANT> !optional(mir) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(<I_WANT> mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(<COULD_YOU> mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(Ich (möchte|möcht|will|mag) !optional((gerne|gern)) mal bitte !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> mal bitte !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<COULD_YOU> bitte !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(!optional(Wo) (Haben Sie|Habt Ihr|Hast du|(Gibt es !optional((bei (euch|dir|Ihnen))))) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|(<COULD_YOU> !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen bitte)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|((suche|such|suchen Sie) !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM>)|(!optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|((suche|such|suchen Sie) !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(<I_WANT> !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<COULD_YOU> mal bitte !optional(nach) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> bitte)|(<I_WANT> mal bitte !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<DET> !optional((neuen|neue|neues)) <SEARCHITEM> !optional((ist|sind)))|(<I_WANT> mal !optional(mir) !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen) bitte)|(<COULD_YOU> bitte mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(<I_WANT> bitte mal !optional(mir) <DET> !optional((neuen|neue|neues)) <SEARCHITEM> (haben|kaufen|bestellen))|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) bitte <DET> !optional((neuen|neue|neues)) <SEARCHITEM>)|((suche|such|suchen Sie) mal bitte !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM>)|(Ich ((hätte (gerne|gern))|brauche|brauch|benötige|bräuchte) bitte !optional((neuen|neue|neues)) <SEARCHITEM>)|(bitte (suche|such|suchen Sie) mal !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM>)|(<I_WANT> !optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen)|(!optional(nach) !optional((neuen|neue|neues)) <SEARCHITEM> suchen));
<DET>:((der|die|das|den|dem|ein|eine|einem|einen|einer|oiner|an|a|in|im|oim));
<COULD_YOU>:((((Kannst|Könntest|Würdest) du)|((Können|Könnten|Würden) Sie)));
<I_WANT>:((Ich (möchte|möcht|will|mag|würde|würd))|(Ich (möchte|möcht|will|mag|würde|würd) (gerne|gern)));
<SEARCHITEM>:(<...>);
[16/08/2016 16:23:08,239] DEBUG VoConJNI-Linux - Grammar precompile...
[16/08/2016 16:23:08,262] INFO MshVoiceControlAdapter - Connected
[16/08/2016 16:23:08,290] DEBUG VoConJNI-Linux - Grammar precompile OK
[16/08/2016 16:23:08,291] DEBUG VoConJNI-Linux - Grammar compile...
[16/08/2016 16:23:08,300] DEBUG VoConJNI-Linux - Grammar compile OK
[16/08/2016 16:23:08,301] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST_SECONDPASS=3
[16/08/2016 16:23:08,302] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST=3
[16/08/2016 16:23:08,302] DEBUG AsrBridge - Creating context for DecisionGrammar(de-DE)...
[16/08/2016 16:23:08,302] DEBUG AsrBridge - Compiling BNF grammar:
#BNF+EMV2.1;
!grammar DecisionGrammar;
!start <RequestTask_GetDecision_Yes>;
!start <RequestTask_GetDecision_Undecided>;
!start <RequestTask_GetDecision_No>;
<RequestTask_GetDecision_Yes>:(((tu|mach) das)|(!optional(na) klar !optional((tu|mach)) !optional(das) !optional(super))|(!optional(au) !optional((jau|ja|jupp|jo|jop|jepp|jawohl|jawoll|sehr)) !optional(super) (gerne|gern) !optional((tu|mach)) !optional(das))|((jau|ja|jupp|jo|jop|jepp|jawohl|jawoll) (bitte|sicher))|(!optional(au) !optional(ja) gut !optional((tu|mach)) !optional(das))|(bitte !optional((tu|mach)) !optional(das))|(okay|super|claro|klaro)|(passt (schon|scho))|(<...> (jau|ja|jupp|jo|jop|jepp|jawohl|jawoll|korrekt|correct) <...>)|(!optional(fahr) los !optional(gehts))|(!optional((ganz|sehr|vollkommen)) richtig)|(!optional(super) (jau|ja|jupp|jo|jop|jepp|jawohl|jawoll) !optional(bitte) !optional((tu|mach)) !optional(das)));
<RequestTask_GetDecision_Undecided>:((!optional(ich habe) keine ahnung)|vielleicht|(<...> keine Zeit <...>)|(ich weiß !optional(jetzt) nicht)|geht so|jein|(so (lala|la la)));
<RequestTask_GetDecision_No>:(niemals|(!optional((nein|nee|nöö|nö)) !optional((bloß|gar|überhaupt|bitte)) (nicht|ned|nett))|(<...> (nein|nee|nöö|nö) <...>)|(<...> schlecht <...>)|(!optional((nein|nee|nöö|nö)) auf keinen Fall)|(<...> nicht <...>)|((nein|nee|nöö|nö) !optional(danke))|(<...> kein <...>)|(<...> bleib da <...>));
[16/08/2016 16:23:08,303] DEBUG VoConJNI-Linux - Grammar precompile...
[16/08/2016 16:23:08,345] DEBUG VoConJNI-Linux - Grammar precompile OK
[16/08/2016 16:23:08,345] DEBUG VoConJNI-Linux - Grammar compile...
[16/08/2016 16:23:08,350] DEBUG VoConJNI-Linux - Grammar compile OK
[16/08/2016 16:23:08,351] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST_SECONDPASS=3
[16/08/2016 16:23:08,351] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST=3
[16/08/2016 16:23:08,351] DEBUG AsrBridge - Creating context for SmallTalkGrammar(de-DE)...
[16/08/2016 16:23:08,351] DEBUG AsrBridge - Compiling BNF grammar:
#BNF+EMV2.1;
!grammar SmallTalkGrammar;
!start <RequestTask_StarWars>;
!start <RequestTask_Test>;
!start <RequestTask_Colour>;
!start <RequestTask_Home>;
!start <RequestTask_HowOldAreYou>;
!start <RequestTask_DoYouHaveaGirlFriends>;
!start <RequestTask_Surprise>;
!start <RequestTask_Now>;
!start <RequestTask_42>;
!start <RequestTask_Banana>;
!start <RequestTask_Fired>;
!start <RequestTask_Universe>;
!start <RequestTask_Smart>;
!start <RequestTask_Joke>;
!start <RequestTask_Hobbies>;
!start <RequestTask_Money>;
!start <RequestTask_Wheather>;
!start <RequestTask_Origin>;
!start <RequestTask_Size>;
!start <RequestTask_Cook>;
!start <RequestTask_WhatCanYouDo>;
!start <RequestTask_Food>;
!start <RequestTask_Song>;
!start <RequestTask_HelloMe>;
!start <RequestTask_Pi>;
!start <RequestTask_Creator>;
!start <RequestTask_Evening>;
!start <RequestTask_OriginName>;
!start <RequestTask_HowAreYou>;
!start <RequestTask_Morning>;
!start <RequestTask_DoYouHaveFriends>;
!start <RequestTask_Date>;
!start <RequestTask_Diet>;
!start <RequestTask_Sing>;
!start <RequestTask_Thanks>;
!start <RequestTask_Sad>;
<RequestTask_StarWars>:(möge die macht mit dir sein);
<RequestTask_Test>:((test !optional(test) !optional(test) !optional(eins zwei drei)));
<RequestTask_Colour>:(((was ist|hast du) (deine|eine) lieblingsfarbe));
<RequestTask_Home>:(wo ist dein zu hause|wo wohnst du);
<RequestTask_HowOldAreYou>:(((wie|wieviel) !optional(jahre) alt !optional(bist) !optional(du)));
<RequestTask_DoYouHaveaGirlFriends>:(hast du eine freundin);
<RequestTask_Surprise>:(((überrasche|überrasch) (mich|uns))|(mach !optional((mal|jetzt)) (was|etwas) überraschendes));
<RequestTask_Now>:(was machst du gerade);
<RequestTask_42>:(was ist die antwort auf die frage nach dem leben dem universum und dem ganzen rest|was ist die antwort auf alles);
<RequestTask_Banana>:(warum ist die banane krumm);
<RequestTask_Fired>:((Du bist (gefeuert|entlassen)));
<RequestTask_Universe>:(Was ist die Antwort auf das Leben das Universum und allem);
<RequestTask_Smart>:((wie (schlau|intelligent|clever) bist du));
<RequestTask_Joke>:(kennst du einen witz|(erzähl !optional((mir|uns)) (was lustiges|einen witz)));
<RequestTask_Hobbies>:((was machst du (in deiner freizeit|nach der arbeit))|((was sind deine|hast du) hobbies));
<RequestTask_Money>:((was (kostest|verdienst) du));
<RequestTask_Wheather>:((wird es !optional((heute|morgen|bald|am wochenende)) (regnen|kalt|sonnig|warm|windig|schneien))|(wie (wird|ist) (heute|morgen|am wochenende) das wetter !optional(sein))|(wie (wird|ist) das wetter !optional(sein))|(wie (wird|ist) das wetter (heute|morgen|am wochenende) !optional(sein)));
<RequestTask_Origin>:((wo kommst !optional(du) her)|woher kommst du);
<RequestTask_Size>:((Wie (groß|hoch|lang) bist du));
<RequestTask_Cook>:((kannst du !optional((gut|überhaupt)) kochen));
<RequestTask_WhatCanYouDo>:(was kannst du|((Für was|Warum) bist du (hier|da))|(Was machst du (hier|da))|welche fähigkeiten hast du);
<RequestTask_Food>:((Was isst du am (liebsten|gernsten|meisten|öftesten))|(Was ist (dein|deine) (Lieblingsessen|Leibspeise)));
<RequestTask_Song>:(((was ist|hast du) (dein|ein|einen) (lieblingslied|lieblingssong)));
<RequestTask_HelloMe>:(hello iss it mi ju are lucking for);
<RequestTask_Pi>:(kennst du pi|wie lautet pi|was ist pi);
<RequestTask_Creator>:(wer sind deine eltern|wer hat dich geboren|(wer hat dich (gemacht|gebaut|entwickelt)));
<RequestTask_Evening>:((!optional((Guten|Schönen|Wunderbaren)) !optional(guten) Abend));
<RequestTask_OriginName>:((warum heißt du (paul|so))|woher hast du deinen namen|wer hat dir deinen namen geben);
<RequestTask_HowAreYou>:(alles klar|(!optional((na|und)) wie läufts)|(!optional((na|und)) wie gehts !optional(dir))|alles okay|(!optional((na|und)) wie geht es dir));
<RequestTask_Morning>:((!optional((guten|schönen|wunderbaren)) morgen));
<RequestTask_DoYouHaveFriends>:(hast du freunde);
<RequestTask_Date>:((willst !optional(du) mit mir (ausgehen|gehen|zusammen sein))|(!optional(was) hast du (heute|morgen) abend !optional(schon) !optional((was|etwas|irgendwas)) vor));
<RequestTask_Diet>:(hast du abgenommen|bist du schlanker geworden);
<RequestTask_Sing>:(((kannst|willst|magst) du !optional((mir|uns)) !optional((etwas|was)) (vorsingen|singen))|(sing !optional((mir|uns)) (ein lied|etwas vor|was vor)));
<RequestTask_Thanks>:(Dankeschön|vielen Dank|(Danke !optional((vielmals|sehr|herzlich))));
<RequestTask_Sad>:(hau ab|(mir gefallen deine (antworten|aussagen) nicht)|(halt !optional((deinen|dein)) (maul|mund|fresse))|du gefällst mir nicht|((verp*ss|verzieh) dich)|ich mag dich nicht|(du bist (langweilig|hässlich|blöd)));
[16/08/2016 16:23:08,352] DEBUG VoConJNI-Linux - Grammar precompile...
[16/08/2016 16:23:08,483] DEBUG VoConJNI-Linux - Grammar precompile OK
[16/08/2016 16:23:08,484] DEBUG VoConJNI-Linux - Grammar compile...
[16/08/2016 16:23:08,508] DEBUG VoConJNI-Linux - Grammar compile OK
[16/08/2016 16:23:08,511] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST_SECONDPASS=3
[16/08/2016 16:23:08,511] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST=3
[16/08/2016 16:23:08,512] DEBUG AsrBridge - Creating context for MotionControlGrammar(de-DE)...
[16/08/2016 16:23:08,512] DEBUG AsrBridge - Compiling BNF grammar:
#BNF+EMV2.1;
!grammar MotionControlGrammar;
!start <RequestTask_Stop>;
!start <RequestTask_Dismiss>;
!start <RequestTask_FollowMe>;
<RequestTask_Stop>:((bitte (halt|halte|halten Sie) !optional(an))|((halt|halte|halten Sie) bitte mal !optional(an))|((hör|hören Sie) bitte auf)|(bitte (hör|hören Sie) mal auf)|((hör|hören Sie) bitte mal auf)|((stop|stoppe|stoppen Sie) bitte mal)|((halt|halte|halten Sie) !optional(an))|((hör|hören Sie) auf)|stopp|((halt|halte|halten Sie) mal bitte !optional(an))|((stop|stoppe|stoppen Sie) mal)|(!optional((((könntest|würdest) du)|((könnten|würden) Sie))) (aufhören|stoppen|anhalten))|((hör|hören Sie) mal auf)|(bitte (stop|stoppe|stoppen Sie))|(!optional((((könntest|würdest) du)|((könnten|würden) Sie))) (aufhören|stoppen|anhalten) bitte)|((stop|stoppe|stoppen Sie) mal bitte)|(bitte (halt|halte|halten Sie) mal !optional(an))|((halt|halte|halten Sie) mal !optional(an))|(!optional((((könntest|würdest) du)|((könnten|würden) Sie))) bitte (aufhören|stoppen|anhalten))|(!optional((((könntest|würdest) du)|((könnten|würden) Sie))) mal (aufhören|stoppen|anhalten) bitte)|(stop|stoppe|stoppen Sie)|(bitte (hör|hören Sie) auf)|(bitte (stop|stoppe|stoppen Sie) mal)|((hör|hören Sie) mal bitte auf)|(!optional((((könntest|würdest) du)|((könnten|würden) Sie))) mal bitte (aufhören|stoppen|anhalten))|((halt|halte|halten Sie) bitte !optional(an))|(!optional((((könntest|würdest) du)|((könnten|würden) Sie))) bitte mal (aufhören|stoppen|anhalten))|((stop|stoppe|stoppen Sie) bitte)|(!optional((((könntest|würdest) du)|((könnten|würden) Sie))) mal (aufhören|stoppen|anhalten)));
<RequestTask_Dismiss>:(((((könntest|würdest) du)|((könnten|würden) Sie)) mal (abhauen|weggehen|verschwinden))|((((könntest|würdest) du)|((könnten|würden) Sie)) (abhauen|weggehen|verschwinden) bitte)|((((könntest|würdest) du)|((könnten|würden) Sie)) mal bitte (abhauen|weggehen|verschwinden))|((hau|hauen Sie) mal bitte ab)|((lass|lassen Sie) mich bitte mal in Ruhe)|((hau|hauen Sie) bitte ab)|((lass|lassen Sie) mich mal in Ruhe)|((geh|gehen Sie) bitte mal weg)|((((könntest|würdest) du)|((könnten|würden) Sie)) mich in Ruhe lassen)|((verschwinde|verschwinden Sie) bitte)|((((könntest|würdest) du)|((könnten|würden) Sie)) mich in Ruhe lassen bitte)|((((könntest|würdest) du)|((könnten|würden) Sie)) mich mal bitte in Ruhe lassen)|((((könntest|würdest) du)|((könnten|würden) Sie)) mal (abhauen|weggehen|verschwinden) bitte)|((((könntest|würdest) du)|((könnten|würden) Sie)) mich bitte mal in Ruhe lassen)|((geh|gehen Sie) weg)|((verschwinde|verschwinden Sie) mal bitte)|(bitte (hau|hauen Sie) mal ab)|((verschwinde|verschwinden Sie) mal)|((verschwinde|verschwinden Sie) bitte mal)|((geh|gehen Sie) mal bitte weg)|(bitte (lass|lassen Sie) mich in Ruhe)|((lass|lassen Sie) mich mal bitte in Ruhe)|((((könntest|würdest) du)|((könnten|würden) Sie)) bitte (abhauen|weggehen|verschwinden))|((lass|lassen Sie) mich in Ruhe)|((((könntest|würdest) du)|((könnten|würden) Sie)) mich bitte in Ruhe lassen)|(bitte (lass|lassen Sie) mich mal in Ruhe)|((((könntest|würdest) du)|((könnten|würden) Sie)) bitte mal (abhauen|weggehen|verschwinden))|((hau|hauen Sie) mal ab)|(bitte (verschwinde|verschwinden Sie))|((lass|lassen Sie) mich bitte in Ruhe)|((((könntest|würdest) du)|((könnten|würden) Sie)) mich mal in Ruhe lassen bitte)|((((könntest|würdest) du)|((könnten|würden) Sie)) (abhauen|weggehen|verschwinden))|(bitte (geh|gehen Sie) mal weg)|((geh|gehen Sie) mal weg)|((hau|hauen Sie) bitte mal ab)|((geh|gehen Sie) bitte weg)|(bitte (geh|gehen Sie) weg)|(Ich brauche (dich|Sie) nicht mehr)|((((könntest|würdest) du)|((könnten|würden) Sie)) mich mal in Ruhe lassen)|(bitte (verschwinde|verschwinden Sie) mal)|((hau|hauen Sie) ab)|(bitte (hau|hauen Sie) ab)|(verschwinde|verschwinden Sie));
<RequestTask_FollowMe>:(((((könntest|würdest) du)|((könnten|würden) sie)) mir bitte folgen)|((folge|folgen Sie) mir mal)|(komm !optional(mit))|((folge|folgen Sie) mir bitte)|(bitte (folge|folgen Sie) mir)|((((könntest|würdest) du)|((könnten|würden) sie)) mir bitte mal folgen)|(bitte (folge|folgen Sie) mir mal)|((folge|folgen Sie) mir mal bitte)|((folge|folgen Sie) mir bitte mal)|((folge|folgen Sie) mir)|((((könntest|würdest) du)|((könnten|würden) sie)) mir mal bitte folgen)|((((könntest|würdest) du)|((könnten|würden) sie)) mir mal folgen bitte)|((((könntest|würdest) du)|((könnten|würden) sie)) mir folgen)|((((könntest|würdest) du)|((könnten|würden) sie)) mir folgen bitte)|((((könntest|würdest) du)|((könnten|würden) sie)) mir mal folgen));
[16/08/2016 16:23:08,512] DEBUG VoConJNI-Linux - Grammar precompile...
[16/08/2016 16:23:08,544] DEBUG VoConJNI-Linux - Grammar precompile OK
[16/08/2016 16:23:08,545] DEBUG VoConJNI-Linux - Grammar compile...
[16/08/2016 16:23:08,550] DEBUG VoConJNI-Linux - Grammar compile OK
[16/08/2016 16:23:08,551] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST_SECONDPASS=3
[16/08/2016 16:23:08,551] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST=3
[16/08/2016 16:23:08,552] DEBUG AsrBridge - Creating context for PartialUtteranceSearchItem(de-DE)...
[16/08/2016 16:23:08,552] DEBUG AsrBridge - Compiling BNF grammar:
#BNF+EMV2.1;
!grammar PartialUtteranceSearchItem;
!start <PartialUtterance_SearchItem>;
<PartialUtterance_SearchItem>:((<DET> <SEARCHITEM>)|<SEARCHITEM>);
<DET>:((der|die|das|den|dem|ein|eine|einem|einen|einer|oiner|an|a|in|im|oim));
<SEARCHITEM>:(<...>);
[16/08/2016 16:23:08,552] DEBUG VoConJNI-Linux - Grammar precompile...
[16/08/2016 16:23:08,566] DEBUG VoConJNI-Linux - Grammar precompile OK
[16/08/2016 16:23:08,566] DEBUG VoConJNI-Linux - Grammar compile...
[16/08/2016 16:23:08,568] DEBUG VoConJNI-Linux - Grammar compile OK
[16/08/2016 16:23:08,569] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST_SECONDPASS=3
[16/08/2016 16:23:08,569] DEBUG VoconConfigurator - Setting default context parameter LH_CTX_PARAM_MAXNBEST=3
[16/08/2016 16:23:08,570] INFO AsrBridge - Initializing ASR bridge completed.
[16/08/2016 16:23:08,570] INFO Middleware - Response from 'de.semvox.ASR': StatusSuccess, Initialize
[16/08/2016 16:23:08,571] INFO Middleware - Received service request: Initialize (from de.semvox.SQUINT)
[16/08/2016 16:23:08,572] INFO Middleware - Service 'de.semvox.TTS' handles request: INITIALIZE=Initialize
[16/08/2016 16:23:08,574] DEBUG SNC - Try to load libsnc...
[16/08/2016 16:23:08,574] INFO SNC - libsnc loaded
[16/08/2016 16:23:08,575] DEBUG SNC - SNC initialized
[16/08/2016 16:23:08,575] DEBUG SNC - Try to load libvocalizer4odp...
[16/08/2016 16:23:08,582] INFO SNC - libvocalizer4odp loaded
[16/08/2016 16:23:08,583] INFO SNC - Artifact 'vocalizer-jni-linux' validation passed
[16/08/2016 16:23:08,586] INFO VocalizerJNI-Linux - Vocalizer Version: 1.5.0
[16/08/2016 16:23:08,587] DEBUG VocalizerJNI-Linux - PDI initialize
[16/08/2016 16:23:08,587] INFO VocalizerJNI-Linux - PDI initialized
[16/08/2016 16:23:08,588] DEBUG VocalizerJNI-Linux - TTS initialize
[16/08/2016 16:23:08,588] INFO VocalizerJNI-Linux - TTS initialized
[16/08/2016 16:23:08,592] DEBUG VocalizerJNI-Linux - TTS open
[16/08/2016 16:23:08,592] INFO VocalizerJNI-Linux - TTS opened
[16/08/2016 16:23:08,626] INFO Middleware - Response from 'de.semvox.TTS': StatusSuccess, Initialize
[16/08/2016 16:23:08,627] INFO Middleware - Received event: InitializeSystem (from de.semvox.SQUINT)
[16/08/2016 16:23:08,635] INFO Middleware - Receiver 'de.semvox.SQUINT' handles event: UserPreferencesChanged
[16/08/2016 16:23:08,639] INFO Middleware - Receiver 'de.semvox.LanguageManager' handles event: UserPreferencesChanged
[16/08/2016 16:23:08,640] INFO Middleware - Receiver 'de.semvox.StickyEventStore' handles event: ConnectivityChanged
[16/08/2016 16:23:08,643] DEBUG SituationalContext - Current configuration:
Static: [
]
Dynamic: [
]
Sticky Events: [
http://www.semvox.de/types/odp/s3#ConnectivityChanged=object s3#ConnectivityChanged {
property s3#connectivity {
object s3#GoodConnectivity;
}
property common#createdAt {
"1471357388046"
}
property common#publisher {
"de.semvox.ConnectivityManager"
}
property common#id {
"10b52332-3f8a-4d2f-b0ee-fd3f49bd4906"
}
}
]
[16/08/2016 16:23:08,646] INFO Middleware - Receiver 'de.semvox.StickyEventStore' handles event: SystemInitialized
[16/08/2016 16:23:08,647] DEBUG SituationalContext - Current configuration:
Static: [
]
Dynamic: [
]
Sticky Events: [
http://www.semvox.de/types/subcon/integration#SystemInitialized=object int#SystemInitialized {
property common#createdAt {
"1471357388632"
}
property common#publisher {
"de.semvox.Middleware"
}
property common#id {
"938ea740-00f2-4ce4-93b6-234bd247037f"
}
}
http://www.semvox.de/types/odp/s3#ConnectivityChanged=object s3#ConnectivityChanged {
property s3#connectivity {
object s3#GoodConnectivity;
}
property common#createdAt {
"1471357388046"
}
property common#publisher {
"de.semvox.ConnectivityManager"
}
property common#id {
"10b52332-3f8a-4d2f-b0ee-fd3f49bd4906"
}
}
]
[16/08/2016 16:23:08,649] INFO Middleware - Receiver 'de.semvox.SQUINT' handles event: SystemInitialized
[16/08/2016 16:23:08,649] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlAbnormalSignalEventReceiver' handles event: ConnectivityChanged
[16/08/2016 16:23:08,650] INFO MshVoiceControlAbnormalSignalEventReceiver - Connectivity Changed event received
[16/08/2016 16:23:08,652] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:08,652] DEBUG PIPELINE - [#FF531A]Next input action: ResetDialog
[16/08/2016 16:23:08,654] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:08,654] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:08,655] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:08,656] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:08,657] DEBUG HotwordHandler - [#B3FFFF][select-hotword-grammars] created request:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#HotwordGrammar;
}
}
}
property common#createdAt {
"1471357388654"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"f0fbedc8-defa-4047-a6be-0486bb2024d8"
}
}
[16/08/2016 16:23:08,660] INFO Middleware - Receiver 'de.semvox.LifecycleReceiver' handles event: SystemInitialized
[16/08/2016 16:23:08,661] INFO MshVoiceControlAbnormalSignalEventReceiver - Connectivity Changed event received (now online)
[16/08/2016 16:23:08,662] DEBUG PIPELINE - [#FF531A]Processing interruptive input ResetDialog
[16/08/2016 16:23:08,665] INFO SQUINT:InteractionHistory - [#E7D1A2][on-dialog-canceled]
[16/08/2016 16:23:08,671] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:08,672] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:08,672] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:08,673] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:08,674] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357388671"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"2b4047f0-b618-4371-8a3f-90a02f8be3f5"
}
}
[16/08/2016 16:23:08,675] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:08,676] INFO SQUINT:DialogState - [#E7D1A2]DialogIdle -> DialogIdle
[16/08/2016 16:23:08,676] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:29,260] INFO MshVoiceControlAdapter - Event: Person Interact received from backend
[16/08/2016 16:23:29,262] INFO MshVoiceControlAdapter - SituationalContext Dialog Not Active
[16/08/2016 16:23:29,262] INFO Middleware - Received event: PersonInteract (from MshVoiceControlAdapter)
[16/08/2016 16:23:29,263] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlEventReceiver' handles event: PersonInteract
[16/08/2016 16:23:29,264] INFO MshVoiceControlService - Saving Intention Request
[16/08/2016 16:23:29,264] INFO Middleware - Received service request: PresentEvent (from MshVoiceControlEventReceiver)
[16/08/2016 16:23:29,264] INFO Middleware - Service 'de.semvox.SQUINT' handles request: PRESENT_EVENT=PresentEvent
[16/08/2016 16:23:29,266] INFO Middleware - Response from 'de.semvox.SQUINT': StatusAccepted, PresentEvent
[16/08/2016 16:23:29,268] DEBUG PIPELINE - [#FF531A]Next input action: PresentEvent(AsSoonAsPossible, PersonInteract)
[16/08/2016 16:23:29,269] INFO PIPELINE - [#FF531A]Processing deferrable input PresentEvent(AsSoonAsPossible, PersonInteract)
[16/08/2016 16:23:29,270] INFO SQUINT:DialogState - [#E7D1A2]DialogIdle -> SystemTurnActive
[16/08/2016 16:23:29,270] INFO SQUINT:DialogState - [#E7D1A2]Calling beforeDialogStarted(false)
[16/08/2016 16:23:29,270] INFO SQUINT:DialogState - [#E7D1A2]Call returned: StatusSuccess
[16/08/2016 16:23:29,271] DEBUG SQUINT:DialogState - [#E7D1A2]Calling beforeSystemTurnStarted(false)
[16/08/2016 16:23:29,271] DEBUG SQUINT:DialogState - [#E7D1A2]Call returned: StatusSuccess
[16/08/2016 16:23:29,273] INFO Middleware - Received event: DialogStarted (from de.semvox.SQUINT)
[16/08/2016 16:23:29,274] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver' handles event: DialogStarted
[16/08/2016 16:23:29,275] INFO MshVoiceControlAbnormalSignalEventReceiver - DialogStarted event caught, setting situational factor dialogActive
[16/08/2016 16:23:29,275] INFO Middleware - Received event: SystemTurnStarted (from de.semvox.SQUINT)
[16/08/2016 16:23:29,277] INFO SQUINT:InteractionManager - [#4DFFFF]=== process PresentableEvent 'PersonInteract'===
[16/08/2016 16:23:29,277] DEBUG SQUINT:InteractionManager - [#B3FFFF][process-presentable-event] PresentableEvent:
object mm#PresentEvent {
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlEventReceiver"
}
property mm#event {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
property common#id {
"b8ae77c9-8284-4017-aed6-cf82bf46876a"
}
}
[16/08/2016 16:23:29,278] INFO Middleware - Received service request: ChangeSituationalContext (from MshVoiceControlAbnormalSignalEventReceiver)
[16/08/2016 16:23:29,279] INFO Middleware - Service 'de.semvox.StickyEventStore' handles request: CHANGE_SITUATIONAL_CONTEXT=ChangeSituationalContext
[16/08/2016 16:23:29,280] DEBUG PIPELINE - [#FF794D]Next join action: ProceedAndCall
[16/08/2016 16:23:29,281] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:29,281] DEBUG SituationalContext - Current configuration:
Static: [
]
Dynamic: [
++ object mshVoiceControl#DialogActive;
]
Sticky Events: [
http://www.semvox.de/types/subcon/integration#SystemInitialized=object int#SystemInitialized {
property common#createdAt {
"1471357388632"
}
property common#publisher {
"de.semvox.Middleware"
}
property common#id {
"938ea740-00f2-4ce4-93b6-234bd247037f"
}
}
http://www.semvox.de/types/odp/s3#ConnectivityChanged=object s3#ConnectivityChanged {
property s3#connectivity {
object s3#GoodConnectivity;
}
property common#createdAt {
"1471357388046"
}
property common#publisher {
"de.semvox.ConnectivityManager"
}
property common#id {
"10b52332-3f8a-4d2f-b0ee-fd3f49bd4906"
}
}
]
[16/08/2016 16:23:29,283] DEBUG PIPELINE - [#FF531A]Proceeding with ProceedAndCall
[16/08/2016 16:23:29,284] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:29,285] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:29,285] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:29,286] INFO SQUINT:InteractionManager - [#B3FFFF][process-presentable-event] trying to execute PresentableEvent: PersonInteract
[16/08/2016 16:23:29,286] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:29,287] INFO SQUINT:InteractionManager - [#B3FFFF][process-presentable-event] last speech output took place at '1471357387674' /current time is '1471357409286' / gap is '21612'
[16/08/2016 16:23:29,287] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357409284"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"c3550caf-a22d-4ed0-88cc-47129493a79b"
}
}
[16/08/2016 16:23:29,288] DEBUG SQUINT:ApplicationEventProcessor - [#4DFFFF][process-presentable-event] event is:
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
[16/08/2016 16:23:29,289] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:29,290] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:29,290] INFO SQUINT:ApplicationEventProcessor - [#B3FFFF][process-presentable-event] select event definition 'PERSON_INTERACT'
[16/08/2016 16:23:29,290] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:29,290] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:29,291] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:29,291] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357409289"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"361047d5-350a-48ec-8470-7d522ce601b0"
}
}
[16/08/2016 16:23:29,292] DEBUG SQUINT:InteractionManager - [#B3FFFF][schedule-user-defined-acts] act:
object ia#Inform {
property common#content var: PERSON_INTERACT {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
}
[16/08/2016 16:23:29,294] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:29,295] INFO Middleware - Response from 'de.semvox.StickyEventStore': StatusSuccess, ChangeSituationalContext
[16/08/2016 16:23:29,295] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver' handles event: SystemTurnStarted
[16/08/2016 16:23:29,296] DEBUG SQUINT:InteractionManager - [#B3FFFF][schedule-user-defined-acts] act:
object ia#RequestTask {
property common#content {
object mshVoiceControl#ProductSearch;
}
}
[16/08/2016 16:23:29,301] INFO Middleware - Received event: ActivatedPresentableEvent (from de.semvox.SQUINT)
[16/08/2016 16:23:29,304] INFO SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] schedule size: '2'
[16/08/2016 16:23:29,305] INFO SQUINT:PresentationManager - [#D47DD4][present-output] got 1 jobs to process
[16/08/2016 16:23:29,305] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] interaction trigger:
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
[16/08/2016 16:23:29,307] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] interactionAct to process:
object ia#Inform {
property common#content var: PERSON_INTERACT {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
[16/08/2016 16:23:29,311] INFO Middleware - Received service request: GenerateOutput (from de.semvox.SQUINT)
[16/08/2016 16:23:29,312] INFO Middleware - Service 'de.semvox.SPIT' handles request: GENERATE=GenerateOutput
[16/08/2016 16:23:29,359] INFO TemplateEngine - Applying template: Inform_PersonInteract from collection Inform
[16/08/2016 16:23:29,365] INFO Middleware - Response from 'de.semvox.SPIT': StatusSuccess, GenerateOutput
[16/08/2016 16:23:29,365] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] generated output:
object nlg#GeneratedOutput {
property common#stringValue {
"<?xml version=\"1.0\"?><speak version=\"1.1\" xmlns=\"http://www.w3.org/2001/10/synthesis\" xmlns:xsi=\"http://www.w3.org/2001/XMLSchema-instance\" xsi:schemaLocation=\"http://www.w3.org/2001/10/synthesis http://www.w3.org/TR/speech-synthesis11/synthesis.xsd\" xml:lang=\"de-DE\">welches produkt?</speak>"
}
property tts#voice {
object tts#Voice {
property tts#generatorRef {
"Inform_PersonInteract from collection Inform"
}
}
}
}
[16/08/2016 16:23:29,366] DEBUG SQUINT:PresentationManager - [#E0A3E0]earliest execution time of first speechoutput is 1471357409270
[16/08/2016 16:23:29,367] INFO SQUINT:PresentationManager - [#E0A3E0][on-output-generated] updated jobs after postprocessing: 1
[16/08/2016 16:23:29,369] INFO SQUINT:PresentationManager - [#E0A3E0][present-output] start processing jobs...
[16/08/2016 16:23:29,369] DEBUG PIPELINE - [#FF794D]Next join action: DoGrammarActivation
[16/08/2016 16:23:29,369] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:29,370] DEBUG PIPELINE - [#FF531A]Forking DoGrammarActivation
[16/08/2016 16:23:29,370] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:29,371] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:29,371] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:29,371] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:29,372] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:29,372] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357409371"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"0cc42b8a-76eb-493f-93fb-ff9f9a7245c2"
}
}
[16/08/2016 16:23:29,373] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:29,374] DEBUG PIPELINE - [#FF794D]Next join action: DoSpeechOutput
[16/08/2016 16:23:29,374] DEBUG PIPELINE - [#FF531A]Waiting for DoSpeechOutput
[16/08/2016 16:23:29,375] DEBUG SQUINT:PresentationManager - [#E0A3E0][present-output] rendering action (speech channel):
object ia#OutputAction {
property ia#expectation {
object ia#Expectation;
}
property common#createdAt {
"1471357409295"
}
property ia#intAct {
object ia#Inform {
property common#content var: PERSON_INTERACT {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
property-list mm#appliedModalities {
object mm#Speech;
}
}
[16/08/2016 16:23:29,377] INFO SQUINT:PresentationManager - [#D47DD4]*** UTTERANCE (SYSTEM): SSML(de-DE, "welches produkt?")
[16/08/2016 16:23:29,377] INFO Middleware - Received service request: StartSpeaking (from de.semvox.SQUINT)
[16/08/2016 16:23:29,377] INFO Middleware - Service 'de.semvox.TTS' handles request: START_SPEAKING=StartSpeaking
[16/08/2016 16:23:29,378] INFO Middleware - Response from 'de.semvox.TTS': StatusAccepted, StartSpeaking
[16/08/2016 16:23:29,378] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:29,383] INFO VocalizerJNI-Linux - Alsa open...
[16/08/2016 16:23:29,383] INFO VocalizerJNI-Linux - PCM device: default
[16/08/2016 16:23:29,396] DEBUG VocalizerJNI-Linux - PCM prepared
[16/08/2016 16:23:29,396] INFO VocalizerJNI-Linux - Alsa opened
[16/08/2016 16:23:29,397] INFO VocalizerJNI-Linux - Process START
[16/08/2016 16:23:29,403] INFO Middleware - Received event: VoiceOutputStarted (from de.semvox.TTS)
[16/08/2016 16:23:29,411] INFO Middleware - Receiver 'de.semvox.SQUINT' handles event: VoiceOutputStarted
[16/08/2016 16:23:29,412] DEBUG PIPELINE - [#FF531A]Next input action: Notify(VoiceOutputStarted)
[16/08/2016 16:23:29,413] DEBUG SQUINT:PresentationManager - [#D47DD4][do-speech-output] on VoiceOutputStarted
[16/08/2016 16:23:29,414] DEBUG SQUINT:InteractionHistory - [#E7D1A2][on-rendering-started] markedOutput: {}
[16/08/2016 16:23:29,414] INFO Middleware - Receiver 'de.semvox.AudioReceiver' handles event: VoiceOutputStarted
[16/08/2016 16:23:29,420] DEBUG SQUINT:InteractionHistory - [#E7D1A2][set-user-intention] make salient:
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
[16/08/2016 16:23:29,422] DEBUG PIPELINE - [#FF794D]Not notifying with Notify(VoiceOutputStarted). Wait(DoSpeechOutput) still pending...
[16/08/2016 16:23:30,126] INFO VocalizerJNI-Linux - Process DONE
[16/08/2016 16:23:30,657] DEBUG VocalizerJNI-Linux - PCM stopped
[16/08/2016 16:23:30,659] INFO VocalizerJNI-Linux - Alsa closed
[16/08/2016 16:23:30,660] INFO Middleware - Received event: VoiceOutputFinished (from de.semvox.TTS)
[16/08/2016 16:23:30,661] INFO Middleware - Receiver 'de.semvox.SQUINT' handles event: VoiceOutputFinished
[16/08/2016 16:23:30,661] INFO Middleware - Receiver 'de.semvox.AudioReceiver' handles event: VoiceOutputFinished
[16/08/2016 16:23:30,661] DEBUG PIPELINE - [#FF531A]Next input action: Notify(VoiceOutputFinished)
[16/08/2016 16:23:30,662] DEBUG PIPELINE - [#FF531A]Notifying DoSpeechOutput with
object tts#VoiceOutputFinished {
property tts#bargeIn {
"false"
}
property common#createdAt {
"1471357410660"
}
property common#publisher {
"de.semvox.TTS"
}
property common#id {
"53047044-7042-4775-8064-eb9024474962"
}
property tts#synthesisId {
"56770a59-5ca0-4f78-884b-13fc36943a35"
}
}
[16/08/2016 16:23:30,663] DEBUG PIPELINE - [#FF794D]Next join action: Proceed
[16/08/2016 16:23:30,663] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:30,663] DEBUG PIPELINE - [#FF531A]Proceeding with Proceed
[16/08/2016 16:23:30,664] INFO SQUINT:InteractionManager - [#B3FFFF][callback] on output processed (openMic:false)
[16/08/2016 16:23:30,664] DEBUG PIPELINE - [#FF794D]Next join action: ProceedAndCall
[16/08/2016 16:23:30,664] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:30,664] DEBUG PIPELINE - [#FF531A]Proceeding with ProceedAndCall
[16/08/2016 16:23:30,665] INFO SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] schedule size: '1'
[16/08/2016 16:23:30,665] INFO SQUINT:InteractionManager - [#4DFFFF]process TaskRequestAction
[16/08/2016 16:23:30,666] DEBUG SQUINT:TaskProcessor - [#4DFFFF][task-processing] process user act:
object ia#RequestTask {
property common#derivedFrom {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
property common#content {
object mshVoiceControl#ProductSearch;
}
property mm#initiator {
object mm#SystemAgent;
}
}
[16/08/2016 16:23:30,668] INFO SQUINT:TaskModelHandler - [#B3FFFF][evaluate-task-processability] select task definition for task ProductSearch
[16/08/2016 16:23:30,673] DEBUG SQUINT:PreconditionEvaluator - [#B3FFFF][situational-precondition] factor matches:
object mm#SituationalFactorCondition {
property common#name {
"Connectivity"
}
property alg#pattern {
object s3#Online;
}
}
[16/08/2016 16:23:30,674] DEBUG SQUINT:TaskModelHandler - [#E5FFFF][evaluate-task-processability] [evaluate task] selected task definition:
object squint#TaskExecutionDefinition {
property-list squint#subsequentReactions {
object squint#SubsequentReaction {
property-list squint#systemActs {
object ia#RequestTask {
property common#content {
object mshVoiceControl#Navigation {
property common#derivedFrom var: TASK_EXECUTION_RESULT;
property mshVoiceControl#destination var: DEPARTMENT;
}
}
}
}
property squint#triggeredByTaskStatus {
object mm#Released {
property mm#taskExecutionResult var: TASK_EXECUTION_RESULT {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#product {
object mshVoiceControl#Product {
property mshVoiceControl#department var: DEPARTMENT;
}
}
property int#responseStatus {
object int#StatusSuccess;
}
}
}
}
}
}
object squint#SubsequentReaction {
property-list squint#systemActs {
object ia#RequestTask {
property common#content {
object mshVoiceControl#ProductSearch {
property common#derivedFrom {
object mshVoiceControl#ProductSearch {
property int#responseStatus {
object mshVoiceControl#StatusNoProductFound;
}
}
}
}
}
}
}
property squint#triggeredByTaskStatus {
object mm#ErrorOnExecution {
property mm#taskExecutionResult {
object mshVoiceControl#ProductSearch {
property int#responseStatus {
object mshVoiceControl#StatusNoProductFound;
}
}
}
}
}
}
object squint#SubsequentReaction {
property-list squint#systemActs {
object ia#Inform {
property common#content;
}
object ia#RequestTask {
property common#content {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mshVoiceControl#errorCode {
object asr#CloudAsrNotAvailable;
}
}
}
}
}
property squint#triggeredByTaskStatus {
object squint#InsuffientNetworkConnectivity;
}
}
}
property squint#interruptionDirective {
object squint#CancelTaskOnInterruption;
}
property squint#useHypothesisFusion {
"true"
}
property squint#allowCorrectLastStepIntoClosedSelectionSpaces {
"true"
}
property-list squint#activateTasks {
object mshVoiceControl#Navigation {
property mshVoiceControl#destination {
object mshVoiceControl#ServiceLocation;
}
}
}
property squint#taskConfirmationDirective {
object squint#NeverConfirmExecution;
}
property mm#task var: PRODUCT_SEARCH {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem var: SEARCH_ITEM matching-relevance: optional;
}
}
property common#name {
"PRODUCT_SEARCH"
}
property squint#cancelationDirective;
property-list squint#slotDefinitions {
object squint#ObjectSingleSlotToFill {
property squint#activateAsrAutomatically {
"true"
}
property squint#slotRange {
object mshVoiceControl#SearchItem;
}
property squint#slotType {
object squint#MandatorySlot;
}
property common#content var: SEARCH_ITEM;
property squint#ellipsisDirective;
property squint#context {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem {
object mshVoiceControl#SearchItem;
}
}
}
property alg#pattern {
object mshVoiceControl#SearchItem;
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property asr#recognitionMode {
object asr#HybridMode;
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH/SEARCH_ITEM"
}
}
}
property-list squint#preconditions {
object squint#SituationalPreconditionDefinition {
property squint#precondition var: Connectivity {
object mm#SituationalFactorCondition {
property common#name {
"Connectivity"
}
property alg#pattern {
object s3#Online;
}
}
}
property squint#onPreconditionFailed {
object squint#InsuffientNetworkConnectivity;
}
}
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property asr#recognitionMode {
object asr#HybridMode;
}
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH"
}
}
[16/08/2016 16:23:30,682] INFO SQUINT:TaskModelHandler - [#B3FFFF][evaluate-task-processability] [evaluate task] selected task definition with name PRODUCT_SEARCH (processing took 14 ms)
[16/08/2016 16:23:30,683] DEBUG SQUINT:TaskProcessor - [#4DFFFF][task-processing] process RequestTask
[16/08/2016 16:23:30,683] INFO SQUINT:InteractionManager - [#B3FFFF][is-task-focused] is focused by previous interaction: false
[16/08/2016 16:23:30,685] DEBUG SQUINT:TaskStateHandler - [#E7D1A2][task-state] changed event:TaskStarted
[16/08/2016 16:23:30,685] INFO Middleware - Received event: TaskStarted (from de.semvox.SQUINT)
[16/08/2016 16:23:30,693] DEBUG SQUINT:TaskProcessor - [#4DFFFF]********************** START processing SIMPLE slot 'SEARCH_ITEM' **********************
[16/08/2016 16:23:30,693] DEBUG SQUINT:TaskProcessor - [#B3FFFF][process-slots] user slot:
object squint#ObjectSingleSlotToFill {
property squint#activateAsrAutomatically {
"true"
}
property squint#slotRange {
object mshVoiceControl#SearchItem;
}
property squint#slotType {
object squint#MandatorySlot;
}
property common#content var: SEARCH_ITEM;
property squint#ellipsisDirective;
property squint#context {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem {
object mshVoiceControl#SearchItem;
}
}
}
property alg#pattern {
object mshVoiceControl#SearchItem;
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property asr#recognitionMode {
object asr#HybridMode;
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH/SEARCH_ITEM"
}
}
[16/08/2016 16:23:30,697] DEBUG SQUINT:TaskProcessor - [#B3FFFF][process-slots] slot after assignment / possibilities processing / validation:
object squint#ObjectSingleSlotToFill {
property squint#activateAsrAutomatically {
"true"
}
property squint#slotRange {
object mshVoiceControl#SearchItem;
}
property squint#slotType {
object squint#MandatorySlot;
}
property common#content var: SEARCH_ITEM;
property squint#ellipsisDirective;
property squint#context {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem {
object mshVoiceControl#SearchItem;
}
}
}
property alg#pattern {
object mshVoiceControl#SearchItem;
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property asr#recognitionMode {
object asr#HybridMode;
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH/SEARCH_ITEM"
}
}
[16/08/2016 16:23:30,700] DEBUG SQUINT:TaskProcessor - [#4DFFFF][process-slots] user slot is POSSIBLE
[16/08/2016 16:23:30,700] DEBUG SQUINT:TaskProcessor - [#4DFFFF]********************** END processing SIMPLE slot 'SEARCH_ITEM' **********************
[16/08/2016 16:23:30,701] DEBUG SQUINT:TaskProcessor - [#4DFFFF][new-completion-state] number of preset-slots: 0
[16/08/2016 16:23:30,701] DEBUG SQUINT:TaskProcessor - [#4DFFFF][create-task-completion-state] new task completion state:
object squint#TaskCompletionState {
property squint#changeLog {
object squint#TaskUpdates {
property common#derivedFrom {
object ia#RequestTask {
property common#derivedFrom {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
property common#content {
object mshVoiceControl#ProductSearch {
property mm#taskId {
"task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4"
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
}
}
property mm#task {
object mshVoiceControl#ProductSearch {
property mm#taskId {
"task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4"
}
property mshVoiceControl#searchItem var: SEARCH_ITEM matching-relevance: optional;
}
}
property squint#taskDefinition {
object squint#TaskExecutionDefinition {
property-list squint#subsequentReactions {
object squint#SubsequentReaction {
property-list squint#systemActs {
object ia#RequestTask {
property common#content {
object mshVoiceControl#Navigation {
property common#derivedFrom var: TASK_EXECUTION_RESULT;
property mshVoiceControl#destination var: DEPARTMENT;
}
}
}
}
property squint#triggeredByTaskStatus {
object mm#Released {
property mm#taskExecutionResult var: TASK_EXECUTION_RESULT {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#product {
object mshVoiceControl#Product {
property mshVoiceControl#department var: DEPARTMENT;
}
}
property int#responseStatus {
object int#StatusSuccess;
}
}
}
}
}
}
object squint#SubsequentReaction {
property-list squint#systemActs {
object ia#RequestTask {
property common#content {
object mshVoiceControl#ProductSearch {
property common#derivedFrom {
object mshVoiceControl#ProductSearch {
property int#responseStatus {
object mshVoiceControl#StatusNoProductFound;
}
}
}
}
}
}
}
property squint#triggeredByTaskStatus {
object mm#ErrorOnExecution {
property mm#taskExecutionResult {
object mshVoiceControl#ProductSearch {
property int#responseStatus {
object mshVoiceControl#StatusNoProductFound;
}
}
}
}
}
}
object squint#SubsequentReaction {
property-list squint#systemActs {
object ia#Inform {
property common#content;
}
object ia#RequestTask {
property common#content {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mshVoiceControl#errorCode {
object asr#CloudAsrNotAvailable;
}
}
}
}
}
property squint#triggeredByTaskStatus {
object squint#InsuffientNetworkConnectivity;
}
}
}
property squint#interruptionDirective {
object squint#CancelTaskOnInterruption;
}
property squint#useHypothesisFusion {
"true"
}
property squint#allowCorrectLastStepIntoClosedSelectionSpaces {
"true"
}
property-list squint#activateTasks {
object mshVoiceControl#Navigation {
property mshVoiceControl#destination {
object mshVoiceControl#ServiceLocation;
}
}
}
property squint#taskConfirmationDirective {
object squint#NeverConfirmExecution;
}
property mm#task var: PRODUCT_SEARCH {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem var: SEARCH_ITEM matching-relevance: optional;
}
}
property common#name {
"PRODUCT_SEARCH"
}
property squint#cancelationDirective;
property-list squint#slotDefinitions {
object squint#ObjectSingleSlotToFill id: ID_5cd762c0-1245-40da-8ac9-d7ad613d7dbc {
property squint#activateAsrAutomatically {
"true"
}
property squint#slotRange {
object mshVoiceControl#SearchItem;
}
property squint#slotType {
object squint#MandatorySlot;
}
property common#content var: SEARCH_ITEM;
property squint#ellipsisDirective;
property squint#context {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem {
object mshVoiceControl#SearchItem;
}
}
}
property alg#pattern {
object mshVoiceControl#SearchItem;
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property asr#recognitionMode {
object asr#HybridMode;
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH/SEARCH_ITEM"
}
}
}
property-list squint#preconditions {
object squint#SituationalPreconditionDefinition {
property squint#precondition var: Connectivity {
object mm#SituationalFactorCondition {
property common#name {
"Connectivity"
}
property alg#pattern {
object s3#Online;
}
}
}
property squint#onPreconditionFailed {
object squint#InsuffientNetworkConnectivity;
}
}
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property asr#recognitionMode {
object asr#HybridMode;
}
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH"
}
}
}
property-list squint#possibleSlots {
object squint#ObjectSingleSlotToFill ref: ID_5cd762c0-1245-40da-8ac9-d7ad613d7dbc;
}
property int#completed {
"false"
}
}
[16/08/2016 16:23:30,709] INFO SQUINT:TaskProcessor - [#B3FFFF][task-processing] task is completed: false
[16/08/2016 16:23:30,709] DEBUG TriggerSlotFillingStrategy - [#B3FFFF][slot-filling-strategy] contains invalid slot filler: null
[16/08/2016 16:23:30,709] DEBUG SQUINT:TaskProcessor - [#B3FFFF] [slot-filling-strategy] selected mandatory simple slot:
object squint#ObjectSingleSlotToFill {
property squint#activateAsrAutomatically {
"true"
}
property squint#slotRange {
object mshVoiceControl#SearchItem;
}
property squint#slotType {
object squint#MandatorySlot;
}
property common#content var: SEARCH_ITEM;
property squint#ellipsisDirective;
property squint#context {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem {
object mshVoiceControl#SearchItem;
}
}
}
property alg#pattern {
object mshVoiceControl#SearchItem;
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property asr#recognitionMode {
object asr#HybridMode;
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH/SEARCH_ITEM"
}
}
[16/08/2016 16:23:30,712] INFO SQUINT:TaskProcessor - [#4DFFFF][task-processing] selected task completion strategy: TriggerSlotFillingStrategy
[16/08/2016 16:23:30,712] DEBUG SQUINT:TaskProcessor - [#B3FFFF][update-task-log] log provided by context processor:
object squint#TaskUpdates {
property common#derivedFrom {
object ia#RequestTask {
property common#derivedFrom {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
property common#content {
object mshVoiceControl#ProductSearch {
property mm#taskId {
"task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4"
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
property squint#slotFillingCompleted {
"false"
}
}
[16/08/2016 16:23:30,713] DEBUG SQUINT:TaskProcessor - [#4DFFFF][update-task-log] updated:
object squint#TaskUpdates {
property common#derivedFrom {
object ia#RequestTask {
property common#derivedFrom {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
property common#content {
object mshVoiceControl#ProductSearch {
property mm#taskId {
"task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4"
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
property squint#slotFillingCompleted {
"false"
}
}
[16/08/2016 16:23:30,715] DEBUG SQUINT:TaskStateHandler - [#E7D1A2][task-state] number of UpdateStepsProvided: 0
[16/08/2016 16:23:30,715] DEBUG SQUINT:TaskProcessor - [#B3FFFF] [slot-filling-strategy] selected mandatory simple slot:
object squint#ObjectSingleSlotToFill {
property squint#activateAsrAutomatically {
"true"
}
property squint#slotRange {
object mshVoiceControl#SearchItem;
}
property squint#slotType {
object squint#MandatorySlot;
}
property common#content var: SEARCH_ITEM;
property squint#ellipsisDirective;
property squint#context {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem {
object mshVoiceControl#SearchItem;
}
}
}
property alg#pattern {
object mshVoiceControl#SearchItem;
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property asr#recognitionMode {
object asr#HybridMode;
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH/SEARCH_ITEM"
}
}
[16/08/2016 16:23:30,718] INFO TriggerSlotFillingStrategy - [#B3FFFF][slot-filling-strategy] trigger standard user slot filling of mandatory slot
[16/08/2016 16:23:30,732] DEBUG SQUINT:TaskProcessor - [#4DFFFF]available subsequent reaction for contains ReferenceNotFound issue : true
[16/08/2016 16:23:30,732] DEBUG SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] execute new schedule
[16/08/2016 16:23:30,732] INFO SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] schedule size: '1'
[16/08/2016 16:23:30,733] INFO SQUINT:PresentationManager - [#D47DD4][present-output] got 1 jobs to process
[16/08/2016 16:23:30,733] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] interaction trigger:
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
[16/08/2016 16:23:30,734] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] interactionAct to process:
object ia#Clarify {
property common#content {
object mshVoiceControl#ProductSearch {
property mm#taskId {
"task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4"
}
property mshVoiceControl#searchItem var: SEARCH_ITEM matching-relevance: optional;
}
}
property mm#initiator {
object mm#SystemAgent;
}
property ia#clarificationReason {
object squint#ObjectSingleSlotToFill {
property squint#activateAsrAutomatically {
"true"
}
property squint#slotRange {
object mshVoiceControl#SearchItem;
}
property squint#slotType {
object squint#MandatorySlot;
}
property common#content var: SEARCH_ITEM;
property squint#ellipsisDirective;
property squint#context {
object mshVoiceControl#ProductSearch {
property mshVoiceControl#searchItem {
object mshVoiceControl#SearchItem;
}
}
}
property alg#pattern {
object mshVoiceControl#SearchItem;
}
property squint#grammarActivation {
object squint#GrammarActivationDirective {
property asr#recognitionMode {
object asr#HybridMode;
}
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property nlu#matchFuzzy {
"false"
}
property squint#inherit {
"true"
}
}
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#PRODUCT_SEARCH/SEARCH_ITEM"
}
}
}
}
[16/08/2016 16:23:30,737] INFO Middleware - Received service request: GenerateOutput (from de.semvox.SQUINT)
[16/08/2016 16:23:30,738] INFO Middleware - Service 'de.semvox.SPIT' handles request: GENERATE=GenerateOutput
[16/08/2016 16:23:30,741] INFO TemplateEngine - Applying template: Clarify_ObjectSingleSlotToFill_ProductSearch_SearchItem from collection Clarify
[16/08/2016 16:23:30,742] INFO Middleware - Response from 'de.semvox.SPIT': StatusNoContent, GenerateOutput
[16/08/2016 16:23:30,742] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] generated output: null
[16/08/2016 16:23:30,743] DEBUG SQUINT:PresentationManager - [#E0A3E0]earliest execution time of first speechoutput is 1471357409270
[16/08/2016 16:23:30,744] INFO SQUINT:PresentationManager - [#E0A3E0][on-output-generated] updated jobs after postprocessing: 1
[16/08/2016 16:23:30,744] INFO SQUINT:PresentationManager - [#D47DD4][on-output-generated] nothing to speak: OutputAction
[16/08/2016 16:23:30,744] INFO SQUINT:PresentationManager - [#E0A3E0][present-output] start processing jobs...
[16/08/2016 16:23:30,744] DEBUG PIPELINE - [#FF794D]Next join action: DoGrammarActivation
[16/08/2016 16:23:30,744] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:30,745] DEBUG PIPELINE - [#FF531A]Forking DoGrammarActivation
[16/08/2016 16:23:30,745] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:30,745] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:30,746] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:30,746] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:30,750] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:30,750] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property common#name {
"ProductSearchGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"PartialUtteranceSearchItem"
}
}
object nlu#PreloadedGrammarSelector {
property common#name {
"ServicesGrammar"
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#YesNoGrammar;
}
}
}
property common#createdAt {
"1471357410745"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property-list nlu#selectedGrammars {
object nlu#SelectedGrammar {
property common#name {
"ServicesGrammar"
}
property-list nlu#onResults {
object asr#OpenDomainResult;
object asr#SemanticResult;
object asr#GrammarResult;
}
property asr#grammarType {
object asr#ContextGrammar;
}
property nlu#onMode {
object asr#GrammarMode;
}
}
object nlu#SelectedGrammar {
property common#name {
"ProductSearchGrammar"
}
property-list nlu#onResults {
object asr#OpenDomainResult;
object asr#SemanticResult;
object asr#GrammarResult;
}
property asr#grammarType {
object asr#ContextGrammar;
}
property nlu#onMode {
object asr#GrammarMode;
}
}
object nlu#SelectedGrammar {
property common#name {
"PartialUtteranceSearchItem"
}
property-list nlu#onResults {
object asr#OpenDomainResult;
object asr#SemanticResult;
object asr#GrammarResult;
}
property asr#grammarType {
object asr#ContextGrammar;
}
property nlu#onMode {
object asr#GrammarMode;
}
}
}
property common#id {
"0e5b95c2-0c62-48e7-8782-f5e11bdf46d1"
}
}
[16/08/2016 16:23:30,754] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: [ServicesGrammar, ProductSearchGrammar, PartialUtteranceSearchItem]
Previous: []
[16/08/2016 16:23:30,754] INFO SQUINT:GrammarManager - [#E7D1A2]Activating grammars: [ServicesGrammar, ProductSearchGrammar, PartialUtteranceSearchItem]
[16/08/2016 16:23:30,755] INFO Middleware - Received service request: ActivateGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:30,755] INFO Middleware - Service 'de.semvox.ASR' handles request: ACTIVATE_GRAMMARS=ActivateGrammars
[16/08/2016 16:23:30,756] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, ActivateGrammars
[16/08/2016 16:23:30,756] DEBUG PIPELINE - [#FF794D]Next join action: DoSleep(0)
[16/08/2016 16:23:30,756] DEBUG PIPELINE - [#FF531A]Forking DoSleep(0)
[16/08/2016 16:23:30,757] DEBUG VoConJNI-Linux - Context added
[16/08/2016 16:23:30,757] DEBUG PIPELINE - [#FF794D]Next join action: Proceed
[16/08/2016 16:23:30,757] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:30,757] DEBUG VoConJNI-Linux - Context added
[16/08/2016 16:23:30,757] DEBUG PIPELINE - [#FF531A]Proceeding with Proceed
[16/08/2016 16:23:30,757] DEBUG VoConJNI-Linux - Context added
[16/08/2016 16:23:30,757] INFO SQUINT:InteractionManager - [#B3FFFF][callback] on output processed (openMic:true)
[16/08/2016 16:23:30,758] DEBUG AsrBridge - Activated contexts: [ServicesGrammar, ProductSearchGrammar, PartialUtteranceSearchItem]
[16/08/2016 16:23:30,760] DEBUG PIPELINE - [#FF794D]Next join action: DoIncrementalSpeechInput(0)
[16/08/2016 16:23:30,760] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:30,761] DEBUG PIPELINE - [#FF531A]Waiting for DoIncrementalSpeechInput(0)
[16/08/2016 16:23:30,761] INFO SQUINT:DialogState - [#E7D1A2]SystemTurnActive -> UserTurnActive
[16/08/2016 16:23:30,761] DEBUG SQUINT:DialogState - [#E7D1A2]Calling afterSystemTurnFinished(false)
[16/08/2016 16:23:30,761] DEBUG SQUINT:DialogState - [#E7D1A2]Call returned.
[16/08/2016 16:23:30,761] DEBUG SQUINT:DialogState - [#E7D1A2]Calling beforeUserTurnStarted(false)
[16/08/2016 16:23:30,762] INFO MshVoiceControlBeepStrategy - before try to play beep
[16/08/2016 16:23:30,762] INFO MshVoiceControlBeepStrategy - creating Executor (should not happen here...)
[16/08/2016 16:23:30,763] DEBUG Beep - Playing beep:aplay data/sounds/OKGoogle.wav
[16/08/2016 16:23:31,063] DEBUG SQUINT:DialogState - [#E7D1A2]Call returned: StatusAccepted
[16/08/2016 16:23:31,064] INFO Middleware - Received event: SystemTurnFinished (from de.semvox.SQUINT)
[16/08/2016 16:23:31,064] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver' handles event: SystemTurnFinished
[16/08/2016 16:23:31,065] INFO Middleware - Received event: UserTurnStarted (from de.semvox.SQUINT)
[16/08/2016 16:23:31,066] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver' handles event: UserTurnStarted
[16/08/2016 16:23:31,066] DEBUG SQUINT:InteractionHistory - [#E7D1A2]converted TaskStateEvent to TaskState status:
object ia#TaskStarted {
property mm#task {
object mshVoiceControl#ProductSearch {
property mm#taskId {
"task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4"
}
}
}
property common#createdAt {
"1471357410685"
}
property common#publisher {
"de.semvox.SQUINT"
}
property common#id {
"253e867b-97c3-424c-94fa-007904d6e725"
}
}
[16/08/2016 16:23:31,067] INFO SQUINT:DoIncrementalSpeechInput - [#99FF99]Starting incremental recognition...
[16/08/2016 16:23:31,068] INFO Middleware - Received service request: StartRecognition (from de.semvox.SQUINT)
[16/08/2016 16:23:31,068] INFO Middleware - Service 'de.semvox.ASR' handles request: START_RECOGNITION=StartRecognition
[16/08/2016 16:23:31,069] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, StartRecognition
[16/08/2016 16:23:31,072] DEBUG AsrBridge - Using contexts: [ServicesGrammar, ProductSearchGrammar, PartialUtteranceSearchItem]
[16/08/2016 16:23:31,072] DEBUG SQUINT:IncrementalRecognitionState - [#99FF99][incremental-recognition] recognition mode: object asr#HybridMode;
[16/08/2016 16:23:31,073] DEBUG SQUINT:IncrementalRecognitionState - [#99FF99][incremental-recognition] setting as 'Pending': object asr#OnboardRecognition;
[16/08/2016 16:23:31,073] DEBUG VoconConfigurator - Setting default recognizer parameter LH_AUDIOSOURCE_PARAM_TIMEOUT=6000
[16/08/2016 16:23:31,074] DEBUG VoconConfigurator - Setting default recognizer parameter LH_FX_PARAM_TIMEOUT_SPEECH=5000
[16/08/2016 16:23:31,074] DEBUG SQUINT:IncrementalRecognitionState - [#99FF99][incremental-recognition] setting as 'Pending': object asr#OnlineRecognition;
[16/08/2016 16:23:31,074] DEBUG AsrBridge - Creating connection object (AppId=NMDPTRIAL_ulrich_reiser_unity_robotics_de20160215034519)...
[16/08/2016 16:23:31,075] INFO SQUINT:DoIncrementalSpeechInput - [#99FF99]Waiting for incremental recognition results (count=0)...
[16/08/2016 16:23:31,075] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:31,076] DEBUG VoConJNI-Linux - NMSP Connection initialized
[16/08/2016 16:23:31,076] DEBUG AsrBridge - Connecting to NMSP...
[16/08/2016 16:23:31,076] DEBUG VoConJNI-Linux - NMSP Connection connecting
[16/08/2016 16:23:31,157] DEBUG Beep - Playing beep: ExitValue :0
[16/08/2016 16:23:31,297] WARN VoConJNI-Linux - NMSP Connection Event: Connection failed. Message: Disconnected. Reason: vocon event
[16/08/2016 16:23:31,297] WARN AsrBridge - onNmspConnectionFailed()
[16/08/2016 16:23:31,297] WARN VoConJNI-Linux - NMSP Connection Event: Connection failed. Message: Connection failed. Reason: connect forbidden
[16/08/2016 16:23:31,299] DEBUG VoConJNI-Linux - NMSP Connection disconnected
[16/08/2016 16:23:31,301] DEBUG VoConJNI-Linux - NMSP Connection closed
[16/08/2016 16:23:31,301] DEBUG AsrBridge - Opened: RECOGNITION_GRAMMAR (id: 4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:31,302] DEBUG VoConJNI-Linux - ASR init
[16/08/2016 16:23:31,303] INFO VoConJNI-Linux - AudioIn Device Default
[16/08/2016 16:23:31,303] DEBUG VoConJNI-Linux - AudioIn Parameters: Frequency:16000, Buffers:50, Samples:960
[16/08/2016 16:23:31,305] DEBUG VoConJNI-Linux - AudioIn interface decorated
[16/08/2016 16:23:31,305] DEBUG VoConJNI-Linux - AudioIn initialized
[16/08/2016 16:23:31,305] DEBUG AsrBridge - onEvent(event: STARTED, id: 4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:31,307] INFO Middleware - Received event: RecognitionStarted (from de.semvox.ASR)
[16/08/2016 16:23:31,308] INFO Middleware - Receiver 'de.semvox.SQUINT' handles event: RecognitionStarted
[16/08/2016 16:23:31,309] DEBUG VoConJNI-Linux - ASR start (4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:31,309] INFO Middleware - Receiver 'de.semvox.AudioReceiver' handles event: RecognitionStarted
[16/08/2016 16:23:31,309] DEBUG VoConJNI-Linux - Output path /u/msh/wav/20160816_162331_4778a277-dc89-412b-9239-26000d82d85e.wav
[16/08/2016 16:23:31,309] DEBUG PIPELINE - [#FF531A]Next input action: Notify(RecognitionStarted)
[16/08/2016 16:23:31,309] DEBUG VoConJNI-Linux - Audio file opened
[16/08/2016 16:23:31,310] DEBUG PIPELINE - [#FF794D]Not notifying with Notify(RecognitionStarted). Wait(DoIncrementalSpeechInput(0)) still pending...
[16/08/2016 16:23:32,277] DEBUG VoConJNI-Linux - Event: Begin of speech
[16/08/2016 16:23:32,277] DEBUG AsrBridge - onEvent(event: START_OF_SPEECH, id: 4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:32,278] INFO Middleware - Received event: StartOfSpeech (from de.semvox.ASR)
[16/08/2016 16:23:32,279] INFO Middleware - Receiver 'de.semvox.SQUINT' handles event: StartOfSpeech
[16/08/2016 16:23:32,279] DEBUG PIPELINE - [#FF531A]Next input action: Notify(StartOfSpeech)
[16/08/2016 16:23:32,280] INFO Middleware - Receiver 'de.semvox.AudioReceiver' handles event: StartOfSpeech
[16/08/2016 16:23:32,280] DEBUG PIPELINE - [#FF794D]Not notifying with Notify(StartOfSpeech). Wait(DoIncrementalSpeechInput(0)) still pending...
[16/08/2016 16:23:33,669] DEBUG VoConJNI-Linux - Event: Result
[16/08/2016 16:23:33,670] DEBUG VoConJNI-Linux - ProcessDistributedRecResult
[16/08/2016 16:23:33,670] DEBUG VoConJNI-Linux - ProcessNormalRecResult
[16/08/2016 16:23:33,670] DEBUG VoConJNI-Linux - Create context-based result
[16/08/2016 16:23:33,672] DEBUG AsrBridge - onResult(size: 3, grammar: ServicesGrammar, id: 4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:33,672] DEBUG VoConJNI-Linux - Event: Result
[16/08/2016 16:23:33,672] DEBUG VoConJNI-Linux - ProcessDistributedRecResult
[16/08/2016 16:23:33,672] DEBUG VoConJNI-Linux - ProcessNormalRecResult
[16/08/2016 16:23:33,672] DEBUG VoConJNI-Linux - Create context-based result
[16/08/2016 16:23:33,673] DEBUG AsrBridge - onResult(size: 3, grammar: ProductSearchGrammar, id: 4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:33,673] DEBUG VoConJNI-Linux - Event: Result
[16/08/2016 16:23:33,673] DEBUG VoConJNI-Linux - ProcessDistributedRecResult
[16/08/2016 16:23:33,673] DEBUG VoConJNI-Linux - ProcessNormalRecResult
[16/08/2016 16:23:33,673] DEBUG VoConJNI-Linux - Create context-based result
[16/08/2016 16:23:33,674] DEBUG AsrBridge - onResult(size: 3, grammar: PartialUtteranceSearchItem, id: 4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:33,676] DEBUG AsrResult - Original results before filtering and sorting:
[16/08/2016 16:23:33,678] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.2557; quality=N/A; utt="in <...> ist"; lang=de-DE; refs=[ProductSearchGrammar#RequestTask_ProductSearch]; tags=[]; data={}]
[16/08/2016 16:23:33,679] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.2321; quality=N/A; utt="neues <...> ist"; lang=de-DE; refs=[ProductSearchGrammar#RequestTask_ProductSearch]; tags=[]; data={}]
[16/08/2016 16:23:33,679] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.0925; quality=N/A; utt="einen <...> ist"; lang=de-DE; refs=[ProductSearchGrammar#RequestTask_ProductSearch]; tags=[]; data={}]
[16/08/2016 16:23:33,679] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.3148; quality=N/A; utt="info"; lang=de-DE; refs=[ServicesGrammar#RequestTask_Navigation_Info]; tags=[]; data={}]
[16/08/2016 16:23:33,680] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.2225; quality=N/A; utt="klo"; lang=de-DE; refs=[ServicesGrammar#RequestTask_Navigation_WC]; tags=[]; data={}]
[16/08/2016 16:23:33,680] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.1331; quality=N/A; utt="toilette"; lang=de-DE; refs=[ServicesGrammar#RequestTask_Navigation_WC]; tags=[]; data={}]
[16/08/2016 16:23:33,680] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.0946; quality=N/A; utt="in <...>"; lang=de-DE; refs=[PartialUtteranceSearchItem#PartialUtterance_SearchItem]; tags=[]; data={}]
[16/08/2016 16:23:33,680] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.0946; quality=N/A; utt="das <...>"; lang=de-DE; refs=[PartialUtteranceSearchItem#PartialUtterance_SearchItem]; tags=[]; data={}]
[16/08/2016 16:23:33,681] DEBUG AsrResult - GrammarResult[source=GrammarRecognition; conf=0.0181; quality=N/A; utt="einen <...>"; lang=de-DE; refs=[PartialUtteranceSearchItem#PartialUtterance_SearchItem]; tags=[]; data={}]
[16/08/2016 16:23:33,684] INFO AsrResult - Results after filtering and sorting:
[16/08/2016 16:23:33,684] INFO AsrResult - Discarded results:
[16/08/2016 16:23:33,684] INFO AsrResult - GrammarResult[idx=3; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.3148; quality=N/A; utt="info"; lang=de-DE; refs=[ServicesGrammar#RequestTask_Navigation_Info]; tags=[]; data={}]
[16/08/2016 16:23:33,684] INFO AsrResult - GrammarResult[idx=0; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.2557; quality=N/A; utt="in <...> ist"; lang=de-DE; refs=[ProductSearchGrammar#RequestTask_ProductSearch]; tags=[]; data={}]
[16/08/2016 16:23:33,685] INFO AsrResult - GrammarResult[idx=1; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.2321; quality=N/A; utt="neues <...> ist"; lang=de-DE; refs=[ProductSearchGrammar#RequestTask_ProductSearch]; tags=[]; data={}]
[16/08/2016 16:23:33,685] INFO AsrResult - GrammarResult[idx=4; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.2225; quality=N/A; utt="klo"; lang=de-DE; refs=[ServicesGrammar#RequestTask_Navigation_WC]; tags=[]; data={}]
[16/08/2016 16:23:33,685] INFO AsrResult - GrammarResult[idx=5; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.1331; quality=N/A; utt="toilette"; lang=de-DE; refs=[ServicesGrammar#RequestTask_Navigation_WC]; tags=[]; data={}]
[16/08/2016 16:23:33,685] INFO AsrResult - GrammarResult[idx=6; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.0946; quality=N/A; utt="in <...>"; lang=de-DE; refs=[PartialUtteranceSearchItem#PartialUtterance_SearchItem]; tags=[]; data={}]
[16/08/2016 16:23:33,685] INFO AsrResult - GrammarResult[idx=7; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.0946; quality=N/A; utt="das <...>"; lang=de-DE; refs=[PartialUtteranceSearchItem#PartialUtterance_SearchItem]; tags=[]; data={}]
[16/08/2016 16:23:33,686] INFO AsrResult - GrammarResult[idx=2; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.0925; quality=N/A; utt="einen <...> ist"; lang=de-DE; refs=[ProductSearchGrammar#RequestTask_ProductSearch]; tags=[]; data={}]
[16/08/2016 16:23:33,686] INFO AsrResult - GrammarResult[idx=8; id=4778a277-dc89-412b-9239-26000d82d85e; source=GrammarRecognition; conf=0.0181; quality=N/A; utt="einen <...>"; lang=de-DE; refs=[PartialUtteranceSearchItem#PartialUtterance_SearchItem]; tags=[]; data={}]
[16/08/2016 16:23:33,686] INFO Middleware - Received event: RecognitionSuccessful (from de.semvox.ASR)
[16/08/2016 16:23:33,687] INFO Middleware - Receiver 'de.semvox.SQUINT' handles event: RecognitionSuccessful
[16/08/2016 16:23:33,687] INFO Middleware - Receiver 'de.semvox.AudioReceiver' handles event: RecognitionSuccessful
[16/08/2016 16:23:33,688] DEBUG PIPELINE - [#FF531A]Next input action: Notify(RecognitionSuccessful)
[16/08/2016 16:23:33,688] INFO MshVoiceControlBeepStrategy - onListeningStopped: RecognitionSuccessful try to play high pitch beep
[16/08/2016 16:23:33,688] DEBUG PIPELINE - [#FF531A]Notifying DoIncrementalSpeechInput(0) with
object asr#RecognitionSuccessful {
property asr#recognitionId {
"4778a277-dc89-412b-9239-26000d82d85e"
}
property common#createdAt {
"1471357413686"
}
property common#publisher {
"de.semvox.ASR"
}
property common#id {
"7bdb1ba8-4988-48f3-bd8f-52fb979deab0"
}
}
[16/08/2016 16:23:33,689] DEBUG Beep - Playing beep:aplay data/sounds/OKGoogle.wav
[16/08/2016 16:23:33,689] INFO SQUINT:DialogState - [#E7D1A2]UserTurnActive -> SystemTurnActive
[16/08/2016 16:23:33,689] DEBUG SQUINT:DialogState - [#E7D1A2]Calling afterUserTurnFinished(true)
[16/08/2016 16:23:33,689] DEBUG SQUINT:DialogState - [#E7D1A2]Call returned.
[16/08/2016 16:23:33,689] DEBUG SQUINT:DialogState - [#E7D1A2]Calling beforeSystemTurnStarted(true)
[16/08/2016 16:23:33,690] DEBUG SQUINT:DialogState - [#E7D1A2]Call returned: StatusSuccess
[16/08/2016 16:23:33,691] INFO Middleware - Received event: UserTurnFinished (from de.semvox.SQUINT)
[16/08/2016 16:23:33,692] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver' handles event: UserTurnFinished
[16/08/2016 16:23:33,693] INFO Middleware - Received event: SystemTurnStarted (from de.semvox.SQUINT)
[16/08/2016 16:23:33,694] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver' handles event: SystemTurnStarted
[16/08/2016 16:23:33,694] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:33,695] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:33,695] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:33,695] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:33,695] DEBUG HotwordHandler - [#B3FFFF][select-hotword-grammars] created request:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#HotwordGrammar;
}
}
}
property common#createdAt {
"1471357413694"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"8e969d6f-33f9-45e6-99ab-82e7e14734cd"
}
}
[16/08/2016 16:23:33,696] INFO SQUINT:DoIncrementalSpeechInput - [#99FF99]Finished by RecognitionSuccessful.
[16/08/2016 16:23:33,696] DEBUG PIPELINE - [#FF794D]Next join action: Proceed
[16/08/2016 16:23:33,696] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,697] DEBUG PIPELINE - [#FF531A]Proceeding with Proceed
[16/08/2016 16:23:33,701] DEBUG PIPELINE - [#FF794D]Next join action: [ContextProcessor] preprocess ASR event
[16/08/2016 16:23:33,701] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,702] DEBUG PIPELINE - [#FF531A]Proceeding with [ContextProcessor] preprocess ASR event
[16/08/2016 16:23:33,702] INFO SQUINT:Pipeline - [#33FF33]==== STARTED: ASR EVENT PROCESSING ====
[16/08/2016 16:23:33,702] DEBUG PIPELINE - [#FF794D]Next join action: [ContextProcessor] ASR event NLU processing
[16/08/2016 16:23:33,703] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,703] DEBUG PIPELINE - [#FF531A]Proceeding with [ContextProcessor] ASR event NLU processing
[16/08/2016 16:23:33,703] INFO SQUINT:ASRProcessor - [#33FF33]==== STARTED: NLU interpretation (1st level interpretation) ====
[16/08/2016 16:23:33,705] INFO SQUINT:ASRProcessor - [#33FF33]==== COMPLETED: NLU interpretation (took 1 ms) ====
[16/08/2016 16:23:33,705] DEBUG PIPELINE - [#FF794D]Next join action: [ContextProcessor] ASR event hypothesis enriching and selection
[16/08/2016 16:23:33,705] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,705] DEBUG PIPELINE - [#FF531A]Proceeding with [ContextProcessor] ASR event hypothesis enriching and selection
[16/08/2016 16:23:33,706] INFO SQUINT:Context:IntentionRecognition - [#33FF33]==== STARTED: task lifecycle evaluation ====
[16/08/2016 16:23:33,706] INFO SQUINT:HypoSelection - [#99FF99][select-hypotheses] *** source hypothesis selection ***
[16/08/2016 16:23:33,706] INFO SQUINT:HypoSelection - [#99FF99][select-hypotheses] no source hypo selection chain defined, using default strategy
[16/08/2016 16:23:33,707] INFO SQUINT:Context:IntentionRecognition - [#33FF33][intention-recognition] active task: ProductSearch
[16/08/2016 16:23:33,707] INFO SQUINT:HypoSelection - [#99FF99][select-hypotheses] *** source hypothesis selection (active task) ***
[16/08/2016 16:23:33,707] INFO SQUINT:HypoSelection - [#99FF99][select-hypotheses] no selection for active task defined, doing nothing
[16/08/2016 16:23:33,707] DEBUG SQUINT:TaskSwitchEval - [#99FF99][task-switch] no hypotheses: no task switch
[16/08/2016 16:23:33,707] DEBUG SQUINT:TaskSwitchEval - [#99FF99][task-switch] (switch task: 0, continue task: 0) => task switch: false
[16/08/2016 16:23:33,708] INFO SQUINT:Context:IntentionRecognition - [#99FF99][intention-recognition] select for: continue task
[16/08/2016 16:23:33,708] INFO SQUINT:Context:IntentionRecognition - [#33FF33]==== COMPLETED: task lifecycle evaluation (took 2 ms) ====
[16/08/2016 16:23:33,715] DEBUG SQUINT:InteractionHistory - [#E7D1A2]| INTERACTION HISTORY (1 turns, unrecognizedActCounter: 1)
[16/08/2016 16:23:33,715] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| salient (history): 1 elements
[16/08/2016 16:23:33,716] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| =====
[16/08/2016 16:23:33,716] DEBUG SQUINT:InteractionHistory - [#E7D1A2]| Interaction #0 (activation: 1471357409305, id dd3e2bc8-de91-4969-9692-c5107ed164ab)
[16/08/2016 16:23:33,716] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| user intention ('<unknown>'): <null>: null
[16/08/2016 16:23:33,716] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| system action: Inform:
object ia#OutputAction {
property common#createdAt {
"1471357409295"
}
property ia#intAct {
object ia#Inform {
property common#content var: PERSON_INTERACT {
object mshVoiceControl#PersonInteract {
property mshVoiceControl#question {
"welches produkt?"
}
property common#createdAt {
"1471357409264"
}
property common#publisher {
"MshVoiceControlAdapter"
}
property mm#importance {
object mm#UnspecifiedImportance;
}
property common#id {
"c28e451e-50a1-4957-a1c4-513d4f0e77d1"
}
property mm#timing {
object mm#AsSoonAsPossible;
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
property-list mm#appliedModalities {
object mm#Speech;
}
}
[16/08/2016 16:23:33,717] DEBUG SQUINT:InteractionHistory - [#F1E5CA]| task status: Started: object mm#Started;
[16/08/2016 16:23:33,718] DEBUG SQUINT:InteractionHistory - [#F1E5CA]| task: ProductSearch:
object mshVoiceControl#ProductSearch {
property mm#taskId {
"task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4"
}
property mshVoiceControl#searchItem var: SEARCH_ITEM matching-relevance: optional;
}
[16/08/2016 16:23:33,718] DEBUG SQUINT:InteractionHistory - [#F1E5CA]| occured taskStateEvent TaskStarted(ProductSearch)
[16/08/2016 16:23:33,718] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| <has no active selection space>
[16/08/2016 16:23:33,718] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| salient (interaction): 0 elements
[16/08/2016 16:23:33,719] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| ================================================
[16/08/2016 16:23:33,719] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| taskStatus=Started(ProductSearch)
[16/08/2016 16:23:33,719] DEBUG SQUINT:InteractionHistory - [#F1E5CA]| --------------------------------------------------------------
[16/08/2016 16:23:33,722] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| expected acts: [ Cancel (1) RequestTask:Navigation (2) ]
[16/08/2016 16:23:33,722] DEBUG SQUINT:InteractionHistory - [#F1E5CA]| --------------------------------------------------------------
[16/08/2016 16:23:33,722] DEBUG SQUINT:InteractionHistory - [#ECDBB6]| focused slots:
[16/08/2016 16:23:33,723] DEBUG SQUINT:InteractionHistory - [#F1E5CA]| SEARCH_ITEM --- [ObjectSingle | CONTEXT/CONTENT: (ProductSearch::SearchItemProperty/SearchItem)]
[16/08/2016 16:23:33,723] DEBUG SQUINT:InteractionHistory - [#F1E5CA]| --------------------------------------------------------------
[16/08/2016 16:23:33,723] INFO SQUINT:Context:ContextBasedInterpretation - [#33FF33]==== STARTED: context-based interpretation (2nd level interpretation) ====
[16/08/2016 16:23:33,723] INFO SQUINT:Context:ContextBasedInterpretation - [#33FF33]==== COMPLETED: context-based interpretation (took 0 ms) ====
[16/08/2016 16:23:33,724] INFO SQUINT:Context:HypothesisFusion - [#33FF33]==== STARTED: hypothesis fusion (0 hypotheses) ====
[16/08/2016 16:23:33,724] INFO SQUINT:Context:HypothesisFusion - [#33FF33]==== COMPLETED: hypothesis fusion, with 0 hypotheses remaining (took 0 ms) ====
[16/08/2016 16:23:33,725] INFO SQUINT:Context:HypothesisFusion - [#33FF33]==== STARTED: hypothesis fusion (0 hypotheses) ====
[16/08/2016 16:23:33,725] INFO SQUINT:Context:HypothesisFusion - [#33FF33]==== COMPLETED: hypothesis fusion, with 0 hypotheses remaining (took 0 ms) ====
[16/08/2016 16:23:33,725] INFO SQUINT:HypoSelection - [#99FF99][select-hypotheses] *** final task continuation hypothesis selection ***
[16/08/2016 16:23:33,725] INFO SQUINT:FinalContinueTaskHypoSelection - [#33FF33]*** Starting Legacy Hypothesis Selection (0 candidate hypos) ***
[16/08/2016 16:23:33,725] INFO SQUINT:FinalContinueTaskHypoSelection - [#99FF99][select-hypotheses] selecting hypotheses for active task 'ProductSearch' (slots: 1 focused, 0 expected, 0 possible, 0 filled)
[16/08/2016 16:23:33,725] DEBUG SQUINT:FinalContinueTaskHypoSelection - [#66FF66][select-hypotheses] select for 'focused object slot'
[16/08/2016 16:23:33,726] INFO SQUINT:FinalContinueTaskHypoSelection - [#33FF33]*** Hypothesis Selection complete (1 ms) ***
[16/08/2016 16:23:33,726] INFO SQUINT:HypoSelection - [#99FF99][select-hypotheses] applied strategy 1: SQUINT:FinalContinueTaskHypoSelection (0 => 0 hypotheses) ***
[16/08/2016 16:23:33,726] INFO SQUINT:Context:IntentionRecognition - [#33FF33]==== COMPLETED: context-based interpretation ====
[16/08/2016 16:23:33,727] DEBUG PIPELINE - [#FF794D]Next join action: [ContextProcessor] ASR event: postprocessing
[16/08/2016 16:23:33,727] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,728] DEBUG PIPELINE - [#FF531A]Proceeding with [ContextProcessor] ASR event: postprocessing
[16/08/2016 16:23:33,734] DEBUG SQUINT:Context:Processor - [#99FF99][send-context-event] context interpretation event:
object ia#ContextInterpretationEvent {
property common#createdAt {
"1471357413734"
}
property-list ia#contextInterpretationResults {
object ia#ContextInterpretationResult {
property ia#intAct {
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
}
}
}
property common#publisher {
"SQUINT:Context:Processor"
}
property common#success {
"false"
}
property common#id {
"contextInterpretation_7700d2ec-c2e6-401c-be17-77caee73a09c"
}
}
[16/08/2016 16:23:33,736] INFO Middleware - Received event: ContextInterpretationEvent (from de.semvox.SQUINT)
[16/08/2016 16:23:33,737] DEBUG SQUINT:Pipeline - [#66FF66][asr-event] ===> selected user intention:
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
[16/08/2016 16:23:33,738] DEBUG SQUINT:Pipeline - [#66FF66][asr-event] ===> task updates: object squint#TaskUpdates;
[16/08/2016 16:23:33,739] INFO SQUINT:Pipeline - [#33FF33]==== COMPLETED: ASR EVENT PROCESSING (took 37 ms) ====
[16/08/2016 16:23:33,740] DEBUG PIPELINE - [#FF794D]Next join action: Proceed
[16/08/2016 16:23:33,740] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,740] DEBUG PIPELINE - [#FF531A]Proceeding with Proceed
[16/08/2016 16:23:33,740] INFO SQUINT:InteractionManager - [#4DFFFF][interaction-management] received user intention UnrecognizedAct
[16/08/2016 16:23:33,740] DEBUG SQUINT:InteractionManager - [#4DFFFF][interaction-management] changelog from context processor: object squint#TaskUpdates;
[16/08/2016 16:23:33,741] DEBUG PIPELINE - [#FF794D]Next join action: ProceedAndCall
[16/08/2016 16:23:33,741] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,741] DEBUG PIPELINE - [#FF531A]Proceeding with ProceedAndCall
[16/08/2016 16:23:33,741] INFO SQUINT:InteractionManager - [#4DFFFF]========== START Derive ActionSchedule ==========
[16/08/2016 16:23:33,744] INFO SQUINT:InteractionManager - [#4DFFFF][interaction-management] selected user act is UnrecognizedAct
[16/08/2016 16:23:33,744] INFO SQUINT:UnrecognizedActProcessor - [#4DFFFF]Processing unrecognized act...
[16/08/2016 16:23:33,744] DEBUG SQUINT:UnrecognizedActProcessor - [#B3FFFF]Unrecognized act:
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
[16/08/2016 16:23:33,745] INFO SQUINT:UnrecognizedActProcessor - [#4DFFFF]Applicable UnrecognizedActMapping found.
[16/08/2016 16:23:33,745] DEBUG SQUINT:InteractionManager - [#B3FFFF][schedule-user-defined-acts] act:
object ia#RequestTask {
property common#content {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
}
[16/08/2016 16:23:33,746] INFO SQUINT:InteractionManager - [#4DFFFF]========== END Derive ActionSchedule (took 6 ms) ==========
[16/08/2016 16:23:33,746] INFO SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] schedule size: '1'
[16/08/2016 16:23:33,746] INFO SQUINT:InteractionManager - [#4DFFFF]process TaskRequestAction
[16/08/2016 16:23:33,747] DEBUG SQUINT:TaskProcessor - [#4DFFFF][task-processing] process user act:
object ia#RequestTask {
property common#derivedFrom {
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
}
property common#content {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
[16/08/2016 16:23:33,748] INFO SQUINT:TaskModelHandler - [#B3FFFF][evaluate-task-processability] select task definition for task AbortBackendRequest
[16/08/2016 16:23:33,748] DEBUG SQUINT:TaskModelHandler - [#E5FFFF][evaluate-task-processability] [evaluate task] selected task definition:
object squint#TaskExecutionDefinition {
property mm#task var: Abort_Decision_Request {
object mshVoiceControl#AbortBackendRequest;
}
property common#name {
"Abort_Decision_Request"
}
property squint#interruptionDirective {
object squint#CancelTaskOnInterruption;
}
property squint#useHypothesisFusion {
"true"
}
property squint#cancelationDirective;
property squint#allowCorrectLastStepIntoClosedSelectionSpaces {
"true"
}
property squint#taskConfirmationDirective {
object squint#NeverConfirmExecution;
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#Abort_Decision_Request"
}
}
[16/08/2016 16:23:33,749] INFO SQUINT:TaskModelHandler - [#B3FFFF][evaluate-task-processability] [evaluate task] selected task definition with name Abort_Decision_Request (processing took 1 ms)
[16/08/2016 16:23:33,749] DEBUG SQUINT:TaskProcessor - [#4DFFFF][task-processing] process RequestTask
[16/08/2016 16:23:33,750] INFO SQUINT:InteractionManager - [#B3FFFF][is-task-focused] is focused by previous interaction: false
[16/08/2016 16:23:33,750] DEBUG SQUINT:TaskProcessor - [#B3FFFF][task-processing] user tries to switch task - current task 'AbortBackendRequest' (id=task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7) vs. last task 'ProductSearch' (id=task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4)
[16/08/2016 16:23:33,750] INFO SQUINT:TaskProcessor - [#4DFFFF][task-processing] user input triggers implicit cancel on previous task ProductSearch
[16/08/2016 16:23:33,752] DEBUG SQUINT:TaskStateHandler - [#E7D1A2][task-state] changed event:TaskCanceled
[16/08/2016 16:23:33,752] INFO Middleware - Received event: TaskCanceled (from de.semvox.SQUINT)
[16/08/2016 16:23:33,753] DEBUG SQUINT:TaskStateHandler - [#E7D1A2][task-state] changed event:TaskStarted
[16/08/2016 16:23:33,754] INFO Middleware - Received event: TaskStarted (from de.semvox.SQUINT)
[16/08/2016 16:23:33,755] DEBUG SQUINT:TaskProcessor - [#4DFFFF][new-completion-state] number of preset-slots: 0
[16/08/2016 16:23:33,755] DEBUG SQUINT:TaskProcessor - [#4DFFFF][create-task-completion-state] new task completion state:
object squint#TaskCompletionState {
property squint#changeLog {
object squint#TaskUpdates {
property common#derivedFrom {
object ia#RequestTask {
property common#derivedFrom {
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
}
property common#content {
object mshVoiceControl#AbortBackendRequest id: ID_ecb01cc0-5ae1-4ae4-bf64-fda5263b93ff {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
}
}
property mm#task {
object mshVoiceControl#AbortBackendRequest ref: ID_ecb01cc0-5ae1-4ae4-bf64-fda5263b93ff;
}
property squint#taskDefinition {
object squint#TaskExecutionDefinition {
property mm#task var: Abort_Decision_Request {
object mshVoiceControl#AbortBackendRequest;
}
property common#name {
"Abort_Decision_Request"
}
property squint#interruptionDirective {
object squint#CancelTaskOnInterruption;
}
property squint#useHypothesisFusion {
"true"
}
property squint#cancelationDirective;
property squint#allowCorrectLastStepIntoClosedSelectionSpaces {
"true"
}
property squint#taskConfirmationDirective {
object squint#NeverConfirmExecution;
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#Abort_Decision_Request"
}
}
}
property int#completed {
"true"
}
}
[16/08/2016 16:23:33,757] INFO SQUINT:TaskProcessor - [#B3FFFF][task-processing] task is completed: true
[16/08/2016 16:23:33,757] INFO SQUINT:TaskProcessor - [#4DFFFF][task-processing] selected task completion strategy: HandleCompletedTaskStrategy
[16/08/2016 16:23:33,757] DEBUG SQUINT:TaskProcessor - [#B3FFFF][update-task-log] log provided by context processor:
object squint#TaskUpdates {
property common#derivedFrom {
object ia#RequestTask {
property common#derivedFrom {
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
}
property common#content {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
property squint#slotFillingCompleted {
"true"
}
}
[16/08/2016 16:23:33,758] DEBUG SQUINT:TaskProcessor - [#4DFFFF][update-task-log] updated:
object squint#TaskUpdates {
property common#derivedFrom {
object ia#RequestTask {
property common#derivedFrom {
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
}
property common#content {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
property squint#slotFillingCompleted {
"true"
}
}
[16/08/2016 16:23:33,759] DEBUG SQUINT:TaskStateHandler - [#E7D1A2][task-state] number of UpdateStepsProvided: 0
[16/08/2016 16:23:33,759] DEBUG SQUINT:TaskProcessor - [#B3FFFF][check-confirm-execution-directive] trigger confirmation dialog: false
[16/08/2016 16:23:33,762] DEBUG SQUINT:TaskProcessor - [#4DFFFF]available subsequent reaction for contains ReferenceNotFound issue : true
[16/08/2016 16:23:33,763] DEBUG SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] execute new schedule
[16/08/2016 16:23:33,763] INFO SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] schedule size: '2'
[16/08/2016 16:23:33,763] INFO SQUINT:PresentationManager - [#D47DD4][present-output] got 1 jobs to process
[16/08/2016 16:23:33,763] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] interaction trigger:
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
[16/08/2016 16:23:33,764] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] interactionAct to process:
object ia#ReportOnTask {
property common#content {
object mshVoiceControl#ProductSearch {
property mm#taskId {
"task_e29ae61d-a1f1-48be-ab3d-8e594c2ea4e4"
}
property mshVoiceControl#searchItem var: SEARCH_ITEM matching-relevance: optional;
}
}
property mm#taskStatus {
object mm#ImplicitlyCanceled;
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#SystemAgent;
}
}
[16/08/2016 16:23:33,765] INFO Middleware - Received service request: GenerateOutput (from de.semvox.SQUINT)
[16/08/2016 16:23:33,765] INFO Middleware - Service 'de.semvox.SPIT' handles request: GENERATE=GenerateOutput
[16/08/2016 16:23:33,768] INFO TemplateEngine - Applying template: ReportOnTask_ImplicitlyCanceled_ProductSearch from collection ReportOnTask
[16/08/2016 16:23:33,768] INFO Middleware - Response from 'de.semvox.SPIT': StatusNoContent, GenerateOutput
[16/08/2016 16:23:33,768] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] generated output: null
[16/08/2016 16:23:33,768] DEBUG SQUINT:PresentationManager - [#E0A3E0]earliest execution time of first speechoutput is 1471357413689
[16/08/2016 16:23:33,769] INFO SQUINT:PresentationManager - [#E0A3E0][on-output-generated] updated jobs after postprocessing: 1
[16/08/2016 16:23:33,769] INFO SQUINT:PresentationManager - [#D47DD4][on-output-generated] nothing to speak: OutputAction
[16/08/2016 16:23:33,769] INFO SQUINT:PresentationManager - [#E0A3E0][present-output] start processing jobs...
[16/08/2016 16:23:33,769] DEBUG PIPELINE - [#FF794D]Next join action: DoGrammarActivation
[16/08/2016 16:23:33,769] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,770] DEBUG PIPELINE - [#FF531A]Forking DoGrammarActivation
[16/08/2016 16:23:33,770] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:33,770] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:33,770] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:33,771] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:33,771] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357413770"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"b92e2ba1-2d60-433e-ae54-10d3fb791894"
}
}
[16/08/2016 16:23:33,772] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: [ServicesGrammar, ProductSearchGrammar, PartialUtteranceSearchItem]
[16/08/2016 16:23:33,772] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,772] INFO SQUINT:GrammarManager - [#E7D1A2]Activating grammars: []
[16/08/2016 16:23:33,773] INFO Middleware - Received service request: ActivateGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:33,773] INFO Middleware - Service 'de.semvox.ASR' handles request: ACTIVATE_GRAMMARS=ActivateGrammars
[16/08/2016 16:23:33,773] INFO Middleware - Response from 'de.semvox.ASR': StatusAccepted, ActivateGrammars
[16/08/2016 16:23:33,773] DEBUG PIPELINE - [#FF794D]Next join action: DoSleep(0)
[16/08/2016 16:23:33,774] DEBUG PIPELINE - [#FF531A]Forking DoSleep(0)
[16/08/2016 16:23:33,774] DEBUG PIPELINE - [#FF794D]Next join action: Proceed
[16/08/2016 16:23:33,774] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,774] DEBUG PIPELINE - [#FF531A]Proceeding with Proceed
[16/08/2016 16:23:33,774] INFO SQUINT:InteractionManager - [#B3FFFF][callback] on output processed (openMic:false)
[16/08/2016 16:23:33,774] DEBUG PIPELINE - [#FF794D]Next join action: ProceedAndCall
[16/08/2016 16:23:33,775] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,775] DEBUG PIPELINE - [#FF531A]Proceeding with ProceedAndCall
[16/08/2016 16:23:33,775] INFO SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] schedule size: '1'
[16/08/2016 16:23:33,775] INFO SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] TaskExecutionAction
[16/08/2016 16:23:33,775] DEBUG SQUINT:InteractionManager - [#4DFFFF][execute-task] task:
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
[16/08/2016 16:23:33,776] INFO SQUINT:InteractionManager - [#B3FFFF][execute-task] of supertype (Sync)ServiceRequest: AbortBackendRequest
[16/08/2016 16:23:33,777] DEBUG PIPELINE - [#FF794D]Next join action: InvokeService(AbortBackendRequest)
[16/08/2016 16:23:33,777] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,777] DEBUG PIPELINE - [#FF531A]Forking InvokeService(AbortBackendRequest)
[16/08/2016 16:23:33,778] INFO Middleware - Received service request: AbortBackendRequest (from de.semvox.SQUINT)
[16/08/2016 16:23:33,778] INFO Middleware - Service 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlService' handles request: ABORT_BACKEND_REQUEST=AbortBackendRequest
[16/08/2016 16:23:33,778] INFO MshVoiceControlService - [orange] Abort Backend Request..
[16/08/2016 16:23:33,778] INFO MshVoiceControlService - [orange] Abort Get Customer Intention Request
[16/08/2016 16:23:33,779] INFO MshVoiceControlAdapter - Sending Abort Intention Request event to backend ..
[16/08/2016 16:23:33,779] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,779] DEBUG VoConJNI-Linux - Event: Stop listening
[16/08/2016 16:23:33,780] INFO MshVoiceControlAdapter - returned 6
[16/08/2016 16:23:33,781] INFO Middleware - Response from 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlService': StatusSuccess, AbortBackendRequest
[16/08/2016 16:23:33,783] DEBUG SQUINT:TaskStateHandler - [#E7D1A2][task-state] changed event:TaskExecuted
[16/08/2016 16:23:33,783] DEBUG AsrBridge - onEvent(event: STOPPED, id: 4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:33,783] DEBUG VoConJNI-Linux - Audio file closed
[16/08/2016 16:23:33,784] INFO Middleware - Received event: TaskExecuted (from de.semvox.SQUINT)
[16/08/2016 16:23:33,786] INFO SQUINT:InteractionManager - [#4DFFFF][on-task-executed] received response for sync task execution
[16/08/2016 16:23:33,788] DEBUG SQUINT:InteractionManager - [#E5FFFF][on-task-executed] check pending system actions:
object ia#ActionSchedule {
property ia#interactionTrigger {
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
}
}
[16/08/2016 16:23:33,790] DEBUG PIPELINE - [#FF794D]Next join action: ProceedAndCall
[16/08/2016 16:23:33,790] DEBUG PIPELINE - [#FF531A]Proceeding with ProceedAndCall
[16/08/2016 16:23:33,790] DEBUG SQUINT:InteractionHistory - [#E7D1A2]updateSaliency on execution response
[16/08/2016 16:23:33,790] INFO SQUINT:TaskProcessor - [#4DFFFF][on-task-executed] task status: Released
[16/08/2016 16:23:33,792] DEBUG SQUINT:TaskProcessor - [#4DFFFF][select-subsequent-reaction] triggered by task status:
object mm#Released {
property mm#taskExecutionConfirmed {
"false"
}
property mm#taskExecutionResult {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property common#createdAt {
"1471357413778"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"672bf0df-2df9-4069-97f7-972f23726a70"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#taskCompletedByOneShot {
"true"
}
} and td:
object squint#TaskExecutionDefinition {
property mm#task var: Abort_Decision_Request {
object mshVoiceControl#AbortBackendRequest;
}
property common#name {
"Abort_Decision_Request"
}
property squint#interruptionDirective {
object squint#CancelTaskOnInterruption;
}
property squint#useHypothesisFusion {
"true"
}
property squint#cancelationDirective;
property squint#allowCorrectLastStepIntoClosedSelectionSpaces {
"true"
}
property squint#taskConfirmationDirective {
object squint#NeverConfirmExecution;
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#Abort_Decision_Request"
}
}
[16/08/2016 16:23:33,794] DEBUG SQUINT:TaskProcessor - [#4DFFFF][on-task-executed] new schedule:
object ia#ActionSchedule {
property-list ia#actions {
object ia#OutputAction {
property ia#expectation {
object ia#Expectation {
property ia#taskState {
object ia#TaskState {
property mm#task {
object mshVoiceControl#AbortBackendRequest id: ID_b0218dae-29d1-4d2e-bd55-cbbbf35185cd {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property squint#changeLog {
object squint#TaskUpdates {
property common#derivedFrom {
object ia#RequestTask id: ID_ab3b5aa3-88fb-4ce8-8a46-43c1333dc544 {
property common#derivedFrom {
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
}
property common#content {
object mshVoiceControl#AbortBackendRequest ref: ID_b0218dae-29d1-4d2e-bd55-cbbbf35185cd;
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
}
}
property mm#taskStatus {
object mm#Released id: ID_33a21609-dc23-4c57-b924-cd743fd2e754 {
property mm#taskExecutionConfirmed {
"false"
}
property mm#taskExecutionResult {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property common#createdAt {
"1471357413778"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"672bf0df-2df9-4069-97f7-972f23726a70"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#taskCompletedByOneShot {
"true"
}
}
}
property squint#taskDefinition {
object squint#TaskExecutionDefinition {
property mm#task var: Abort_Decision_Request {
object mshVoiceControl#AbortBackendRequest;
}
property common#name {
"Abort_Decision_Request"
}
property squint#interruptionDirective {
object squint#CancelTaskOnInterruption;
}
property squint#useHypothesisFusion {
"true"
}
property squint#cancelationDirective;
property squint#allowCorrectLastStepIntoClosedSelectionSpaces {
"true"
}
property squint#taskConfirmationDirective {
object squint#NeverConfirmExecution;
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#Abort_Decision_Request"
}
}
}
}
}
}
}
property common#createdAt {
"1471357413791"
}
property ia#intAct {
object ia#ReportOnTask {
property common#content {
object mshVoiceControl#AbortBackendRequest ref: ID_b0218dae-29d1-4d2e-bd55-cbbbf35185cd;
}
property mm#taskStatus {
object mm#Released ref: ID_33a21609-dc23-4c57-b924-cd743fd2e754;
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
}
}
property ia#interactionTrigger {
object ia#RequestTask ref: ID_ab3b5aa3-88fb-4ce8-8a46-43c1333dc544;
}
}
[16/08/2016 16:23:33,823] DEBUG SQUINT:InteractionManager - [#B3FFFF][on-task-executed] updated action schedule:
object ia#ActionSchedule {
property-list ia#actions {
object ia#OutputAction {
property ia#expectation {
object ia#Expectation {
property ia#taskState {
object ia#TaskState {
property mm#task {
object mshVoiceControl#AbortBackendRequest id: ID_5ad36453-3b0b-4fbc-9f11-7b0791559639 {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property squint#changeLog {
object squint#TaskUpdates {
property common#derivedFrom {
object ia#RequestTask {
property common#derivedFrom {
object ia#UnrecognizedAct id: ID_74a8012f-aed9-43be-aaa7-66567fe45bfa {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
}
property common#content {
object mshVoiceControl#AbortBackendRequest ref: ID_5ad36453-3b0b-4fbc-9f11-7b0791559639;
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
}
}
property mm#taskStatus {
object mm#Released id: ID_11c9660c-24c7-421b-95c2-d5af123e13bc {
property mm#taskExecutionConfirmed {
"false"
}
property mm#taskExecutionResult {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property common#createdAt {
"1471357413778"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"672bf0df-2df9-4069-97f7-972f23726a70"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#taskCompletedByOneShot {
"true"
}
}
}
property squint#taskDefinition {
object squint#TaskExecutionDefinition {
property mm#task var: Abort_Decision_Request {
object mshVoiceControl#AbortBackendRequest;
}
property common#name {
"Abort_Decision_Request"
}
property squint#interruptionDirective {
object squint#CancelTaskOnInterruption;
}
property squint#useHypothesisFusion {
"true"
}
property squint#cancelationDirective;
property squint#allowCorrectLastStepIntoClosedSelectionSpaces {
"true"
}
property squint#taskConfirmationDirective {
object squint#NeverConfirmExecution;
}
property common#id {
"de/fraunhofer/ipa/bundles/MshVoiceControl/taskmodel/MshVoiceControlTaskmodel#Abort_Decision_Request"
}
}
}
}
}
}
}
property common#createdAt {
"1471357413791"
}
property ia#intAct {
object ia#ReportOnTask {
property common#content {
object mshVoiceControl#AbortBackendRequest ref: ID_5ad36453-3b0b-4fbc-9f11-7b0791559639;
}
property mm#taskStatus {
object mm#Released ref: ID_11c9660c-24c7-421b-95c2-d5af123e13bc;
}
property mm#initiator {
object mm#SystemAgent;
}
}
}
}
}
property ia#interactionTrigger {
object ia#UnrecognizedAct ref: ID_74a8012f-aed9-43be-aaa7-66567fe45bfa;
}
}
[16/08/2016 16:23:33,835] DEBUG VoConJNI-Linux - ASR return (4778a277-dc89-412b-9239-26000d82d85e)
[16/08/2016 16:23:33,837] DEBUG VoConJNI-Linux - AudioIn released
[16/08/2016 16:23:33,837] DEBUG VoConJNI-Linux - ASR done
[16/08/2016 16:23:33,838] DEBUG VoConJNI-Linux - Context removed
[16/08/2016 16:23:33,838] DEBUG VoConJNI-Linux - Context removed
[16/08/2016 16:23:33,839] DEBUG VoConJNI-Linux - Context removed
[16/08/2016 16:23:33,839] DEBUG AsrBridge - Activated contexts: []
[16/08/2016 16:23:33,839] INFO SQUINT:InteractionManager - [#4DFFFF][process-action-schedule] schedule size: '1'
[16/08/2016 16:23:33,839] INFO SQUINT:PresentationManager - [#D47DD4][present-output] got 1 jobs to process
[16/08/2016 16:23:33,840] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] interaction trigger:
object ia#UnrecognizedAct {
property common#content {
object ia#SpeechRecognitionFailed {
property common#content {
object asr#NoMatch;
}
}
}
property mm#inputModality {
object mm#Speech;
}
property mm#initiator {
object mm#UserAgent;
}
}
[16/08/2016 16:23:33,841] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] interactionAct to process:
object ia#ReportOnTask {
property common#content {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#taskStatus {
object mm#Released {
property mm#taskExecutionConfirmed {
"false"
}
property mm#taskExecutionResult {
object mshVoiceControl#AbortBackendRequest {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property common#createdAt {
"1471357413778"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"672bf0df-2df9-4069-97f7-972f23726a70"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property mm#taskCompletedByOneShot {
"true"
}
}
}
property mm#initiator {
object mm#SystemAgent;
}
property mm#inputModality {
object mm#Speech;
}
}
[16/08/2016 16:23:33,845] INFO Middleware - Received service request: GenerateOutput (from de.semvox.SQUINT)
[16/08/2016 16:23:33,845] INFO Middleware - Service 'de.semvox.SPIT' handles request: GENERATE=GenerateOutput
[16/08/2016 16:23:33,872] INFO TemplateEngine - Applying template: ReportOnTask_AbortDecisionRequest from collection ReportOnTask
[16/08/2016 16:23:33,872] INFO Middleware - Response from 'de.semvox.SPIT': StatusNoContent, GenerateOutput
[16/08/2016 16:23:33,872] DEBUG SQUINT:PresentationManager - [#D47DD4][present-output] generated output: null
[16/08/2016 16:23:33,873] DEBUG SQUINT:PresentationManager - [#E0A3E0]earliest execution time of first speechoutput is 1471357413689
[16/08/2016 16:23:33,873] INFO SQUINT:PresentationManager - [#E0A3E0][on-output-generated] updated jobs after postprocessing: 1
[16/08/2016 16:23:33,873] INFO SQUINT:PresentationManager - [#D47DD4][on-output-generated] nothing to speak: OutputAction
[16/08/2016 16:23:33,873] INFO SQUINT:PresentationManager - [#E0A3E0][present-output] start processing jobs...
[16/08/2016 16:23:33,874] DEBUG PIPELINE - [#FF794D]Next join action: DoGrammarActivation
[16/08/2016 16:23:33,874] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,874] DEBUG PIPELINE - [#FF531A]Forking DoGrammarActivation
[16/08/2016 16:23:33,874] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:33,875] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:33,875] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:33,876] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:33,876] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357413874"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"44d413c1-09c4-49db-9a82-eaafde8cf466"
}
}
[16/08/2016 16:23:33,878] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:33,879] DEBUG PIPELINE - [#FF794D]Next join action: DoSleep(0)
[16/08/2016 16:23:33,879] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,879] DEBUG PIPELINE - [#FF531A]Forking DoSleep(0)
[16/08/2016 16:23:33,879] DEBUG PIPELINE - [#FF794D]Next join action: Proceed
[16/08/2016 16:23:33,879] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,880] DEBUG PIPELINE - [#FF531A]Proceeding with Proceed
[16/08/2016 16:23:33,880] INFO SQUINT:InteractionManager - [#B3FFFF][callback] on output processed (openMic:false)
[16/08/2016 16:23:33,881] DEBUG PIPELINE - [#FF531A]Next idle action: Idle(SetDialogFinished)
[16/08/2016 16:23:33,881] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,881] DEBUG PIPELINE - [#FF531A]Idle with Idle(SetDialogFinished)
[16/08/2016 16:23:33,882] INFO SQUINT:DialogState - [#E7D1A2]SystemTurnActive -> DialogIdle
[16/08/2016 16:23:33,882] DEBUG SQUINT:DialogState - [#E7D1A2]Calling afterSystemTurnFinished(false)
[16/08/2016 16:23:33,882] DEBUG SQUINT:DialogState - [#E7D1A2]Call returned.
[16/08/2016 16:23:33,882] INFO SQUINT:DialogState - [#E7D1A2]Calling afterDialogFinished(false)
[16/08/2016 16:23:33,883] INFO SQUINT:DialogState - [#E7D1A2]Call returned.
[16/08/2016 16:23:33,883] INFO Middleware - Received event: SystemTurnFinished (from de.semvox.SQUINT)
[16/08/2016 16:23:33,884] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver' handles event: SystemTurnFinished
[16/08/2016 16:23:33,886] INFO Middleware - Received event: DialogFinished (from de.semvox.SQUINT)
[16/08/2016 16:23:33,886] INFO Middleware - Receiver 'de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver' handles event: DialogFinished
[16/08/2016 16:23:33,886] INFO MshVoiceControlAbnormalSignalEventReceiver - DialogFinished event caught
[16/08/2016 16:23:33,887] DEBUG SQUINT:InteractionHistory - [#E7D1A2]converted TaskStateEvent to TaskState status:
object ia#TaskExecuted {
property mm#task {
object mshVoiceControl#AbortBackendRequest id: ID_277bab2f-aed7-4397-ab84-b9b62e880549 {
property mshVoiceControl#activeTask {
object mshVoiceControl#ProductSearch;
}
property mm#taskId {
"task_c8c47cbd-d444-42dc-aa67-cc037c8f9bc7"
}
property common#createdAt {
"1471357413778"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"672bf0df-2df9-4069-97f7-972f23726a70"
}
property mshVoiceControl#errorCode {
object asr#NoMatch;
}
}
}
property common#createdAt {
"1471357413784"
}
property common#publisher {
"de.semvox.SQUINT"
}
property mm#taskStatus {
object mm#Released {
property mm#taskExecutionResult {
object mshVoiceControl#AbortBackendRequest ref: ID_277bab2f-aed7-4397-ab84-b9b62e880549;
}
}
}
property common#id {
"def375ec-7c45-490a-beb4-c4b92218225e"
}
}
[16/08/2016 16:23:33,890] INFO MshVoiceControlAbnormalSignalEventReceiver - SituationalContext Dialog Active, removing situational factor dialogActive
[16/08/2016 16:23:33,890] INFO Middleware - Received service request: ChangeSituationalContext (from MshVoiceControlAbnormalSignalEventReceiver)
[16/08/2016 16:23:33,890] INFO Middleware - Service 'de.semvox.StickyEventStore' handles request: CHANGE_SITUATIONAL_CONTEXT=ChangeSituationalContext
[16/08/2016 16:23:33,891] DEBUG SituationalContext - Current configuration:
Static: [
]
Dynamic: [
]
Sticky Events: [
http://www.semvox.de/types/subcon/integration#SystemInitialized=object int#SystemInitialized {
property common#createdAt {
"1471357388632"
}
property common#publisher {
"de.semvox.Middleware"
}
property common#id {
"938ea740-00f2-4ce4-93b6-234bd247037f"
}
}
http://www.semvox.de/types/odp/s3#ConnectivityChanged=object s3#ConnectivityChanged {
property s3#connectivity {
object s3#GoodConnectivity;
}
property common#createdAt {
"1471357388046"
}
property common#publisher {
"de.semvox.ConnectivityManager"
}
property common#id {
"10b52332-3f8a-4d2f-b0ee-fd3f49bd4906"
}
}
]
[16/08/2016 16:23:33,891] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:33,892] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:33,892] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:33,892] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:33,893] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357413890"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"ad6b53ca-6f2f-49e6-b66c-9a70582ee811"
}
}
[16/08/2016 16:23:33,895] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:33,895] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:33,895] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:33,896] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:33,896] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:33,896] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:33,896] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357413895"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"1d513458-1d65-484a-a476-66ac6d1716c4"
}
}
[16/08/2016 16:23:33,897] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:33,897] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:33,898] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:33,898] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:33,898] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:33,898] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357413897"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"6b982e0e-1c02-4204-a6fe-71f9808bfa48"
}
}
[16/08/2016 16:23:33,899] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:33,899] INFO Middleware - Response from 'de.semvox.StickyEventStore': StatusSuccess, ChangeSituationalContext
[16/08/2016 16:23:34,081] DEBUG Beep - Playing beep: ExitValue :0
[16/08/2016 16:23:57,930] INFO Shutdown - Received signal. Shutting down...
[16/08/2016 16:23:57,931] DEBUG MshVoiceControlAdapter - Try to disconnect...
[16/08/2016 16:23:57,931] INFO MshVoiceControlAdapter - Disconnected
[16/08/2016 16:23:57,931] INFO Middleware - Service unregistered: de.semvox.SystemClock
[16/08/2016 16:23:57,931] INFO Middleware - Service unregistered: de.semvox.OutputService
[16/08/2016 16:23:57,932] INFO Middleware - Service unregistered: de.semvox.SPIT
[16/08/2016 16:23:57,932] INFO Middleware - Receiver unregistered: de.semvox.AudioReceiver
[16/08/2016 16:23:57,932] INFO Middleware - Service unregistered: de.semvox.StickyEventStore
[16/08/2016 16:23:57,932] INFO Middleware - Receiver unregistered: de.semvox.StickyEventStore
[16/08/2016 16:23:57,933] DEBUG SituationalContext - Current configuration:
Static: [
]
Dynamic: [
]
Sticky Events: [
]
[16/08/2016 16:23:57,933] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:57,933] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:57,933] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:57,934] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:57,934] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357437933"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"b52ad31b-0c65-4704-b13c-3771d97f9f79"
}
}
[16/08/2016 16:23:57,935] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:57,935] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:57,935] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:57,935] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:57,936] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:57,936] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357437935"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"97c07c1d-8943-43e4-aebf-e5962094cdad"
}
}
[16/08/2016 16:23:57,936] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:57,937] INFO Middleware - Service unregistered: de.semvox.SQUINT
[16/08/2016 16:23:57,937] INFO Middleware - Receiver unregistered: de.semvox.SQUINT
[16/08/2016 16:23:57,937] DEBUG PIPELINE - [#FF531A]Next input action: ResetDialog
[16/08/2016 16:23:57,937] DEBUG PIPELINE - [#FF531A]Processing interruptive input ResetDialog
[16/08/2016 16:23:57,938] INFO SQUINT:InteractionHistory - [#E7D1A2][on-dialog-canceled]
[16/08/2016 16:23:57,938] INFO Middleware - Received service request: SelectGrammars (from de.semvox.SQUINT)
[16/08/2016 16:23:57,938] INFO Middleware - Service 'de.semvox.SPIJK' handles request: SELECT_GRAMMARS=SelectGrammars
[16/08/2016 16:23:57,938] DEBUG Spijk - Selecting grammars.
[16/08/2016 16:23:57,939] INFO Middleware - Response from 'de.semvox.SPIJK': StatusSuccess, SelectGrammars
[16/08/2016 16:23:57,939] DEBUG SQUINT:GrammarManager - [#ECDBB6]SelectGrammars request/response:
object nlu#SelectGrammars {
property-list nlu#includes {
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object asr#MainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#OpenDomainGrammar;
}
}
object nlu#PreloadedGrammarSelector {
property asr#grammarType {
object spijk#LiftingGrammar;
}
}
}
property common#createdAt {
"1471357437938"
}
property common#publisher {
"de.semvox.SQUINT"
}
property int#responseStatus {
object int#StatusSuccess;
}
property common#id {
"4bf74562-c35b-41f9-91c6-79f64ac6f201"
}
}
[16/08/2016 16:23:57,940] DEBUG SQUINT:GrammarManager - [#E7D1A2]Selected grammars:
New: []
Previous: []
[16/08/2016 16:23:57,940] INFO SQUINT:DialogState - [#E7D1A2]DialogIdle -> DialogIdle
[16/08/2016 16:23:57,940] DEBUG PIPELINE - [#FF9F80]Performing next step...
[16/08/2016 16:23:57,940] DEBUG PIPELINE - [#FF794D]Pipeline disposed. Terminating loop.
[16/08/2016 16:23:57,940] INFO Middleware - Service unregistered: de.semvox.SPIJK
[16/08/2016 16:23:57,941] INFO Middleware - Service unregistered: de.semvox.LanguageManager
[16/08/2016 16:23:57,941] INFO Middleware - Receiver unregistered: de.semvox.LanguageManager
[16/08/2016 16:23:57,941] INFO Middleware - Receiver unregistered: de.semvox.LifecycleReceiver
[16/08/2016 16:23:57,941] INFO Middleware - Service unregistered: de.semvox.ConnectivityManager
[16/08/2016 16:23:57,941] INFO Middleware - Receiver unregistered: de.semvox.ConnectivityManager
[16/08/2016 16:23:57,942] INFO Middleware - Service unregistered: de.semvox.ASR
[16/08/2016 16:23:57,943] DEBUG VoConJNI-Linux - Context closed
[16/08/2016 16:23:57,943] DEBUG VoConJNI-Linux - Context closed
[16/08/2016 16:23:57,943] DEBUG VoConJNI-Linux - Context closed
[16/08/2016 16:23:57,943] DEBUG VoConJNI-Linux - Context closed
[16/08/2016 16:23:57,943] DEBUG VoConJNI-Linux - Context closed
[16/08/2016 16:23:57,943] DEBUG VoConJNI-Linux - Context closed
[16/08/2016 16:23:57,943] DEBUG VoConJNI-Linux - Gram2 terminated
[16/08/2016 16:23:57,944] DEBUG VoConJNI-Linux - CLC closed
[16/08/2016 16:23:57,944] DEBUG VoConJNI-Linux - Pron terminated
[16/08/2016 16:23:57,944] DEBUG VoConJNI-Linux - AcMod closed
[16/08/2016 16:23:57,944] DEBUG VoConJNI-Linux - ASR unprepared
[16/08/2016 16:23:58,015] DEBUG VoConJNI-Linux - NSMP terminated
[16/08/2016 16:23:58,016] DEBUG VoConJNI-Linux - SEE terminated
[16/08/2016 16:23:58,016] DEBUG VoConJNI-Linux - DASR terminated
[16/08/2016 16:23:58,016] DEBUG VoConJNI-Linux - SEM terminated
[16/08/2016 16:23:58,016] DEBUG VoConJNI-Linux - ASR terminated
[16/08/2016 16:23:58,016] DEBUG VoConJNI-Linux - Gram terminated
[16/08/2016 16:23:58,016] DEBUG VoConJNI-Linux - Base terminated
[16/08/2016 16:23:58,017] DEBUG VoConJNI-Linux - Heap closed
[16/08/2016 16:23:58,017] INFO Middleware - Service unregistered: de.semvox.TTS
[16/08/2016 16:23:58,018] DEBUG VocalizerJNI-Linux - TTS close
[16/08/2016 16:23:58,019] INFO VocalizerJNI-Linux - TTS closed
[16/08/2016 16:23:58,019] DEBUG VocalizerJNI-Linux - TTS release
[16/08/2016 16:23:58,019] INFO VocalizerJNI-Linux - TTS released
[16/08/2016 16:23:58,020] DEBUG VocalizerJNI-Linux - PDI release
[16/08/2016 16:23:58,020] INFO VocalizerJNI-Linux - PDI released
[16/08/2016 16:23:58,020] INFO Middleware - Service unregistered: de.semvox.UserManager
[16/08/2016 16:23:58,020] INFO Middleware - Receiver unregistered: de.semvox.UserManager
[16/08/2016 16:23:58,020] INFO Middleware - Service unregistered: de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlService
[16/08/2016 16:23:58,021] INFO Middleware - Receiver unregistered: de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlEventReceiver
[16/08/2016 16:23:58,021] INFO Middleware - Receiver unregistered: de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlAbnormalSignalEventReceiver
[16/08/2016 16:23:58,021] INFO Middleware - Receiver unregistered: de.fraunhofer.ipa.bundles.MshVoiceControl.components.MshVoiceControlDialogEventReceiver
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment