[BUG] OfflineSpeechToText Failure: LanguageNotSupported

[MattiaDurli]

Is there an existing issue for this?

• I have searched the existing issues

Did you read the "Reporting a bug" section on Contributing file?

• I have read the "Reporting a bug" section on Contributing file: https://github.com/CommunityToolkit/Maui/blob/main/CONTRIBUTING.md#reporting-a-bug

Current Behavior

Using the unmodified sample provided, I try OfflineSpeechToText and receive a Failure in speech engine - LanguageNotSupported

Expected Behavior

Expect the sample to work and listen to speech

Steps To Reproduce

Press the button "StartListenAs" and the error appears in Language Output label

Link to public reproduction project repository

https://github.com/CommunityToolkit/Maui

Environment

Latest Community toolkit sample 11.0.0, tried on Android 13, 14 and 15.

Anything else?

Italian language devices, language pack downloaded in italian and english.
Tried:
await speechToText.StartListenAsync(new SpeechToTextOptions
{
Culture = new System.Globalization.CultureInfo("en-US"),
ShouldReportPartialResults = true
}, CancellationToken.None);

to force "en-US" and the default Culture = CultureInfo.CurrentCulture, that picks "it-IT"

[MattiaDurli]

Ok, if I use:

await speechToText.StartListenAsync(new SpeechToTextOptions
{
Culture = new System.Globalization.CultureInfo("it_IT"),
ShouldReportPartialResults = true
}, CancellationToken.None);

or

await speechToText.StartListenAsync(new SpeechToTextOptions
{
Culture = new System.Globalization.CultureInfo("en_US"),
ShouldReportPartialResults = true
}, CancellationToken.None);

works.
But I had to use en_US and not en-US, same it_IT instead of it-IT.
But on my device Culture = CultureInfo.CurrentCulture returns it-IT

[VladislavAntonyuk]

as I see the solution is to replace - with _. It seems like it is only on Android, on iOS culture should be dash separated.

[wmassalski-arp]

Hey, i've experienced the same issue (Android). However after trying out "en_US" it prompts me to download English language package update (even tho i installed it beforehand). After pressing download it continues but throws "Failure in speech engine - NoMatch".

[alex3696]

as I see the solution is to replace - with _. It seems like it is only on Android, on iOS culture should be dash separated.

I tried to launch recognition - it does not work from the box :-). Let me help and share my research.

1. I think we must use Tolanguagetag, it`s generates the correct IETF BCP 47 tag for intent
   static Intent CreateSpeechIntent(SpeechToTextOptions options)
   {
   var intent = new Intent(RecognizerIntent.ActionRecognizeSpeech);
   intent.PutExtra(RecognizerIntent.ExtraLanguagePreference, Java.Util.Locale.Default.ToLanguageTag());
   intent.PutExtra(RecognizerIntent.ExtraLanguageModel, RecognizerIntent.LanguageModelFreeForm);
   intent.PutExtra(RecognizerIntent.ExtraCallingPackage, Application.Context.PackageName);
   intent.PutExtra(RecognizerIntent.ExtraPartialResults, options.ShouldReportPartialResults);
   var javaLocale = Java.Util.Locale.ForLanguageTag(options.Culture.Name).ToLanguageTag();
   intent.PutExtra(RecognizerIntent.ExtraLanguage, javaLocale);
   return intent;
   }
   or try to get a list of languages in a suitable form
   https://developer.android.com/reference/android/speech/RecognizerIntent#EXTRA_LANGUAGE_PREFERENCE

ACTION_GET_LANGUAGE_DETAILS - a Bundle of extras will be returned to the provided result receiver, and should ideally contain values for EXTRA_LANGUAGE_PREFERENCE

2. You must activate the following applications in Android: AndroidSystemIntelligence and PrivateComputeServices.
   This must be indicated in the documentation and in error messages or logs.
   disabled AndroidSystemIntelligence generates error: [SpeechRecognizer] Bind to system recognition service failed with error 10
   disabled PrivateComputeServices generates error: Failure in speech engine - client
   https://developer.android.com/about/versions/13/behavior-changes-all?hl=ru#speech-service

Something else is wrong :-(, because the test application works correctly on Samsung-S24, A51, but not on my S20+(LanguageNotSupported), but CultureInfo.GetCultureInfo("en-US") works fine.

[alex3696]

Wow, it's been a night and now it's working. Apparently something was downloaded by the phone in the background. I didn't install anything, it's the same build that I debugged yesterday. Now, every time I start, I get a download confirmation, but speech recognition is working.
There is a video here, which shows where to watch downloaded languages
jamsch/expo-speech-recognition#8

[VladislavAntonyuk]

Make sure you downloaded the language in Languages->On-Device recognition