[Proposal] SpeechToText

[VladislavAntonyuk]

Feature name

SpeechToText

Link to discussion

#727

Progress tracker

• Android Implementation
• iOS Implementation
• MacCatalyst Implementation
• Windows Implementation
• Tizen Implementation
• Unit Tests
• Samples
• Documentation

Summary

Free Speech recognition functionality that is available online and offline.

More details with samples at https://vladislavantonyuk.azurewebsites.net/articles/Speech-recognition-with-.NET-MAUI

Motivation

.NET MAUI has TextToSpeech. It's time to convert SpeechToText

Detailed Design

https://developer.apple.com/documentation/speech
https://developer.android.com/reference/android/speech/SpeechRecognizer
https://learn.microsoft.com/en-us/uwp/api/windows.media.speechrecognition?view=winrt-22621

public interface ISpeechToText: IAsyncDisposable
{
	Task<bool> RequestPermissions(CancellationToken cancellationToken);
	Task<string> Listen(CultureInfo culture, IProgress<string>? recognitionResult, CancellationToken cancellationToken);
}

Usage Syntax

var isAuthorized = await speechToText.RequestPermissions();
		if (isAuthorized)
		{
			try
			{
				RecognitionText = await speechToText.Listen(CultureInfo.GetCultureInfo(Locale?.Language ?? "en-us"), new Progress<string>(partialText =>
					{
						RecognitionText += partialText + " ";
					}), cancellationToken);
			}
			catch (Exception ex)
			{
				await Toast.Make(ex.Message).Show(cancellationToken);
			}
		}
		else
		{
			await Toast.Make("Permission denied").Show(cancellationToken);
		}

Drawbacks

No response

Alternatives

No response

Unresolved Questions

No response

[brminnick]

Thanks @VladislavAntonyuk!

Promoting to approved This Proposal has been approved and is ready to be added to the Toolkit as we voted to approve it in the December Standup.

Technically, we should've opened the Proposal first before voting to approve said Proposal, but we'll let this one slide.

Submitting a Proposal doesn't require a vote from the core maintainers. It should start as a Discussion, and then once the Discussion is deemed feature-complete a Proposal can be opened.

[ghost]

Reopening Proposal.

Only Proposals moved to the Closed Project Column and Completed Project Column can be closed.