-
Notifications
You must be signed in to change notification settings - Fork 0
Ai Overview
The AIBuds AI framework provides a common entry point for AI chat, audio recording, streaming speech recognition, text-to-speech, summaries, text translation, simultaneous interpretation, conversation translation, image generation, and AI asking services.
Each AI service is supplied by a registered provider SDK that conforms to AIConnectSDK. Your app initializes AIBudsAISDK with the provider SDKs it includes, selects an AIServiceVendor, and then calls the service-specific APIs exposed by AIBudsAISDK.
Browse the generated Wiki navigation for the pages in this section.
- Install the AI framework and the provider SDKs required by your application.
- Register the provider SDK implementations when initializing
AIBudsAISDK. - After a device is connected, provide its AI device information to the AI framework.
- Select
.starBurstor.mltcloudwithsetAIServiceVendor. - Complete provider authentication when its authentication mode is app initiated.
- Start the required AI service and handle its callbacks or session events.
The public SDK currently defines two selectable service providers:
| Enum Case | Service Provider |
|---|---|
.starBurst |
StarBurst AI (ByteDance) |
.mltcloud |
MltCloud AI (Meilc) |
.none means that no provider has been selected. It is the default value and is not a usable AI service provider.
Provider registration and provider selection are separate operations. Registration makes a provider implementation available to the framework; selection determines which registered provider receives subsequent AI service requests.
An installed provider may not implement every service or support the same languages as another provider. Use the provider metadata exposed by AIBudsAISDK, including allSupportedLanguages, and handle unsupported-service errors returned by individual operations.
- Initialize the base AIBuds SDK and
AIBudsAISDKbefore using AI services. - Connect a supported device and configure its AI device information.
- Select a registered AI service provider.
- Complete authentication when required by that provider.
- Maintain network connectivity for cloud-backed services.
See Select AI Provider for provider initialization, selection, and authentication checks.
AIBuds SDK documentation · Full documentation · API Reference
- Introduction
- Getting Started
- Core Concepts
-
Core Features
- Basic Features
- Device Info
- Find Device
- Physical Operations
- Work Mode
- Work Status
- Wear Detection
- Volume Control
- Music Control
- TWS
- Equalizer
- ANC
- Audio
- Camera
- Remote Camera
- File Import
- Teleprompter
- Segment Navigation
- Live Streaming
- Device Applications
- OTA
- Camera OTA
- Service Auth
- AI Services
- Voice Assistant
- Logging
- Advanced Topics
- Releases
- Troubleshooting