Skip to content

feat: add AI text APIs and Demos#377

Merged
shiliu-yang merged 13 commits intotuya:devfrom
maidang-xing:add_ai_text_chat
Sep 23, 2025
Merged

feat: add AI text APIs and Demos#377
shiliu-yang merged 13 commits intotuya:devfrom
maidang-xing:add_ai_text_chat

Conversation

@maidang-xing
Copy link
Copy Markdown
Contributor

Add AI text chat by uart in T5 and esp32s3

huatuo-dr and others added 12 commits September 17, 2025 13:37
* update platform T5AI

* config country code

* use git-action country code

* release use country code

---------

Co-authored-by: denglk <denglk@tuya.com>
* feat: tal_memory add support for external RAM

* feat: support tyutools webdebug

* feat: remove ai_audio_debug

* fix: remove redundant attribute check in __ai_get_send_attr_len
* yt/fix:fix mcu8080 lcd

* yt/feature:atk t5ai mini board support spi/ mcu8080 2.4in lcd

* yt/refactor:rename camera ov2640 init seq table

* yt/feature:support display swap rgb565 pixel

* yt/feature:add ATK_T5AI_MINI_BOARD_CAMERA_8080_LCD_2.4.config to example camera

* yt/feature:add display/pitcture example

* yt/fix:fix audio_recorder example complie fix

* yt/refactor:delect unused file

* yt/refactor:delect unused file

* yt/fix:fix use default config complie error
* fix: Replace SRAM with PSRAM to avoid crashes caused by insufficient memory. (tuya#347)

* fix: free allocated memory in BLE event callback to prevent memory leaks (tuya#349)

* Yj/feat examples (tuya#352)

* fix: mp3 decode use minimp3

* fix: format code for consistency and readability

* fix: windows not found python3 (tuya#353)

* yt/featur:adapt new platform (tuya#354)

* add games app (tuya#355)

* feature: save dist at apps (tuya#357)

* add leds_pixel driver && example (tuya#358)

* add leds_pixel driver && example

* yt/fix:fix spi baudrate

* yt/fix:fix spi baudrate

---------

Co-authored-by: zhouss@tuya.com <zhouss@tuya.com>

* add esp32 board lvgl

* add esp32 and esp32s3 board lvgl example

* fix app config

* fix app config

* fix app config

---------

Co-authored-by: YangJie <yangjie6759@163.com>
Co-authored-by: KyleDeng <55138677+KyleDeng@users.noreply.github.com>
Co-authored-by: yingtao450 <144092910+yingtao450@users.noreply.github.com>
Co-authored-by: flyingcys <flyingcys@163.com>
Co-authored-by: zhouss@tuya.com <zhouss@tuya.com>
* feat: initialize time service in user_main and include it in tal_api.h

* fix: improve event_id handling in ai_audio_agent_msg_cb

* fix: update memory allocation methods in ai_monitor to use OS_MALLOC and OS_FREE

* fix: add null check for memory allocation

* fix: improve error handling and fix the issue that may cause disorder in the event status of AI_CLOUD_ASR when interrupted.

* feat: add AI_AUDIO_EVT_AI_REPLIES_TEXT_INTERUPT event and handle UI streaming interruption

* fix: The playback of the new reply failed after the conversation was interrupted.

* fix: update T5AI commit reference to the latest version
* fix: update T5AI commit reference to the latest version

* fix: update T5AI commit reference to the latest version
Co-authored-by: denglk <denglk@tuya.com>
@maidang-xing maidang-xing reopened this Sep 23, 2025
@adwuard adwuard changed the title Add ai text chat feat: add AI text APIs and Demos Sep 23, 2025
@shiliu-yang shiliu-yang merged commit eaff821 into tuya:dev Sep 23, 2025
2 checks passed
flyingcys added a commit that referenced this pull request Oct 15, 2025
* feat: add AI text APIs and Demos (#377)

* update platform T5AI (#365)

* update platform T5AI

* config country code

* use git-action country code

* release use country code

---------

Co-authored-by: denglk <denglk@tuya.com>

* Yj/feat add ai monitor (#367)

* feat: tal_memory add support for external RAM

* feat: support tyutools webdebug

* feat: remove ai_audio_debug

* fix: remove redundant attribute check in __ai_get_send_attr_len

* Atk 8080lcd (#368)

* yt/fix:fix mcu8080 lcd

* yt/feature:atk t5ai mini board support spi/ mcu8080 2.4in lcd

* yt/refactor:rename camera ov2640 init seq table

* yt/feature:support display swap rgb565 pixel

* yt/feature:add ATK_T5AI_MINI_BOARD_CAMERA_8080_LCD_2.4.config to example camera

* yt/feature:add display/pitcture example

* yt/fix:fix audio_recorder example complie fix

* yt/refactor:delect unused file

* yt/refactor:delect unused file

* yt/fix:fix use default config complie error

* Esp32/s3 lvgl example enable (#370)

* fix: Replace SRAM with PSRAM to avoid crashes caused by insufficient memory. (#347)

* fix: free allocated memory in BLE event callback to prevent memory leaks (#349)

* Yj/feat examples (#352)

* fix: mp3 decode use minimp3

* fix: format code for consistency and readability

* fix: windows not found python3 (#353)

* yt/featur:adapt new platform (#354)

* add games app (#355)

* feature: save dist at apps (#357)

* add leds_pixel driver && example (#358)

* add leds_pixel driver && example

* yt/fix:fix spi baudrate

* yt/fix:fix spi baudrate

---------

Co-authored-by: zhouss@tuya.com <zhouss@tuya.com>

* add esp32 board lvgl

* add esp32 and esp32s3 board lvgl example

* fix app config

* fix app config

* fix app config

---------

Co-authored-by: YangJie <yangjie6759@163.com>
Co-authored-by: KyleDeng <55138677+KyleDeng@users.noreply.github.com>
Co-authored-by: yingtao450 <144092910+yingtao450@users.noreply.github.com>
Co-authored-by: flyingcys <flyingcys@163.com>
Co-authored-by: zhouss@tuya.com <zhouss@tuya.com>

* Yj/fix chatbot (#371)

* feat: initialize time service in user_main and include it in tal_api.h

* fix: improve event_id handling in ai_audio_agent_msg_cb

* fix: update memory allocation methods in ai_monitor to use OS_MALLOC and OS_FREE

* fix: add null check for memory allocation

* fix: improve error handling and fix the issue that may cause disorder in the event status of AI_CLOUD_ASR when interrupted.

* feat: add AI_AUDIO_EVT_AI_REPLIES_TEXT_INTERUPT event and handle UI streaming interruption

* fix: The playback of the new reply failed after the conversation was interrupted.

* fix: update T5AI commit reference to the latest version

* feat: add waveshare t5ai board (#373)

* fix: update T5AI commit reference to the latest version (#374)

* fix: update T5AI commit reference to the latest version

* fix: update T5AI commit reference to the latest version

* fix t5ai: clean cmd (#375)

Co-authored-by: denglk <denglk@tuya.com>

* fix dev some code bug (#376)

* Initial commit

* Add ENABLE_AUDIO_CHAT define

---------

Co-authored-by: KyleDeng <55138677+KyleDeng@users.noreply.github.com>
Co-authored-by: denglk <denglk@tuya.com>
Co-authored-by: YangJie <yangjie6759@163.com>
Co-authored-by: yingtao450 <144092910+yingtao450@users.noreply.github.com>
Co-authored-by: flyingcys <flyingcys@163.com>
Co-authored-by: zhouss@tuya.com <zhouss@tuya.com>

* yt/feat:support atk 2.8in 8080 16bit lcd (#378)

* feat: add led pixel effect (#380)

Co-authored-by: Hsuan Han Lai <huate.lai@tuya.com>

* Support bmi270 (#381)

* Add imu bmi270 driver in /src for T5 pocket

* Support bmi270 get acc and gyro

* Support bmi270 get acc and gyro in T5 pocket

* Support i2c scan example (#385)

* Support T5 and ESP32/S3 i2c scan example

* Support T5 and ESP32/S3 i2c scan example

* support micropython REPL (#386)

* support micropython REPL

* update micropython doc

---------

Co-authored-by: denglk <denglk@tuya.com>

* change release name (#388)

Co-authored-by: denglk <denglk@tuya.com>

* Add bmi270 read accl and gyro example (#387)

* feat: restart ai client when the link type changes (#389)

* Update display and camera (#393)

* feat:update t5ai platform

* yt/feat:support display rotate and draw api

* yt/feat:support part flush

* yt/fix:dvp crash

* yt feat: atk t5ai board support 2.4/2.8/7 inch lcd and pocket support camera

* feat: update example and support new board

* Pocket sdcard (#395)

* fix: camera cb called when camera open successfully

* feat:t5ai pocket board support sdcard

* feat:add camera output sdcard example

* feat:porting add sdio pinmux type

* feat: more matrix 2D effects (#384)

* feat: more matrix 2D effects

* fix COLOR_RESOLUION typo

---------

Co-authored-by: Hsuan Han Lai <huate.lai@tuya.com>

* Fix disp spi (#397)

* feat:Remove the SPI DMA length limitation on T5AI

* feat:Optimize the YUV to 422 conversion algorithm

* feat:pocket support config lcd rotation

* feat: new encoder demo (#394)

Co-authored-by: Hsuan Han Lai <huate.lai@tuya.com>

---------

Co-authored-by: maidang-xing <maidang.xing@tuya.com>
Co-authored-by: KyleDeng <55138677+KyleDeng@users.noreply.github.com>
Co-authored-by: denglk <denglk@tuya.com>
Co-authored-by: YangJie <yangjie6759@163.com>
Co-authored-by: yingtao450 <144092910+yingtao450@users.noreply.github.com>
Co-authored-by: zhouss@tuya.com <zhouss@tuya.com>
Co-authored-by: Hsuan Han Lai <hsuan.han.lai@gmail.com>
Co-authored-by: Hsuan Han Lai <huate.lai@tuya.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants