Skip to content

A Design of 3D Dynamic Display System Based on Voice Control. ✨ Purpose only! Copyright and commercial use rights are received.

License

Notifications You must be signed in to change notification settings

Charmve/LightCube

Repository files navigation

LightCube 💠
A 3D Dynamic Display System Based on Voice Control

[Paper (Chinese)] | [Poster] | [Slides] | [Patents]

LightCube

video-YouTube video-B站

Table of Contents

一种基于语音控制的3D动态显示系统设计

张 伟
(扬州大学 物理科学与技术学院,江苏扬州 225000 )

摘要

       光立方作为一种新型的裸眼3D显示技术,用户不需要配戴任何观看辅助工具就能达到裸眼3D显示的效果,给人们带来了全新的视觉体验。本文设计一种基于语音控制的3D动态显示系统,采用LD3320非特定人声语音识别芯片以及STM32F407作为光立方核心控制器实现全彩高阶的语音控制光立方设计,解决了现有光立方显示色彩单一、分辨率低、人机交互性能差、设计复杂、成本较高等的问题。语音识别模块与STM32之间采用UART串口通信,将语音识别结果作为控制指令发送给STM32,控制光立方的显示动画和工作模式,并用模块自带的喇叭播放背景音乐。SM16126串转并级联驱动输出电路的设计,降低了系统功耗,为高阶光立方的设计提供了一种可行的实现方案。测试表明,光立方显示系统对语音指令识别的响应速度快、识别精度高、工作稳定,具有较好的使用体验,使人们的生活更加智能化和人性化。

关键词:光立方;语音控制;STM32;全彩显示;裸眼 3D


Design of a 3D Dynamic Display System Based on Voice Control

Wei Zhang *
*School of Physical Science and Technology, Yangzhou University, Yangzhou 225000, China

Abstract:

Light Cube, as a new type of naked eye 3D display technology, can achieve the naked eye 3D display without wearing any viewing aids. Especially, it brings a new visual experience to people and has become a research hot spot in research organizations home and abroad for the past few years. In this paper, a 3D dynamic display system based on voice control is presented, which solves the existing light cube display color single, low resolution, poor human-computer interaction performance, complex design, high cost, etc. The LD3320 non-specific vocal speech recognition chip and STM32F407 are used as controller core to realize the full-color high-order voice controlled light cube. The voice recognition module sends the voice recognition result to the STM32 via UART serial port as a control command for controlling the display animation and working mode of the optical cube, and playing the background music with the speaker provided by the module. The SM16126 cascade-to-cascade drive output circuit design reduces system power consumption and provides a viable implementation for high-order optical cube designs. Finally, tests show that this light cube display system has fast voice command recognition response speed, high recognition accuracy and stable work performance, which can make people's life more intelligent and user-friendly.

Key words:Light cube; voice control; STM32; full-color display; naked eye 3D



(click this picture to watch a video)


Browsing

If you are browsing around the source tree, and want to see some of the major functional chunks, here are a few pointers:

  • 📂 01_LightCube-Project: CORE code folder, which cantains code for all this repo, including:
    • 📂 01_LightCube: STM32F407 firmware
      • 📂 /LED_CUBE/CORE: AMR Cortex M4 core
      • 📂 /LED_CUBE/FWLIB: stm32f4xx firmware library
      • 📂 /LED_CUBE/HARDWARE/LED_CUBE: light cube led driver
      • 📂 /LED_CUBE/HARDWARE/SD: SD card peripheral driver which cantains LightCube display pattern data
      • 📂 /LED_CUBE/HARDWARE/SM12126: SM12126 peripheral driver, serial to parallel
      • 📂 /LED_CUBE/HARDWARE/TFCard: TFCard peripheral driver, which cantains some audio files
      • 📂 /LED_CUBE/OBJ: object files
      • 📂 /LED_CUBE/SYSTEM: stm32f4xx system resources, including spi, timer, delay, sys, usart
      • 📂 /LED_CUBE/USER: debug files in Keil
      • 📂 /LED_CUBE/fatfs: SPI_MSD0_Driver.c
    • 📂 02_SD文件(STM32)/控制底板SD.rar/: cantains LightCube display pattern data
    • 📂 02_SD文件(STM32)/语音模块SD/: cantains some audio files
    • 📂 04_Data Sheet&Circuit Schematic: cantains data sheet and PCB
    • 📂 05_LDV5语音识别模块-配套资料

Quick Start

System Block
Figure 1. System Block

More details can be seen at design report, click HERE.


👉 Step 1. Prepare the required software and hardware components

  • software: Keil-ARM, (download)
  • hardware
    • STM32F407 development board or minimum system
    • some essential Dupont line
    • 12x12x12 LEDs, iron wire (350mm)
    • JLink
    • 12V Power Adapter
    • PCB, physical reference

👉 Step 2. Download this repo

In Terminal, run

git clone https://github.com/Charmve/LightCube.git

or Download ZIP

Then, open the project with Keil5-ARM ./01_LightCube-Projects/01_LightCube/LED_CUBE/USER/Template.uvprojx.

👉 Step 3. Set the device style in STM32F407XX and the debuger in ST-Link, compile to produce object file.

the main.c is at ./01_LightCube-Projects/01_LightCube/LED_CUBE/USER/main.c.

System Setting
Figure 2. Setting block

device style
Figure 3. Set the device style

debuger
Figure 4. Set the debuger

👉 Step 4. Download code to STM32 flash memory

✨ Awesome JOB! ✨

PNG

PNG

Maintainers

@Charmve, @Fuzhou.

Acknowledgements

在此,我要非常感谢我的伙伴:沈福周,是他一直陪伴我把这个项目做下去,他在这个项目中也贡献了十分大的力量。在大学阶段遇到这样一位伙伴,我十分荣幸。同时,我也要感谢我的指导老师:陈磊老师,是他给我们提供指导和来自学校的资金支持。没有你们的帮助,是不能顺利完成这个项目的。PS:整个项目耗时半年,焊接整个光立方花了20多天 -_- (在此,也得感谢我的室友们,以及孙吉乔跟我们一起焊接!)

English Version: Here, I would like to thank my partner: Shen Fuzhou, who has been with me to continue this project, and he has also contributed a lot to this project. I am honored to meet such a partner in college. At the same time, I would also like to thank my instructor: Mr. Chen Lei, who provided us with guidance and financial support from the school. Without your help, this project cannot be successfully completed. PS: The whole project took half a year, and it took more than 20 days to weld the entire light cube -_- (Here, I have to thank my roommates and Sun Jiqiao for welding with us!)

License

本项目因为是基金项目,一方面为了公益性而开源,另一方面为了著作权所有而申请了国家专利保护📑。 如有商业用途,请与我联系。

English Version: Because this project is a funded project, on the one hand, it is open source for public welfare, and on the other hand, it has applied for national patents protection 📑 for copyright ownership. If you have any commercial use, please contact me.

If you have any questions or idea, please let me know 📧 yidazhang1@gmail.com

Citation

Use this bibtex to cite this repository:

@misc{LightCube,
  title={A Design of 3D Dynamic Display System Based on Voice Control},
  author={Charmve},
  year={2019.11},
  publisher={Github},
  journal={GitHub repository},
  howpublished={\url{https://github.com/Charmve/LightCube-A-Design-of-3D-Dynamic-Display-System-Based-on-Voice-Control}},
}

🚧 My Related Work: ⬇️

      EmotiomCube      Surface-Defect-Detection

❤️ Follow me or Sponsor me

You can find how to contact me in the right sidebar. You can follow me to find something more interesting.

If you like Charmve or me or my projects, you can buy me a ☕ coffee 🍉 / 🍦 or 🍰 cake at Charmve Sponsors to support me, click the button. Your name will be shown at https://charmve.github.io/sponsor.html.

Buy Me A Coffee



Code with ❤️ & ☕ By Charmve @ 2021