main.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#  “数字人交互，与虚拟的自己互动”——用PaddleAvatar打造数字分身，探索人机交互的未来\n",
    "\n",
    "![GitHub Repo stars](https://img.shields.io/github/stars/Kedreamix/PaddleAvatar)\n",
    "\n",
    "你是否曾经幻想过与自己的虚拟人交互？现在，使用`PaddleAvatar`，您可以将自己的图像、音频和视频转化为一个逼真的数字人视频，与其进行人机交互。\n",
    "\n",
    "`PaddleAvatar`是一种基于**PaddlePaddle**深度学习框架的数字人生成工具，基于Paddle的许多套件，它可以将您的数字图像、音频和视频合成为一个逼真的数字人视频。除此之外，`PaddleAvatar`还支持进一步的开发，例如使用自然语言处理技术，将数字人视频转化为一个完整的人机交互系统，使得您能够与虚拟的自己进行真实的对话和互动。\n",
    "\n",
    "使用`PaddleAvatar`，您可以将数字人视频用于各种场合，例如游戏、教育、虚拟现实等等。P`addleAvatar`为您提供了一个自由创作的数字世界，让您的想象力得到了充分的释放！\n",
    "\n",
    "所以，现在就使用`PaddleAvatar`，打造自己的数字分身，探索人机交互的未来吧！\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 🪀 环境说明\n",
    "\n",
    "- Anaconda ![Anconda](https://img.shields.io/badge/Anaconda-orange)\n",
    "- Python 3.7+ ![python38](https://img.shields.io/badge/python-3.7+-brightgreen)\n",
    "- paddlepaddle ![paddlepaddle](https://img.shields.io/badge/paddlepaddle-3.8-blue)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## ⚙️ 1. 安装环境"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false,
    "execution": {
     "iopub.execute_input": "2023-05-12T06:58:13.956780Z",
     "iopub.status.busy": "2023-05-12T06:58:13.956446Z",
     "iopub.status.idle": "2023-05-12T06:58:13.959327Z",
     "shell.execute_reply": "2023-05-12T06:58:13.958762Z",
     "shell.execute_reply.started": "2023-05-12T06:58:13.956758Z"
    },
    "jupyter": {
     "outputs_hidden": false
    },
    "scrolled": true,
    "tags": []
   },
   "outputs": [],
   "source": [
    "# 下载最新的文件\n",
    "# !rm -rf PaddleAvatar\n",
    "# !git clone https://github.com/Kedreamix/PaddleAvatar.git"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false,
    "execution": {
     "iopub.execute_input": "2023-05-12T06:58:13.961047Z",
     "iopub.status.busy": "2023-05-12T06:58:13.960719Z",
     "iopub.status.idle": "2023-05-12T06:58:18.598686Z",
     "shell.execute_reply": "2023-05-12T06:58:18.597721Z",
     "shell.execute_reply.started": "2023-05-12T06:58:13.961025Z"
    },
    "jupyter": {
     "outputs_hidden": false
    },
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "/home/aistudio/PaddleAvatar\r\n",
      "Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple\r\n",
      "Requirement already satisfied: paddlespeech==1.4.1 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from -r requirements.txt (line 1)) (1.4.1)\r\n",
      "Requirement already satisfied: ppgan==2.1.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from -r requirements.txt (line 2)) (2.1.0)\r\n",
      "Requirement already satisfied: streamlit in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from -r requirements.txt (line 3)) (1.13.0)\r\n",
      "Requirement already satisfied: azure-cognitiveservices-speech==1.26.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from -r requirements.txt (line 5)) (1.26.0)\r\n",
      "Requirement already satisfied: pandas in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from -r requirements.txt (line 6)) (1.1.5)\r\n",
      "Requirement already satisfied: matplotlib in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from -r requirements.txt (line 7)) (2.2.3)\r\n",
      "Requirement already satisfied: textgrid in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.5)\r\n",
      "Requirement already satisfied: resampy in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.2.2)\r\n",
      "Requirement already satisfied: onnxruntime>=1.11.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.14.1)\r\n",
      "Requirement already satisfied: ToJyutping in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.2.3)\r\n",
      "Requirement already satisfied: loguru in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.7.0)\r\n",
      "Requirement already satisfied: g2p-en in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.1.0)\r\n",
      "Requirement already satisfied: librosa==0.8.1 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.8.1)\r\n",
      "Requirement already satisfied: python-dateutil in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.8.2)\r\n",
      "Requirement already satisfied: webrtcvad in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.0.10)\r\n",
      "Requirement already satisfied: zhon in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.1.5)\r\n",
      "Requirement already satisfied: pattern-singleton in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.2.0)\r\n",
      "Requirement already satisfied: websockets in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (10.4)\r\n",
      "Requirement already satisfied: nara-wpe in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.0.9)\r\n",
      "Requirement already satisfied: inflect in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (6.0.4)\r\n",
      "Requirement already satisfied: paddleslim>=2.3.4 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.4.1)\r\n",
      "Requirement already satisfied: opencc in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.1.6)\r\n",
      "Requirement already satisfied: sacrebleu in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.3.1)\r\n",
      "Requirement already satisfied: jsonlines in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (3.1.0)\r\n",
      "Requirement already satisfied: timer in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.2.2)\r\n",
      "Requirement already satisfied: pyworld>=0.2.12 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.3.3)\r\n",
      "Requirement already satisfied: typeguard==2.13.3 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.13.3)\r\n",
      "Requirement already satisfied: paddlespeech-feat in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.1.0)\r\n",
      "Requirement already satisfied: paddleaudio>=1.1.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.1.0)\r\n",
      "Requirement already satisfied: pypinyin<=0.44.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.44.0)\r\n",
      "Requirement already satisfied: praatio<=5.1.1,>=5.0.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (5.1.1)\r\n",
      "Requirement already satisfied: yacs~=0.1.8 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.1.8)\r\n",
      "Requirement already satisfied: opencc-python-reimplemented in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.1.7)\r\n",
      "Requirement already satisfied: g2pM in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.1.2.5)\r\n",
      "Requirement already satisfied: paddlenlp>=2.4.8 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.5.2)\r\n",
      "Requirement already satisfied: h5py in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.9.0)\r\n",
      "Requirement already satisfied: prettytable in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.7.2)\r\n",
      "Requirement already satisfied: ppdiffusers>=0.9.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.14.1)\r\n",
      "Requirement already satisfied: braceexpand in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.1.7)\r\n",
      "Requirement already satisfied: pyyaml in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (5.1.2)\r\n",
      "Requirement already satisfied: hyperpyyaml in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.2.0)\r\n",
      "Requirement already satisfied: pypinyin-dict in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.5.0)\r\n",
      "Requirement already satisfied: editdistance in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.6.2)\r\n",
      "Requirement already satisfied: easydict in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (1.9)\r\n",
      "Requirement already satisfied: tqdm in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (4.64.1)\r\n",
      "Requirement already satisfied: munch in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (2.5.0)\r\n",
      "Requirement already satisfied: scikit-image>=0.14.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (0.19.3)\r\n",
      "Requirement already satisfied: opencv-python in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (4.6.0.66)\r\n",
      "Requirement already satisfied: natsort in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (8.3.1)\r\n",
      "Requirement already satisfied: numba==0.53.1 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (0.53.1)\r\n",
      "Requirement already satisfied: scipy>=1.1.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (1.6.3)\r\n",
      "Requirement already satisfied: imageio-ffmpeg in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (0.3.0)\r\n",
      "Requirement already satisfied: imageio==2.9.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ppgan==2.1.0->-r requirements.txt (line 2)) (2.9.0)\r\n",
      "Requirement already satisfied: pillow in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from imageio==2.9.0->ppgan==2.1.0->-r requirements.txt (line 2)) (8.2.0)\r\n",
      "Requirement already satisfied: numpy in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from imageio==2.9.0->ppgan==2.1.0->-r requirements.txt (line 2)) (1.21.6)\r\n",
      "Requirement already satisfied: pooch>=1.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.7.0)\r\n",
      "Requirement already satisfied: soundfile>=0.10.2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.10.3.post1)\r\n",
      "Requirement already satisfied: decorator>=3.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (4.4.2)\r\n",
      "Requirement already satisfied: scikit-learn!=0.19.0,>=0.14.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.24.2)\r\n",
      "Requirement already satisfied: audioread>=2.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.1.8)\r\n",
      "Requirement already satisfied: joblib>=0.14 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.14.1)\r\n",
      "Requirement already satisfied: packaging>=20.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (21.3)\r\n",
      "Requirement already satisfied: setuptools in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from numba==0.53.1->ppgan==2.1.0->-r requirements.txt (line 2)) (56.2.0)\r\n",
      "Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from numba==0.53.1->ppgan==2.1.0->-r requirements.txt (line 2)) (0.36.0)\r\n",
      "Requirement already satisfied: validators>=0.2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (0.20.0)\r\n",
      "Requirement already satisfied: pympler>=0.9 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (1.0.1)\r\n",
      "Requirement already satisfied: pyarrow>=4.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (10.0.0)\r\n",
      "Requirement already satisfied: altair>=3.2.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (4.2.0)\r\n",
      "Requirement already satisfied: cachetools>=4.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (4.0.0)\r\n",
      "Requirement already satisfied: pydeck>=0.1.dev5 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (0.8.0)\r\n",
      "Requirement already satisfied: blinker>=1.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (1.5)\r\n",
      "Requirement already satisfied: click>=7.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (8.0.4)\r\n",
      "Requirement already satisfied: tzlocal>=1.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (4.2)\r\n",
      "Requirement already satisfied: rich>=10.11.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (12.6.0)\r\n",
      "Requirement already satisfied: tornado>=5.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (6.2)\r\n",
      "Requirement already satisfied: watchdog in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (2.2.0)\r\n",
      "Requirement already satisfied: importlib-metadata>=1.4 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (4.2.0)\r\n",
      "Requirement already satisfied: protobuf!=3.20.2,<4,>=3.12 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (3.20.0)\r\n",
      "Requirement already satisfied: gitpython!=3.1.19 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (3.1.14)\r\n",
      "Requirement already satisfied: requests>=2.4 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (2.24.0)\r\n",
      "Requirement already satisfied: typing-extensions>=3.10.0.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (4.5.0)\r\n",
      "Requirement already satisfied: semver in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (2.13.0)\r\n",
      "Requirement already satisfied: toml in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from streamlit->-r requirements.txt (line 3)) (0.10.0)\r\n",
      "Requirement already satisfied: pytz>=2017.2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from pandas->-r requirements.txt (line 6)) (2019.3)\r\n",
      "Requirement already satisfied: cycler>=0.10 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->-r requirements.txt (line 7)) (0.10.0)\r\n",
      "Requirement already satisfied: kiwisolver>=1.0.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->-r requirements.txt (line 7)) (1.1.0)\r\n",
      "Requirement already satisfied: six>=1.10 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->-r requirements.txt (line 7)) (1.16.0)\r\n",
      "Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->-r requirements.txt (line 7)) (3.0.9)\r\n",
      "Requirement already satisfied: jinja2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from altair>=3.2.0->streamlit->-r requirements.txt (line 3)) (3.0.0)\r\n",
      "Requirement already satisfied: entrypoints in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from altair>=3.2.0->streamlit->-r requirements.txt (line 3)) (0.4)\r\n",
      "Requirement already satisfied: toolz in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from altair>=3.2.0->streamlit->-r requirements.txt (line 3)) (0.12.0)\r\n",
      "Requirement already satisfied: jsonschema>=3.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from altair>=3.2.0->streamlit->-r requirements.txt (line 3)) (4.16.0)\r\n",
      "Requirement already satisfied: gitdb<5,>=4.0.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from gitpython!=3.1.19->streamlit->-r requirements.txt (line 3)) (4.0.5)\r\n",
      "Requirement already satisfied: zipp>=0.5 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from importlib-metadata>=1.4->streamlit->-r requirements.txt (line 3)) (3.8.1)\r\n",
      "Requirement already satisfied: sympy in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from onnxruntime>=1.11.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.10.1)\r\n",
      "Requirement already satisfied: coloredlogs in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from onnxruntime>=1.11.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (15.0.1)\r\n",
      "Requirement already satisfied: flatbuffers in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from onnxruntime>=1.11.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (23.5.9)\r\n",
      "Requirement already satisfied: colorlog in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (4.1.0)\r\n",
      "Requirement already satisfied: kaldiio in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.18.0)\r\n",
      "Requirement already satisfied: pybind11 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.10.4)\r\n",
      "Requirement already satisfied: pathos==0.2.8 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.2.8)\r\n",
      "Requirement already satisfied: parameterized in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.9.0)\r\n",
      "Requirement already satisfied: ppft>=1.6.6.4 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from pathos==0.2.8->paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.7.6.6)\r\n",
      "Requirement already satisfied: dill>=0.3.4 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from pathos==0.2.8->paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.3.4)\r\n",
      "Requirement already satisfied: multiprocess>=0.70.12 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from pathos==0.2.8->paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.70.12.2)\r\n",
      "Requirement already satisfied: pox>=0.3.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from pathos==0.2.8->paddleaudio>=1.1.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.3.2)\r\n",
      "Requirement already satisfied: paddle2onnx in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.0.0)\r\n",
      "Requirement already satisfied: datasets>=2.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.7.0)\r\n",
      "Requirement already satisfied: fastapi in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.95.0)\r\n",
      "Requirement already satisfied: huggingface-hub>=0.11.1 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.14.1)\r\n",
      "Requirement already satisfied: colorama in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.4.4)\r\n",
      "Requirement already satisfied: Flask-Babel<3.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.0.0)\r\n",
      "Requirement already satisfied: uvicorn in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.21.1)\r\n",
      "Requirement already satisfied: typer in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.9.0)\r\n",
      "Requirement already satisfied: sentencepiece in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.1.96)\r\n",
      "Requirement already satisfied: paddlefsl in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.1.0)\r\n",
      "Requirement already satisfied: seqeval in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.2.2)\r\n",
      "Requirement already satisfied: jieba in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.42.1)\r\n",
      "Requirement already satisfied: visualdl in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.4.0)\r\n",
      "Requirement already satisfied: swig in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddleslim>=2.3.4->paddlespeech==1.4.1->-r requirements.txt (line 1)) (4.1.1)\r\n",
      "Requirement already satisfied: pyzmq in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddleslim>=2.3.4->paddlespeech==1.4.1->-r requirements.txt (line 1)) (23.2.1)\r\n",
      "Requirement already satisfied: safetensors in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ppdiffusers>=0.9.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.3.1)\r\n",
      "Requirement already satisfied: regex in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ppdiffusers>=0.9.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2023.5.5)\r\n",
      "Requirement already satisfied: ftfy in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ppdiffusers>=0.9.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (6.1.1)\r\n",
      "Requirement already satisfied: cython>=0.24 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from pyworld>=0.2.12->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.29)\r\n",
      "Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests>=2.4->streamlit->-r requirements.txt (line 3)) (1.25.11)\r\n",
      "Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests>=2.4->streamlit->-r requirements.txt (line 3)) (2019.9.11)\r\n",
      "Requirement already satisfied: idna<3,>=2.5 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests>=2.4->streamlit->-r requirements.txt (line 3)) (2.8)\r\n",
      "Requirement already satisfied: chardet<4,>=3.0.2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests>=2.4->streamlit->-r requirements.txt (line 3)) (3.0.4)\r\n",
      "Requirement already satisfied: commonmark<0.10.0,>=0.9.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from rich>=10.11.0->streamlit->-r requirements.txt (line 3)) (0.9.1)\r\n",
      "Requirement already satisfied: pygments<3.0.0,>=2.6.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from rich>=10.11.0->streamlit->-r requirements.txt (line 3)) (2.13.0)\r\n",
      "Requirement already satisfied: PyWavelets>=1.1.1 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from scikit-image>=0.14.0->ppgan==2.1.0->-r requirements.txt (line 2)) (1.3.0)\r\n",
      "Requirement already satisfied: tifffile>=2019.7.26 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from scikit-image>=0.14.0->ppgan==2.1.0->-r requirements.txt (line 2)) (2021.11.2)\r\n",
      "Requirement already satisfied: networkx>=2.2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from scikit-image>=0.14.0->ppgan==2.1.0->-r requirements.txt (line 2)) (2.4)\r\n",
      "Requirement already satisfied: backports.zoneinfo in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from tzlocal>=1.1->streamlit->-r requirements.txt (line 3)) (0.2.1)\r\n",
      "Requirement already satisfied: pytz-deprecation-shim in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from tzlocal>=1.1->streamlit->-r requirements.txt (line 3)) (0.1.0.post0)\r\n",
      "Requirement already satisfied: distance>=0.1.3 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from g2p-en->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.1.3)\r\n",
      "Requirement already satisfied: nltk>=3.2.4 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from g2p-en->paddlespeech==1.4.1->-r requirements.txt (line 1)) (3.4.5)\r\n",
      "Requirement already satisfied: pydantic>=1.9.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from inflect->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.10.6)\r\n",
      "Requirement already satisfied: ruamel.yaml>=0.17.8 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from hyperpyyaml->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.17.21)\r\n",
      "Requirement already satisfied: attrs>=19.2.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from jsonlines->paddlespeech==1.4.1->-r requirements.txt (line 1)) (22.1.0)\r\n",
      "Requirement already satisfied: bottleneck in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from nara-wpe->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.3.7)\r\n",
      "Requirement already satisfied: mock in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from paddlespeech-feat->paddlespeech==1.4.1->-r requirements.txt (line 1)) (5.0.2)\r\n",
      "Requirement already satisfied: lxml in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from sacrebleu->paddlespeech==1.4.1->-r requirements.txt (line 1)) (4.9.1)\r\n",
      "Requirement already satisfied: tabulate>=0.8.9 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from sacrebleu->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.9.0)\r\n",
      "Requirement already satisfied: portalocker in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from sacrebleu->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.7.0)\r\n",
      "Requirement already satisfied: pygtrie in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ToJyutping->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.5.0)\r\n",
      "Requirement already satisfied: xxhash in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (3.1.0)\r\n",
      "Requirement already satisfied: responses<0.19 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.18.0)\r\n",
      "Requirement already satisfied: fsspec[http]>=2021.11.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2022.11.0)\r\n",
      "Requirement already satisfied: aiohttp in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (3.8.3)\r\n",
      "Requirement already satisfied: Flask in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from Flask-Babel<3.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.1.1)\r\n",
      "Requirement already satisfied: Babel>=2.3 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from Flask-Babel<3.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.8.0)\r\n",
      "Requirement already satisfied: smmap<4,>=3.0.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from gitdb<5,>=4.0.1->gitpython!=3.1.19->streamlit->-r requirements.txt (line 3)) (3.0.5)\r\n",
      "Requirement already satisfied: filelock in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from huggingface-hub>=0.11.1->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (3.0.12)\r\n",
      "Requirement already satisfied: MarkupSafe>=2.0.0rc2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from jinja2->altair>=3.2.0->streamlit->-r requirements.txt (line 3)) (2.0.1)\r\n",
      "Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from jsonschema>=3.0->altair>=3.2.0->streamlit->-r requirements.txt (line 3)) (0.18.1)\r\n",
      "Requirement already satisfied: pkgutil-resolve-name>=1.3.10 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from jsonschema>=3.0->altair>=3.2.0->streamlit->-r requirements.txt (line 3)) (1.3.10)\r\n",
      "Requirement already satisfied: importlib-resources>=1.4.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from jsonschema>=3.0->altair>=3.2.0->streamlit->-r requirements.txt (line 3)) (5.9.0)\r\n",
      "Requirement already satisfied: platformdirs>=2.5.0 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from pooch>=1.0->librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (3.5.1)\r\n",
      "Requirement already satisfied: ruamel.yaml.clib>=0.2.6 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from ruamel.yaml>=0.17.8->hyperpyyaml->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.2.6)\r\n",
      "Requirement already satisfied: threadpoolctl>=2.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from scikit-learn!=0.19.0,>=0.14.0->librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.1.0)\r\n",
      "Requirement already satisfied: cffi>=1.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from soundfile>=0.10.2->librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.15.1)\r\n",
      "Requirement already satisfied: humanfriendly>=9.1 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from coloredlogs->onnxruntime>=1.11.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (10.0)\r\n",
      "Requirement already satisfied: starlette<0.27.0,>=0.26.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from fastapi->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.26.1)\r\n",
      "Requirement already satisfied: wcwidth>=0.2.5 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from ftfy->ppdiffusers>=0.9.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.2.6)\r\n",
      "Requirement already satisfied: tzdata in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from pytz-deprecation-shim->tzlocal>=1.1->streamlit->-r requirements.txt (line 3)) (2022.7)\r\n",
      "Requirement already satisfied: mpmath>=0.19 in /home/aistudio/.data/webide/pip/lib/python3.7/site-packages (from sympy->onnxruntime>=1.11.0->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.3.0)\r\n",
      "Requirement already satisfied: h11>=0.8 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from uvicorn->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.14.0)\r\n",
      "Requirement already satisfied: bce-python-sdk in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from visualdl->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.8.53)\r\n",
      "Requirement already satisfied: pycparser in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from cffi>=1.0->soundfile>=0.10.2->librosa==0.8.1->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.21)\r\n",
      "Requirement already satisfied: Werkzeug>=0.15 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from Flask->Flask-Babel<3.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.16.0)\r\n",
      "Requirement already satisfied: itsdangerous>=0.24 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from Flask->Flask-Babel<3.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.1.0)\r\n",
      "Requirement already satisfied: multidict<7.0,>=4.5 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (6.0.2)\r\n",
      "Requirement already satisfied: yarl<2.0,>=1.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.7.2)\r\n",
      "Requirement already satisfied: charset-normalizer<3.0,>=2.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (2.1.1)\r\n",
      "Requirement already satisfied: asynctest==0.13.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.13.0)\r\n",
      "Requirement already satisfied: frozenlist>=1.1.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.3.0)\r\n",
      "Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (4.0.2)\r\n",
      "Requirement already satisfied: aiosignal>=1.1.2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->datasets>=2.0.0->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.2.0)\r\n",
      "Requirement already satisfied: anyio<5,>=3.4.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from starlette<0.27.0,>=0.26.1->fastapi->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (3.6.1)\r\n",
      "Requirement already satisfied: pycryptodome>=3.8.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from bce-python-sdk->visualdl->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (3.9.9)\r\n",
      "Requirement already satisfied: future>=0.6.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from bce-python-sdk->visualdl->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (0.18.0)\r\n",
      "Requirement already satisfied: sniffio>=1.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from anyio<5,>=3.4.0->starlette<0.27.0,>=0.26.1->fastapi->paddlenlp>=2.4.8->paddlespeech==1.4.1->-r requirements.txt (line 1)) (1.3.0)\r\n",
      "\r\n",
      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.1.2\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m23.1.2\u001b[0m\r\n",
      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\r\n"
     ]
    }
   ],
   "source": [
    "%cd PaddleAvatar\n",
    "!pip install -r requirements.txt --user"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 😀 2.PaddleAvator技术原理\n",
    "\n",
    "![](https://ai-studio-static-online.cdn.bcebos.com/a19b9b24633a4f3c8522561b2fe5a2213396ba3048b34e2c9de6721a13e3788f)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 🔮 3.网页部署（Streamlit）\n",
    "\n",
    "这里可以使用`streamlit`进行网页端的部署，这样就利用可视化进行体验，这里可以看到有一个8501的端口，打开来即可看到网页\n",
    "\n",
    "```bash\n",
    "streamlit run avator.streamlit.py\n",
    "```\n",
    "\n",
    "\n",
    "\n",
    "对于TTS，文字转语音来说，我设置了两种方式\n",
    "\n",
    "- PaddleSpeech语音合成，可选择多种声音和语调，可以调节语言和人\n",
    "- Azure微软语音合成，调用微软的API进行语音合成，不过需要填入密钥（这里不提供）"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false,
    "execution": {
     "iopub.execute_input": "2023-05-12T06:58:18.600413Z",
     "iopub.status.busy": "2023-05-12T06:58:18.599996Z"
    },
    "jupyter": {
     "outputs_hidden": false
    },
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\r\n",
      "Collecting usage statistics. To deactivate, set browser.gatherUsageStats to False.\r\n",
      "\u001b[0m\r\n",
      "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/streamlit/web/bootstrap.py:109: UserWarning: \r\n",
      "This call to matplotlib.use() has no effect because the backend has already\r\n",
      "been chosen; matplotlib.use() must be called *before* pylab, matplotlib.pyplot,\r\n",
      "or matplotlib.backends is imported for the first time.\r\n",
      "\r\n",
      "The backend was *originally* set to 'module://matplotlib_inline.backend_inline' by the following code:\r\n",
      "  File \"/opt/conda/envs/python35-paddle120-env/bin/streamlit\", line 5, in <module>\r\n",
      "    from streamlit.web.cli import main\r\n",
      "  File \"/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/streamlit/__init__.py\", line 70, in <module>\r\n",
      "    from streamlit.delta_generator import DeltaGenerator as _DeltaGenerator\r\n",
      "  File \"/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/streamlit/delta_generator.py\", line 90, in <module>\r\n",
      "    from streamlit.elements.arrow import ArrowMixin\r\n",
      "  File \"/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/streamlit/elements/arrow.py\", line 21, in <module>\r\n",
      "    from pandas.io.formats.style import Styler\r\n",
      "  File \"/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/pandas/io/formats/style.py\", line 46, in <module>\r\n",
      "    import matplotlib.pyplot as plt\r\n",
      "  File \"/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/matplotlib/pyplot.py\", line 71, in <module>\r\n",
      "    from matplotlib.backends import pylab_setup\r\n",
      "  File \"/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/matplotlib/backends/__init__.py\", line 16, in <module>\r\n",
      "    line for line in traceback.format_stack()\r\n",
      "\r\n",
      "\r\n",
      "  matplotlib.use(\"Agg\")\r\n",
      "\u001b[0m\r\n",
      "\u001b[34m\u001b[1m  You can now view your Streamlit app in your browser.\u001b[0m\r\n",
      "\u001b[0m\r\n",
      "\u001b[34m  Network URL: \u001b[0m\u001b[1mhttp://10.152.25.45:8501\u001b[0m\r\n",
      "\u001b[34m  External URL: \u001b[0m\u001b[1mhttp://180.76.140.37:8501\u001b[0m\r\n",
      "\u001b[0m\r\n",
      "\r\n",
      "  \u001b[34m\u001b[1mA new version of Streamlit is available.\u001b[0m\r\n",
      "\r\n",
      "  See what's new at https://discuss.streamlit.io/c/announcements\r\n",
      "\r\n",
      "  Enter the following command to upgrade:\r\n",
      "  \u001b[34m$\u001b[0m \u001b[1mpip install streamlit --upgrade\u001b[0m\r\n",
      "\u001b[0m\r\n"
     ]
    }
   ],
   "source": [
    "# 在本地终端或者云服务器\n",
    "!streamlit run avatar.streamlit.py\n",
    "\n",
    "# 如果在aistudio中，直接打开这个文件即可，aistudio内置了部署的方法，不过好像响应速度很慢"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "这样子，就会显示以下界面\n",
    "\n",
    "![](https://ai-studio-static-online.cdn.bcebos.com/c8a25b3b22da4046979023d75c330b57829507e53524407d8dfcab99c40a6add)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 🔥 4.未来展望（人机交互）\n",
    "\n",
    "我设计了一个基于自然语言处理、语音和图像处理等人工智能技术的人机交互系统。该系统致力于实现高度逼真的数字人多模态交互，以提供更加自然和亲密的用户体验。如图所示，该系统由四个核心模块组成：\n",
    "\n",
    "(1) `自动语音识别(ASR)模块`，用于将用户的语音输入转化为文本信息。\n",
    "\n",
    "(2) `对话系统(DS)`，用于接收ASR模块输出的文本信息，并进行对话处理。\n",
    "\n",
    "(3) `文本到语音(TTS)模块`，用于将DS模块输出的文本信息转化为高度逼真的语音信息。\n",
    "\n",
    "(4) `数字人生成模块`，用于预处理模型输入的图片和视频，以提取面部特征。接下来，该模型利用TTS模块将低维语音信号映射到高维视频信号，包括嘴巴、表情和动作等。最后，该模型使用神经网络来融合特征和多模态输出视频，并将其在客户端上显示。\n",
    "\n",
    "![](https://ai-studio-static-online.cdn.bcebos.com/b9589499824c432698dcaf80e5421433762f5c7734f64415b1a9b8f21ebe682d)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 🎯 TO DO LIST\n",
    "\n",
    "\n",
    "在本仓库 https://github.com/Kedreamix/PaddleAvatar 之中，已经实现了第3和第4个模块，但是离完整的人机交互系统差一部分，所以这一部分还可以继续努力\n",
    "\n",
    "- [x] 加入表情迁移（丰富头部动作信息）\n",
    "- [ ] 实时语音识别（人与数字人之间就可以通过语音进行对话交流)\n",
    "- [ ] 语音克隆技术（语音克隆合成自己声音，提高数字人分身的真实感和互动体验）\n",
    "- [ ] 类GPT对话系统（提高数字人的交互性和真实感，增强数字人的智能）\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 📑 参考资料\n",
    "\n",
    "- https://github.com/JiehangXie/PaddleBoBo\n",
    "- https://github.com/PaddlePaddle/PaddleSpeech\n",
    "- https://github.com/PaddlePaddle/PaddleGAN"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "py35-paddle1.2.0"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.4"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}