FunASR/runtime/python/http
IrvingGao d7a6de771c first commit for takway.ai 2024-05-18 15:50:56 +08:00
..
README.md first commit for takway.ai 2024-05-18 15:50:56 +08:00
asr_nginx.conf first commit for takway.ai 2024-05-18 15:50:56 +08:00
client.py first commit for takway.ai 2024-05-18 15:50:56 +08:00
hotwords.txt first commit for takway.ai 2024-05-18 15:50:56 +08:00
requirements.txt first commit for takway.ai 2024-05-18 15:50:56 +08:00
server.py first commit for takway.ai 2024-05-18 15:50:56 +08:00
start_server.sh first commit for takway.ai 2024-05-18 15:50:56 +08:00

README.md

Service with http-python

Server

  1. Install requirements
cd funasr/runtime/python/http
pip install -r requirements.txt
  1. Start server
python server.py --port 8000

More parameters:

python server.py \
--host [host ip] \
--port [server port] \
--asr_model [asr model_name] \
--vad_model [vad model_name] \
--punc_model [punc model_name] \
--device [cuda or cpu] \
--ngpu [0 or 1] \
--ncpu [1 or 4] \
--hotword_path [path of hot word txt] \
--certfile [path of certfile for ssl] \
--keyfile [path of keyfile for ssl] \
--temp_dir [upload file temp dir] 

Client

# get test audio file
wget https://isv-data.oss-cn-hangzhou.aliyuncs.com/ics/MaaS/ASR/test_audio/asr_example_zh.wav
python client.py --host=127.0.0.1 --port=8000 --audio_path=asr_example_zh.wav

More parameters:

python server.py \
--host [sever ip] \
--port [sever port] \
--audio_path [use audio path] 

支持多进程

方法是启动多个server.py然后通过Nginx的负载均衡分发请求达到支持多用户同时连效果处理方式如下默认您已经安装了Nginx没安装的请参考官方安装教程

配置Nginx。

sudo cp -f asr_nginx.conf /etc/nginx/nginx.conf
sudo service nginx reload

然后使用脚本启动多个服务,每个服务的端口号不一样。

sudo chmod +x start_server.sh
./start_server.sh

说明: 默认是3个进程如果需要修改首先修改start_server.sh的最后那部分,可以添加启动数量。然后修改asr_nginx.conf配置文件的upstream backend部分,增加新启动的服务,可以使其他服务器的服务。