Technical note
语音助手选型
Whisper自动语音识别
参考
- https://mdnice.com/writing/a40f4bcd3b3e40d8931512186982b711
- https://transformers.run/
- https://huggingface.co/docs/transformers/main_classes/pipelines
- https://github.com/openai/whisper
- https://github.com/askrella/speech-rest-api
- https://github.com/wuhanchu/whisper_service/blob/main/run.py
- https://github.com/muaz-khan/RecordRTC/issues/630
官网
- https://openai.com/index/whisper/
- https://github.com/openai/whisper
- https://huggingface.co/openai/whisper-large-v3
语义相似度比对
参考
- https://github.com/whxf/awesome-chinese-nlp/blob/master/doc/%E6%96%87%E6%9C%AC%E7%9B%B8%E4%BC%BC%E5%BA%A6.md
- https://github.com/huaweicloud/ModelArts-Lab/blob/master/notebook/DL_nlp_text_similarity/text_similarity.ipynb
Sentence Similarity
- https://huggingface.co/models?pipeline_tag=sentence-similarity&language=zh&sort=trending
- https://huggingface.co/shibing624/text2vec-base-chinese 102M params
- https://huggingface.co/sentence-transformers/LaBSE 471M params
- https://huggingface.co/GanymedeNil/text2vec-large-chinese 326M params
Feature Extraction
- https://huggingface.co/models?pipeline_tag=feature-extraction&language=zh&sort=trending
- https://huggingface.co/maidalun1020/bce-embedding-base_v1
- https://huggingface.co/intfloat/multilingual-e5-large
- https://huggingface.co/BAAI/bge-large-zh-v1.5