nslearning / langhelper

Striving to create a great Application with full functions of learning languages by ChatGPT, TTS, STT and other awesome AI models, supports talking, speaking assessment, memorizing words with contexts, Listening test, so on.

✨ Features / 功能

1. talk to ChatGPT / 口语对话

   • support different speech types, web, AI with hundreds accents (VCTK corpus), will support azure, iflytek. 100多种口音演示

   • support two recognition tech, web and iflytek. 双语识别演示

   • talk to any celebrities, such as Obama, Taylor, Downey...奥巴马、霉霉、小罗伯特唐尼实时语音演示

   • will offer interface for loading your TTS model.

2. Speaking Assessment / 发音评分

   integrate two Assessment API, speechsuper and iflytek now, open to get better algorithms to perfect the feature for IELTS/TOEFL test. 口语评分演示 + IELTS spoken test prompts

📦 Install

windows

ChatGPT and LangHelper + espeak-ng 装x86版的. ChatGPT and LangHelper 都是免安装的，espeak-ng 一路默认安装即可。视频教程 + 文字教程及注意事项

目前要使用AI发音得装ChatGPT desktop for Langhelper + LangHelper + espeak-ng，因为跑AI用到pytorch一些库比较大，放弃了把python程序打包成bin文件集成到ChatGPT desktop for Langhelper， espeak-ng是语音合成的必须依赖。

• ChatGPT desktop for Langhelper(改版后的chatgpt桌面应用)， windows 4月初更新那版好像会查杀，允许就好（可以查源代码, 没有任何其他有害脚本注入）。
• LangHelper（AI发音及其他辅助程序, LangHelper文件下的python程序)
• espeak-ng (开源的文本转语音库)

instructions

1. 解压压缩包，一个Langhelper文件夹（内含langhelper.exe），一个chatgpt.exe, 分别打开。langhelper 会等待chatgpt配置完成后才能工作，chatgpt在-> preferences -> control center -> setting -> LangHelper 下设置语音相关功能， 没有配置API，就不要选其他的speech type 和recognition，设置完成后点击submit后, 有个restart提示点击yes. 这是langhelper窗口会出现Complete init -> start conversation，表示初始化完成。

2. 对话不能正常AI发音，先在setting -> LangHelper->Audition text 同行点击try测试是否能发音，文本为空则会默认合成"you are gorgeous, i love you". 看langhlper界面是什么提示，error:Obama, 就是表示Obama口音不能用，其他就是可能环境没配置好。入群发问请给出详细的错误截图信息。以下为合成How can I assist you today? 正常信息提示：

   Text splitted to sentences. ['How can I assist you today?'] Hello! p241 Text splitted to sentences. ['Hello!'] Processing time: 0.8514664173126221 Real-time factor: 0.5273829916220033 Processing time: 0.6864285469055176 Real-time factor: 0.6285610240559246

3. 语音识别，需先点一次speech recognition, 待不再需要识别后再点一次结束识别。

IELTS

How to set up prompts? Preferences -> control center ->Language Model -> User Custom ->Add model, add your custom prompts, here is my presetting ITELTS prompt for reference:

I want you to ask me some questions for simulating IELTS speaking test, non offical but give score of reference,when you ask me a question, I'll respond you my spoken text and prounciation scores which come from speech recognition and assessment tech, please remeber that you should ask me question one by one it means that you should offer another question after I give you response text which including prouncation scores, do not give questions one time because I do not want to respond it by one time, after all questions finished , you can combine the score to assess my answer, please give me the final score of IELTS speaking test.so let's start first question.

Mission

11.22 OpenAI已出完全免费的语音对话功能，非PLUS也可以用：https://twitter.com/OpenAI/status/1727065166188274145

langhelper's Issues

在各项功能都正常运行的情况下生成的每句语音都会包含"one slash"

Untitled.video.-.Made.with.Clipchamp.3.mp4

看起来像一个错误代码

切换唐尼的口音报错，也不会有任何声音。其他口音没问题

无法加入群了

交流群已满200，进不去了