ModuleNotFoundError: No module named 'nemo.collections.asr.metrics.rnnt_wer' about nemo

[titu1994]

If you do pip install -e .[all], then the main branch version of the scripts are needed.
If you do pip install nemo_toolkit[all]==VERSION then you need to switch to VERSION branch before going to the example scripts.

The two mismatches you're seeing are

1. Traceback (most recent call last):
   File "/home/aidos/exp/NeMo/examples/asr/speech_to_text_eval.py", line 71, in
   import transcribe_speech
   File "/home/aidos/exp/NeMo/examples/asr/transcribe_speech.py", line 34, in
   from nemo.collections.asr.parts.utils.transcribe_utils import (
   ImportError: cannot import name 'read_and_maybe_sort_manifest' from 'nemo.collections.asr.parts.utils.transcribe_utils' (/home/aidos/nemo_venv/lib/python3.11/site-packages/nemo/collections/asr/parts/utils/transcribe_utils.py)

I tried this on both transcribe speech and speech to text eval just a moment ago - they work.
Most likely you have an older version of main branch (or are using 1.23 branch and attempting to use the latest main script) - you need to pull from main again and install it.

2. The dataclass issue - you're using Python 3.11 presumably. Its a bug with the dataclass handling, ill fix that in a PR in some time. If you want you can switch to 3.10 if its easy, or wait until I fix it.

[titu1994]

Can you paste your full stack trace ? Rnnt wer was merged into wer.py in NeMo 1.23.0, and we tested the eval script but might have missed something.

[aidos-aiforiatech]

Traceback (most recent call last):
  File "/home/aidos/exp/NeMo/examples/asr/speech_to_text_eval.py", line 71, in <module>
    import transcribe_speech
  File "/home/aidos/exp/NeMo/examples/asr/transcribe_speech.py", line 34, in <module>
    from nemo.collections.asr.parts.utils.transcribe_utils import (
ImportError: cannot import name 'read_and_maybe_sort_manifest' from 'nemo.collections.asr.parts.utils.transcribe_utils' (/home/aidos/nemo_venv/lib/python3.11/site-packages/nemo/collections/asr/parts/utils/transcribe_utils.py)

This exception is being thrown on main branch.

[aidos-aiforiatech]

I tried to switch to r1.23.0 and r1.22.0 etc. Further exceptions were thrown of different branches:

[titu1994]

You can't use the main branch script with the r1.23 branch or lower Nemo installation, you should switch to the correct branch of the installed NeMo version before using the script. So if you have 1.23 pip installed you need the 1.23.0 branch

[titu1994]

As to main, thanks for the trace, well take a look asap. Fyi @stevehuang52 @tbartley94

[aidos-aiforiatech]

You can't use the main branch script with the r1.23 branch or lower Nemo installation, you should switch to the correct branch of the installed NeMo version before using the script. So if you have 1.23 pip installed you need the 1.23.0 branch

I'm actually training on main branch. The Nemo toolkit has been install in python venv.
For the inference then, should I create another venv and install r1.23? Is speech_to_text_eval script is working stable on that version?