Comments (7)
for models published on huggingface
How can I figure out whether the model is published on huggingface or not?
I have been using https://catalog.ngc.nvidia.com/models to find models.
from nemo.
By the way,
import nemo.collections.asr as nemo_asr
asr_model = nemo_asr.models.EncDecHybridRNNTCTCBPEModel.from_pretrained(model_name="stt_ua_fastconformer_hybrid_large_pc")
from
https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/stt_ua_fastconformer_hybrid_large_pc
throws the following error:
[NeMo I 2024-05-09 02:22:17 nemo_logging:381] PADDING: 0
[NeMo E 2024-05-09 02:22:17 nemo_logging:405] Model instantiation failed!
Target class: nemo.collections.asr.models.hybrid_rnnt_ctc_bpe_models.EncDecHybridRNNTCTCBPEModel
Error(s): Error in call to target 'nemo.collections.asr.modules.conformer_encoder.ConformerEncoder':
TypeError("ConformerEncoder.__init__() got an unexpected keyword argument 'conv_pointwise_type'")
Traceback (most recent call last):
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 92, in _call_target
return _target_(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: ConformerEncoder.__init__() got an unexpected keyword argument 'conv_pointwise_type'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/nemo/core/classes/common.py", line 502, in from_config_dict
instance = imported_cls(cfg=config, trainer=trainer)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/nemo/collections/asr/models/hybrid_rnnt_ctc_bpe_models.py", line 94, in __init__
super().__init__(cfg=cfg, trainer=trainer)
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/nemo/collections/asr/models/hybrid_rnnt_ctc_models.py", line 45, in __init__
super().__init__(cfg=cfg, trainer=trainer)
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/nemo/collections/asr/models/rnnt_models.py", line 66, in __init__
self.encoder = EncDecRNNTModel.from_config_dict(self.cfg.encoder)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/nemo/core/classes/common.py", line 485, in from_config_dict
instance = hydra.utils.instantiate(config=config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 226, in instantiate
return instantiate_node(
^^^^^^^^^^^^^^^^^
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 347, in instantiate_node
return _call_target(_target_, partial, args, kwargs, full_key)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/sdb/shared/py311/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 97, in _call_target
raise InstantiationException(msg) from e
hydra.errors.InstantiationException: Error in call to target 'nemo.collections.asr.modules.conformer_encoder.ConformerEncoder':
TypeError("ConformerEncoder.__init__() got an unexpected keyword argument 'conv_pointwise_type'")
from nemo.
Hi @csukuangfj , for models published on huggingface you need to prepend nvidia name as well along with model name. so command would look like
import nemo.collections.asr as nemo_asr
asr_model = nemo_asr.models.EncDecHybridRNNTCTCBPEModel.from_pretrained(model_name="nvidia/stt_fa_fastconformer_hybrid_large")
from nemo.
I could load stt_ua_fastconformer_hybrid_large_pc
fine, could you please try again with: (btw I am on main
branch)
asr_model = nemo_asr.models.EncDecHybridRNNTCTCBPEModel.from_pretrained(model_name="nvidia/stt_ua_fastconformer_hybrid_large_pc")
from nemo.
Thank you for your reply.
nvidia/stt_fa_fastconformer_hybrid_large
does work!
I have been following the doc at
https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/stt_fa_fastconformer_hybrid_large
The doc says stt_fa_fastconformer_hybrid_large
, not nvidia/stt_fa_fastconformer_hybrid_large
.
I hope that you either fix the doc or fix the NeMo code to support the doc.
from nemo.
Looks like there is an issue with NGC model version, and hence I suggested huggingface model
its just a copy of it.
from nemo.
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.
from nemo.
Related Issues (20)
- Can we add emotions to the produced audio?
- LM on Parakeet models HOT 1
- to support deepseekv2
- How to use a pre-trained model for cache-aware FastConformer-Hybrid model? HOT 3
- When Trying to import nlp collections in the Nemo Primer getting error "No Module named megatron"
- How to export SLUIntentSlotBPEModel to ONNX HOT 1
- issue about self attention with mask
- Converting megatron checkpoint to .nemo without the same environment
- Nemo container for Nemotron 340B inference fails pytorch_lightning import HOT 1
- Can you support DoRA?
- Unable to reproduce cache aware streaming results for Conformer that were there for Fastconformer.
- Issue: TimeError Occurring During Training on node 16 or more
- Speaker Diarization goes haywire due to small segments of audio
- MCore slower than NeMo native implementation
- FSDP CPU offloading errors out due to device placements
- Getting empty results from online streaming asr. Please help me!!!!! thanks a lot.
- Failed to generate timestamp for parakeet-tdt-1.1b
- Citrinet CTC Decoder Alphabet size mismatch.
- Segmentation fault when fine-tuning Ambernet HOT 3
- Fastconformer-CTC crashing with Watchdog caught collective operation timeout
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nemo.