qywu / blenderbot2-retriever Goto Github PK

BlenderBot2-main$ python3 interactive.py
19:30:04 | building data: /home/sun/.local/lib/python3.10/site-packages/data/models/blenderbot2/blenderbot2_400M/model.tgz
19:30:04 | Downloading http://parl.ai/downloads/_models/blenderbot2/blenderbot2_400M/model.tgz to /home/sun/.local/lib/python3.10/site-packages/data/models/blenderbot2/blenderbot2_400M/model.tgz
Downloading model.tgz: 100%|███████████████| 2.42G/2.42G [25:25<00:00, 1.58MB/s]
2022-05-04 19:56:06.659422: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2022-05-04 19:56:06.659453: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
19:56:09 | Overriding opt["task"] to blended_skill_talk (previously: None)
19:56:09 | Overriding opt["model_file"] to /home/sun/.local/lib/python3.10/site-packages/data/models/blenderbot2/blenderbot2_400M/model (previously: /checkpoint/kshuster/projects/knowledge_bot/kbot_memfix_sweep25_Fri_Jul__9/338/model.oss)
19:56:09 | Overriding opt["search_server"] to https://api.bing.microsoft.com/v7.0/search (previously: None)
19:56:09 | Using CUDA
19:56:09 | loading dictionary from /home/sun/.local/lib/python3.10/site-packages/data/models/blenderbot2/blenderbot2_400M/model.dict
19:56:09 | num words = 50264
19:56:09 | BlenderBot2Fid: full interactive mode on.
19:56:36 | building data: /home/sun/.local/lib/python3.10/site-packages/data/models/hallucination/bart_rag_token/model.tgz
19:56:36 | Downloading http://parl.ai/downloads/_models/hallucination/bart_rag_token/model.tgz to /home/sun/.local/lib/python3.10/site-packages/data/models/hallucination/bart_rag_token/model.tgz
Downloading model.tgz: 0.00B [00:00, ?B/s]
Traceback (most recent call last):
File "/home/sun/NLI/BlenderBot2-main/interactive.py", line 124, in
Interactive.main(
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/script.py", line 125, in main
return cls._run_args(args)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/script.py", line 101, in _run_args
return cls._run_from_parser_and_opt(opt, parser)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/script.py", line 108, in _run_from_parser_and_opt
return script.run()
File "/home/sun/NLI/BlenderBot2-main/interactive.py", line 119, in run
return interactive(self.opt)
File "/home/sun/NLI/BlenderBot2-main/interactive.py", line 82, in interactive
agent = create_agent(opt, requireModelExists=True)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/agents.py", line 468, in create_agent
model = create_agent_from_opt_file(opt)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/agents.py", line 421, in create_agent_from_opt_file
return model_class(opt_from_file)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/agents/rag/rag.py", line 186, in init
self._generation_agent.init(self, opt, shared) # type: ignore
File "/home/sun/.local/lib/python3.10/site-packages/parlai/agents/bart/bart.py", line 72, in init
super().init(opt, shared)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/torch_generator_agent.py", line 485, in init
self.model = fsdp_utils.fsdp_wrap(self.build_model())
File "/home/sun/.local/lib/python3.10/site-packages/projects/blenderbot2/agents/blenderbot2.py", line 969, in build_model
model = BlenderBot2FidModel(self.opt, self.dict)
File "/home/sun/.local/lib/python3.10/site-packages/projects/blenderbot2/agents/modules.py", line 835, in init
super().init(
File "/home/sun/.local/lib/python3.10/site-packages/projects/blenderbot2/agents/modules.py", line 90, in init
self.retriever = retriever_factory(opt, dictionary, shared=retriever_shared)
File "/home/sun/.local/lib/python3.10/site-packages/projects/blenderbot2/agents/modules.py", line 65, in retriever_factory
return BB2SearchQuerySearchEngineRetriever(opt, dictionary, shared=shared)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/agents/rag/retrievers.py", line 1158, in init
super().init(opt, dictionary, shared)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/agents/rag/retrievers.py", line 1069, in init
self.init_query_encoder(opt)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/agents/rag/retrievers.py", line 1112, in init_query_encoder
self.query_encoder = DprQueryEncoder(
File "/home/sun/.local/lib/python3.10/site-packages/parlai/agents/rag/dpr.py", line 183, in init
super().init(*args, **kwargs)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/agents/rag/dpr.py", line 106, in init
pretrained_path = modelzoo_path(
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/build_data.py", line 507, in modelzoo_path
my_module.download(datapath)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/zoo/hallucination/bart_rag_token.py", line 21, in download
download_models(
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/build_data.py", line 472, in download_models
untar(dpath, fname, flatten_tar=flatten_tar)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/build_data.py", line 271, in untar
return _untar(path, fname, delete=delete, flatten=flatten_tar)
File "/home/sun/.local/lib/python3.10/site-packages/parlai/core/build_data.py", line 310, in _untar
with PathManager.open(fn, 'wb') as wf, tf.extractfile(item.name) as rf:
File "/usr/lib/python3.10/tarfile.py", line 2117, in extractfile
tarinfo = self.getmember(member)
File "/usr/lib/python3.10/tarfile.py", line 1801, in getmember
tarinfo = self._getmember(name.rstrip('/'))
File "/usr/lib/python3.10/tarfile.py", line 2387, in _getmember
members = self.getmembers()
File "/usr/lib/python3.10/tarfile.py", line 1812, in getmembers
self._load() # all members, we first have to
File "/usr/lib/python3.10/tarfile.py", line 2410, in _load
tarinfo = self.next()
File "/usr/lib/python3.10/tarfile.py", line 2332, in next
self.fileobj.seek(self.offset - 1)
File "/usr/lib/python3.10/gzip.py", line 393, in seek
return self._buffer.seek(offset, whence)
File "/usr/lib/python3.10/_compression.py", line 153, in seek
data = self.read(min(io.DEFAULT_BUFFER_SIZE, offset))
File "/usr/lib/python3.10/gzip.py", line 507, in read
raise EOFError("Compressed file ended before the "
EOFError: Compressed file ended before the end-of-stream marker was reached