Comments (7)
benman1
commented on July 22, 2024
Hi @bdeva1975! This is likely a bug in a recent transformers version. Just to check: are you using the version indicated in the book? Could you show me the output that you get from pip show transformers, please?
You can try a different model (for example, liminerity/Phigments12) or a newer transformers version (pip install -U transformers).
from generative_ai_with_langchain.
benman1
commented on July 22, 2024
@bdeva1975 is this resolved, please?
from generative_ai_with_langchain.
darshaniyer
commented on July 22, 2024
from transformers import pipeline
import torch
generate_text = pipeline(
model="liminerity/Phigments12",
torch_dtype=torch.bfloat16,
trust_remote_code=True,
)
The above code worked and generated the following response:
[{'generated_text': "In this chapter, we'll discuss first steps with generative AI in Python. We'll cover the"}]
But when I run the following code:
from langchain import PromptTemplate, LLMChain
template = """Question: {question}
Answer: Let's think step by step."""
prompt = PromptTemplate(template=template, input_variables=["question"])
llm_chain = LLMChain(prompt=prompt, llm=generate_text)
question = "What is electroencephalography?"
print(llm_chain.run(question))
I get the following error:
ValidationError Traceback (most recent call last)
Cell In[10], line 6
3 template = """Question: {question}
4 Answer: Let's think step by step."""
5 prompt = PromptTemplate(template=template, input_variables=["question"])
----> 6 llm_chain = LLMChain(prompt=prompt, llm=generate_text)
8 question = "What is electroencephalography?"
9 print(llm_chain.run(question))
File ~\Anaconda3\envs\langchain_ai\lib\site-packages\langchain_core\load\serializable.py:120, in Serializable.init(self, **kwargs)
119 def init(self, **kwargs: Any) -> None:
--> 120 super().init(**kwargs)
121 self._lc_kwargs = kwargs
File ~\Anaconda3\envs\langchain_ai\lib\site-packages\pydantic\v1\main.py:341, in BaseModel.init(pydantic_self, **data)
339 values, fields_set, validation_error = validate_model(pydantic_self.class, data)
340 if validation_error:
--> 341 raise validation_error
342 try:
343 object_setattr(pydantic_self, 'dict', values)
ValidationError: 2 validation errors for LLMChain
llm
instance of Runnable expected (type=type_error.arbitrary_type; expected_arbitrary_type=Runnable)
llm
instance of Runnable expected (type=type_error.arbitrary_type; expected_arbitrary_type=Runnable)
from generative_ai_with_langchain.
benman1
commented on July 22, 2024
@bdeva1975, hi! Is this with your setup of LC version 0.1? The code on this branch/in the book is relevant to LC version 0.0.284. Have you tried pip install -r requirements.txt or even something like this here - just copy pasting from the requirments.txt file:
pip install 'langchain[docarray]==0.0.284' 'langchain_experimental==0.0.25' 'sentence-transformers>=2.2.2'It's really difficult to help you if you work with very different versions to what's in the book/on GitHub.
Best,
Ben
from generative_ai_with_langchain.
SebLKMa
commented on July 22, 2024
Similar error from http://localhost:8888/notebooks/langchain_transformers.ipynb
TypeError: transformers.generation.utils.GenerationMixin.generate() got multiple values for keyword argument 'pad_token_id'My machine: Docker container, MacBook M2, Ubuntu UTM.
ubuntu@ubuntu:~$ uname -a
Linux ubuntu 5.15.0-86-generic #96-Ubuntu SMP Wed Sep 20 08:29:36 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
ubuntu@ubuntu:~$ docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
455fb048cfbd ben_langchain_ai "jupyter notebook --\u2026" 3 minutes ago Up 3 minutes 0.0.0.0:8888->8888/tcp, :::8888->8888/tcp benBTW, have to resort to lower gpt4all version due to:
# ERROR: Could not find a version that satisfies the requirement gpt4all>=1.0.6 (from versions: 0.1.5, 0.1.6, 0.1.7)
# ERROR: No matching distribution found for gpt4all>=1.0.6
#gpt4all>=1.0.6
gpt4all>=0.1.7pip list below:
(base) root@455fb048cfbd:/home# pip list
Package Version
---------------------------------------- ---------------
accelerate 0.29.2
aiofiles 23.2.1
aiohttp 3.9.4
aiohttp-cors 0.7.0
aiosignal 1.3.1
altair 5.3.0
annotated-types 0.6.0
anyio 4.3.0
apify_client 1.6.4
apify_shared 1.1.1
archspec 0.2.1
argon2-cffi 23.1.0
argon2-cffi-bindings 21.2.0
arrow 1.3.0
arxiv 2.1.0
asgiref 3.8.1
asttokens 2.4.1
async-lru 2.0.4
attrs 23.2.0
Babel 2.14.0
backoff 2.2.1
backports.tarfile 1.0.0
bcrypt 4.1.2
beautifulsoup4 4.12.3
bleach 6.1.0
blinker 1.7.0
boltons 23.0.0
Brotli 1.0.9
build 1.2.1
cachetools 5.3.3
certifi 2024.2.2
cffi 1.16.0
chardet 5.2.0
charset-normalizer 3.3.2
chroma-hnswlib 0.7.3
chromadb 0.4.24
click 8.1.7
coloredlogs 15.0.1
colorful 0.5.6
comm 0.2.2
conda 24.1.2
conda-content-trust 0.2.0
conda-libmamba-solver 24.1.0
conda-package-handling 2.2.0
conda_package_streaming 0.9.0
contourpy 1.2.1
cryptography 42.0.2
curl_cffi 0.6.2
cycler 0.12.1
dataclasses-json 0.5.14
dataclasses-json-speakeasy 0.5.11
debugpy 1.8.1
decorator 5.1.1
defusedxml 0.7.1
Deprecated 1.2.14
distlib 0.3.8
distro 1.8.0
docarray 0.32.1
docstring_parser 0.16
duckduckgo_search 5.3.0
emoji 2.11.0
executing 2.0.1
faiss-cpu 1.8.0
fastapi 0.110.1
fastjsonschema 2.19.1
feedparser 6.0.10
ffmpy 0.3.2
filelock 3.13.4
filetype 1.2.0
flatbuffers 24.3.25
fonttools 4.51.0
fqdn 1.5.1
frozenlist 1.4.1
fsspec 2024.3.1
gitdb 4.0.11
GitPython 3.1.43
google-ai-generativelanguage 0.6.1
google-api-core 2.18.0
google-api-python-client 2.125.0
google-auth 2.29.0
google-auth-httplib2 0.2.0
google-cloud-aiplatform 1.47.0
google-cloud-bigquery 3.20.1
google-cloud-core 2.4.1
google-cloud-resource-manager 1.12.3
google-cloud-storage 2.16.0
google-crc32c 1.5.0
google-generativeai 0.5.0
google-resumable-media 2.7.0
googleapis-common-protos 1.63.0
gpt4all 0.1.7
gradio 4.26.0
gradio_client 0.15.1
greenlet 3.0.3
grpc-google-iam-v1 0.13.0
grpcio 1.62.1
grpcio-status 1.62.1
h11 0.14.0
hnswlib 0.8.0
httpcore 1.0.5
httplib2 0.22.0
httptools 0.6.1
httpx 0.27.0
huggingface-hub 0.22.2
humanfriendly 10.0
idna 3.4
importlib-metadata 7.0.0
importlib_resources 6.4.0
iniconfig 2.0.0
ipykernel 6.29.4
ipython 8.23.0
ipywidgets 8.1.2
isoduration 20.11.0
jaraco.context 5.3.0
jedi 0.19.1
Jinja2 3.1.3
joblib 1.4.0
json5 0.9.25
jsonpatch 1.32
jsonpath-python 1.0.6
jsonpointer 2.1
jsonschema 4.21.1
jsonschema-specifications 2023.12.1
jupyter 1.0.0
jupyter_client 8.6.1
jupyter-console 6.6.3
jupyter_core 5.7.2
jupyter-events 0.10.0
jupyter-lsp 2.2.5
jupyter_server 2.14.0
jupyter_server_terminals 0.5.3
jupyterlab 4.1.6
jupyterlab_pygments 0.3.0
jupyterlab_server 2.26.0
jupyterlab_widgets 3.0.10
kiwisolver 1.4.5
kubernetes 29.0.0
lanarky 0.7.16
langchain 0.0.284
langchain-decorators 0.5.6
langchain-experimental 0.0.25
langdetect 1.0.9
langsmith 0.0.65
libmambapy 1.5.6
lxml 5.2.1
markdown-it-py 3.0.0
MarkupSafe 2.1.5
marshmallow 3.21.1
matplotlib 3.8.4
matplotlib-inline 0.1.6
mdurl 0.1.2
menuinst 2.0.2
mistune 3.0.2
mmh3 4.1.0
monotonic 1.6
more-itertools 10.2.0
mpmath 1.3.0
msgpack 1.0.8
multidict 6.0.5
mypy-extensions 1.0.0
nbclient 0.10.0
nbconvert 7.16.3
nbformat 5.10.4
nest-asyncio 1.6.0
networkx 3.3
nltk 3.8.1
notebook 7.1.2
notebook_shim 0.2.4
numexpr 2.10.0
numpy 1.26.4
oauthlib 3.2.2
onnxruntime 1.17.3
openai 0.28.1
opencensus 0.11.4
opencensus-context 0.1.3
opentelemetry-api 1.24.0
opentelemetry-exporter-otlp-proto-common 1.24.0
opentelemetry-exporter-otlp-proto-grpc 1.24.0
opentelemetry-instrumentation 0.45b0
opentelemetry-instrumentation-asgi 0.45b0
opentelemetry-instrumentation-fastapi 0.45b0
opentelemetry-proto 1.24.0
opentelemetry-sdk 1.24.0
opentelemetry-semantic-conventions 0.45b0
opentelemetry-util-http 0.45b0
orjson 3.10.0
overrides 7.7.0
packaging 23.1
pandas 2.2.2
pandoc 1.1.0
pandocfilters 1.5.1
parso 0.8.4
pexpect 4.9.0
pillow 10.3.0
pip 24.0
platformdirs 3.10.0
pluggy 1.0.0
plumbum 1.8.2
ply 3.11
posthog 3.5.0
prometheus_client 0.20.0
prompt-toolkit 3.0.43
promptwatch 0.4.4
proto-plus 1.23.0
protobuf 4.25.3
psutil 5.9.8
ptyprocess 0.7.0
pulsar-client 3.5.0
pure-eval 0.2.2
py-spy 0.3.14
pyarrow 15.0.2
pyasn1 0.6.0
pyasn1_modules 0.4.0
pycosat 0.6.6
pycparser 2.21
pydantic 2.7.0
pydantic_core 2.18.1
pydeck 0.8.1b0
pydub 0.25.1
Pygments 2.17.2
pyparsing 3.1.2
pypdf 4.2.0
PyPika 0.48.9
pyproject_hooks 1.0.0
PySocks 1.7.1
pytest 7.3.1
python-dateutil 2.9.0.post0
python-dotenv 1.0.1
python-iso639 2024.2.7
python-json-logger 2.0.7
python-magic 0.4.27
python-multipart 0.0.9
pytz 2024.1
PyYAML 6.0.1
pyzmq 25.1.2
qtconsole 5.5.1
QtPy 2.4.1
rapidfuzz 3.8.1
ray 2.10.0
referencing 0.34.0
regex 2023.12.25
replicate 0.25.1
requests 2.31.0
requests-oauthlib 2.0.0
rfc3339-validator 0.1.4
rfc3986-validator 0.1.1
rich 13.7.1
rpds-py 0.18.0
rsa 4.9
ruamel.yaml 0.17.21
ruff 0.3.7
safetensors 0.4.2
scikit-learn 1.4.2
scipy 1.13.0
semantic-version 2.10.0
Send2Trash 1.8.3
sentence-transformers 2.2.2
sentencepiece 0.2.0
setuptools 68.2.2
sgmllib3k 1.0.0
shapely 2.0.3
shellingham 1.5.4
six 1.16.0
smart-open 7.0.4
smmap 5.0.1
sniffio 1.3.1
soupsieve 2.5
SQLAlchemy 2.0.29
stack-data 0.6.3
starlette 0.37.2
streamlit 1.33.0
sympy 1.12
tabulate 0.9.0
tenacity 8.2.3
terminado 0.18.1
threadpoolctl 3.4.0
tiktoken 0.6.0
tinycss2 1.2.1
tokenizers 0.15.2
toml 0.10.2
tomlkit 0.12.0
toolz 0.12.1
torch 2.2.2
torchvision 0.17.2
tornado 6.4
tqdm 4.65.0
traitlets 5.14.2
transformers 4.39.3
truststore 0.8.0
typer 0.12.3
types-python-dateutil 2.9.0.20240316
types-requests 2.31.0.20240406
typing_extensions 4.11.0
typing-inspect 0.9.0
tzdata 2024.1
unstructured 0.13.2
unstructured-client 0.18.0
uri-template 1.3.0
uritemplate 4.1.1
urllib3 2.1.0
uvicorn 0.29.0
uvloop 0.19.0
virtualenv 20.25.1
watchdog 4.0.0
watchfiles 0.21.0
wcwidth 0.2.13
webcolors 1.13
webencodings 0.5.1
websocket-client 1.7.0
websockets 11.0.3
wheel 0.41.2
widgetsnbextension 4.0.10
wikipedia 1.4.0
wolframalpha 5.0.0
wrapt 1.16.0
xmltodict 0.13.0
yarl 1.9.4
zipp 3.18.1
zstandard 0.19.0
(base) root@455fb048cfbd:/home# See if you can repro, thanks in advance
from generative_ai_with_langchain.
amscosta
commented on July 22, 2024
The code snippet is running fine on google colab.
from generative_ai_with_langchain.
Related Issues (20)
- Replicate Example not working in Chapter 3 HOT 5
- can't build docker image HOT 1
- ResolvePackageNotFound of Readline and ncurses HOT 5
- LangChain: 1 validation error for LLMChain - value is not a valid dict (type=type_error.dict) HOT 3
- LLama.cpp model 3B is not available HOT 1
- from langchain.llms import FakeLLM in python throws an error HOT 4
- python_repl not found error HOT 9
- Pydantic format error HOT 3
- langchain[docarray] doesn't install HOT 2
- information_extraction/__init__.py all ways want a validator on BaseModel classes HOT 1
- ModuleNotFoundError: No module named 'chat_with_retrieval' in chat_with_documents.py HOT 7
- AttributeError: module 'openai' has no attribute 'OpenAI' HOT 7
- No PythonREPLTool,no python_repl
- Issue with reading Resume HOT 2
- chapter 3 - Using Hugging Face HOT 1
- Conda and docker setups both fail HOT 2
- Summarizing texts : working alternative for ChatOpenAI HOT 2
- chat_with_retrieval not running HOT 1
- I am not able in create conda env using .yaml file. Here is the message - (base) admin_user@llm-vm:~$ conda env create --file langchain_ai.yaml --force Solving environment: failed ResolvePackageNotFound: -- I am using following Linux env - Description: Ubuntu 22.04.4 LTS Release: 22.04 Codename: jammy, anaconda version is 2023.09-0 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from generative_ai_with_langchain.