GithubHelp home page GithubHelp logo

mayooear / private-chatbot-mpt30b-langchain Goto Github PK

View Code? Open in Web Editor NEW
178.0 4.0 45.0 170 KB

Chat with your data privately using MPT-30b

Home Page: https://www.youtube.com/watch?v=CVd2XHcctJo

License: MIT License

Makefile 2.74% Python 97.26%
ggml gpt langchain llm

private-chatbot-mpt30b-langchain's Issues

Error trying ingest.py

When I try to run "python3 ingest.py" I get this error:

Traceback (most recent call last):
  File "/home/ubuntu/private-chatbot-mpt30b-langchain/ingest.py", line 7, in <module>
    from langchain.docstore.document import Document
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/__init__.py", line 6, in <module>
    from langchain.agents import MRKLChain, ReActChain, SelfAskWithSearchChain
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/agents/__init__.py", line 2, in <module>
    from langchain.agents.agent import (
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/agents/agent.py", line 16, in <module>
    from langchain.agents.tools import InvalidTool
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/agents/tools.py", line 8, in <module>
    from langchain.tools.base import BaseTool, Tool, tool
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/tools/__init__.py", line 3, in <module>
    from langchain.tools.arxiv.tool import ArxivQueryRun
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/tools/arxiv/tool.py", line 12, in <module>
    from langchain.utilities.arxiv import ArxivAPIWrapper
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/utilities/__init__.py", line 3, in <module>
    from langchain.utilities.apify import ApifyWrapper
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/utilities/apify.py", line 5, in <module>
    from langchain.document_loaders import ApifyDatasetLoader
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/document_loaders/__init__.py", line 44, in <module>
    from langchain.document_loaders.embaas import EmbaasBlobLoader, EmbaasLoader
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/document_loaders/embaas.py", line 54, in <module>
    class BaseEmbaasLoader(BaseModel):
  File "pydantic/main.py", line 204, in pydantic.main.ModelMetaclass.__new__
  File "pydantic/fields.py", line 488, in pydantic.fields.ModelField.infer
  File "pydantic/fields.py", line 419, in pydantic.fields.ModelField.__init__
  File "pydantic/fields.py", line 539, in pydantic.fields.ModelField.prepare
  File "pydantic/fields.py", line 801, in pydantic.fields.ModelField.populate_validators
  File "pydantic/validators.py", line 696, in find_validators
  File "pydantic/validators.py", line 585, in pydantic.validators.make_typeddict_validator
  File "pydantic/annotated_types.py", line 35, in pydantic.annotated_types.create_model_from_typeddict
  File "pydantic/main.py", line 972, in pydantic.main.create_model
  File "pydantic/main.py", line 204, in pydantic.main.ModelMetaclass.__new__
  File "pydantic/fields.py", line 488, in pydantic.fields.ModelField.infer
  File "pydantic/fields.py", line 419, in pydantic.fields.ModelField.__init__
  File "pydantic/fields.py", line 534, in pydantic.fields.ModelField.prepare
  File "pydantic/fields.py", line 638, in pydantic.fields.ModelField._type_analysis
  File "/usr/lib/python3.10/typing.py", line 1158, in __subclasscheck__
    return issubclass(cls, self.__origin__)
TypeError: issubclass() arg 1 must be a class

I have everything correctly installed, using python 3.10.6 and I have enough RAM, Storage and CPU.

I'm running it on an AWS machine, on ubuntu, but there shouldn't be any problem, right?

Thanks for the work you do, I hope you can help me.

trouble during setup

hi
Great project, wanted to try it, but having these problems during setup:

private-chatbot-mpt30b-langchain$ python ingest.py
Traceback (most recent call last):
File "/home/im/Downloads/private-chatbot-mpt30b-langchain/ingest.py", line 6, in
from dotenv import load_dotenv
ModuleNotFoundError: No module named 'dotenv'

and:

private-chatbot-mpt30b-langchain$ poetry run python chat.py
Traceback (most recent call last):
File "/home/im/Downloads/private-chatbot-mpt30b-langchain/chat.py", line 5, in
from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler
ModuleNotFoundError: No module named 'langchain'

Am I missing some dependencies or smth else? Seems like I might be missing smth related to LangChain (but already did: pip install langchain)?. rgds, IM

Testing in a macbook pro

Thanks for sharing the model, I have been able to test it on my macbook pro, i9 with 32 GB of ram. I notice that the cpu goes to 400% when inferring the answer, and the gpu goes to 0%. Is it possible to make the model use the gpu? Radeon Pro Vega 20 4GB

poetry install error m1

poetry install


Installing dependencies from lock file

Package operations: 54 installs, 0 updates, 0 removals

  • Installing scipy (1.9.3): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel
  
  + meson setup /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3 /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3/.mesonpy-1p55ixp1/build -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3/.mesonpy-1p55ixp1/build/meson-python-native-file.ini
  The Meson build system
  Version: 1.2.0
  Source dir: /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3
  Build dir: /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3/.mesonpy-1p55ixp1/build
  Build type: native build
  Project name: SciPy
  Project version: 1.9.3
  C compiler for the host machine: cc (clang 12.0.5 "Apple clang version 12.0.5 (clang-1205.0.22.9)")
  C linker for the host machine: cc ld64 650.9
  C++ compiler for the host machine: c++ (clang 12.0.5 "Apple clang version 12.0.5 (clang-1205.0.22.9)")
  C++ linker for the host machine: c++ ld64 650.9
  Host machine cpu family: aarch64
  Host machine cpu: aarch64
  Compiler for C supports arguments -Wno-unused-but-set-variable: NO 
  Compiler for C supports arguments -Wno-unused-but-set-variable: NO (cached)
  Compiler for C supports arguments -Wno-unused-function: YES 
  Compiler for C supports arguments -Wno-conversion: YES 
  Compiler for C supports arguments -Wno-misleading-indentation: YES 
  Compiler for C supports arguments -Wno-incompatible-pointer-types: YES 
  Library m found: YES
  
  ../../meson.build:57:0: ERROR: Unknown compiler(s): [['gfortran'], ['flang'], ['nvfortran'], ['pgfortran'], ['ifort'], ['ifx'], ['g95']]
  The following exception(s) were encountered:
  Running `gfortran --version` gave "[Errno 2] No such file or directory: 'gfortran'"
  Running `gfortran -V` gave "[Errno 2] No such file or directory: 'gfortran'"
  Running `flang --version` gave "[Errno 2] No such file or directory: 'flang'"
  Running `flang -V` gave "[Errno 2] No such file or directory: 'flang'"
  Running `nvfortran --version` gave "[Errno 2] No such file or directory: 'nvfortran'"
  Running `nvfortran -V` gave "[Errno 2] No such file or directory: 'nvfortran'"
  Running `pgfortran --version` gave "[Errno 2] No such file or directory: 'pgfortran'"
  Running `pgfortran -V` gave "[Errno 2] No such file or directory: 'pgfortran'"
  Running `ifort --version` gave "[Errno 2] No such file or directory: 'ifort'"
  Running `ifort -V` gave "[Errno 2] No such file or directory: 'ifort'"
  Running `ifx --version` gave "[Errno 2] No such file or directory: 'ifx'"
  Running `ifx -V` gave "[Errno 2] No such file or directory: 'ifx'"
  Running `g95 --version` gave "[Errno 2] No such file or directory: 'g95'"
  Running `g95 -V` gave "[Errno 2] No such file or directory: 'g95'"
  
  A full log can be found at /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3/.mesonpy-1p55ixp1/build/meson-logs/meson-log.txt
  

  at /opt/homebrew/Cellar/poetry/1.5.1_1/libexec/lib/python3.11/site-packages/poetry/installation/chef.py:147 in _prepare
      143│ 
      144│                 error = ChefBuildError("\n\n".join(message_parts))
      145│ 
      146│             if error is not None:
    → 147│                 raise error from None
      148│ 
      149│             return path
      150│ 
      151│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:

Note: This error originates from the build backend, and is likely not a problem with poetry but with scipy (1.9.3) not supporting PEP 517 builds. You can verify this by running 'pip wheel --use-pep517 "scipy (==1.9.3)"'.

Thanks and questions...

@mayooear thanks for this nice project. Very helpful. Have a couple of items:

  1. The current setup is missing a required package: sentence_transformers
  2. Any thoughts on how to run this in GPU?

NVIDIA CUDA Toolkit libraries error

I am following all the instructions but I am getting the following error when I run python ingest.py.

Traceback (most recent call last):
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/torch/init.py", line 168, in _load_global_deps
ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/ctypes/init.py", line 376, in init
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: libcufft.so.10: cannot open shared object file: No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/skhani/Documents/Recent/LLM/private-chatbot-mpt30b-langchain-main/ingest.py", line 162, in
main()
File "/home/skhani/Documents/Recent/LLM/private-chatbot-mpt30b-langchain-main/ingest.py", line 126, in main
embeddings = HuggingFaceEmbeddings(model_name=embeddings_model_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/langchain/embeddings/huggingface.py", line 51, in init
import sentence_transformers
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/sentence_transformers/init.py", line 3, in
from .datasets import SentencesDataset, ParallelSentencesDataset
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/sentence_transformers/datasets/init.py", line 1, in
from .DenoisingAutoEncoderDataset import DenoisingAutoEncoderDataset
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/sentence_transformers/datasets/DenoisingAutoEncoderDataset.py", line 1, in
from torch.utils.data import Dataset
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/torch/init.py", line 228, in
_load_global_deps()
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/torch/init.py", line 189, in _load_global_deps
_preload_cuda_deps(lib_folder, lib_name)
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/torch/init.py", line 154, in _preload_cuda_deps
raise ValueError(f"{lib_name} not found in the system path {sys.path}")
ValueError: libcublas.so.*[0-9] not found in the system path ['/home/skhani/Documents/Recent/LLM/private-chatbot-mpt30b-langchain-main', '/home/skhani/anaconda3/envs/llm/lib/python311.zip', '/home/skhani/anaconda3/envs/llm/lib/python3.11', '/home/skhani/anaconda3/envs/llm/lib/python3.11/lib-dynload', '/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages']
(llm) skhani@skhani-Precision-7760 ~/Documents/Recent/LLM/private-chatbot-mpt30b-langchain-main$ poetry install
Installing dependencies from lock file

No dependencies to install or update
(llm) skhani@skhani-Precision-7760 ~/Documents/Recent/LLM/priv
ate-chatbot-mpt30b-langchain-main$ on311.zip', '/home/skhani/anaconda3/envs/llm/lib/python3.11', '/home/skhani/anaconda3/envs/llm/lib/python3.11/lib-dynload', '/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages']khani/anaconda3/envs/llm/lib/python3.11/site-packages']

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.