This is a simple App for testing LLM to SQL commands on a sqlite database using Langchain SQL Agent. The repo comes with a setup script that loads a sqlite database with some sample data.
This repo is intended to be a starter for Langchain and also a starter for programming with co-pilot GPT-4. The scope is small enough that you can even get by with copying/pasting whole clases to GPT-4 and asking for explanations or improvemnts to the code. There's a single important TODO item that is not and will not be ever completed, which is to implement the file upload functionality in the UI. The backend is already setup to handle file uploads (csv). If you're interested you could probably also:
- clean the ouput of the agent after each execution
- add a auto-refresh or a refresh button to the tables
Backend has several endpoints:
/api/v1/tables
- returns a list of tables in the database/api/v1/tables/<table_name>
- returns a list of columns in the table/api/v1/run-command
- takes a json payload with the command to execute and returns the results via a websocket/api/v1/upload
- takes a csv file and loads it into the database
run-command
is where all the fun is happening with the langchain sql agent.
Backend was setup with Python 3.10.10
Frontend was setup with Node 18.15.0
Experience may vary with other versions
You have to have an open-api-api-key to use the langchain sql agent.
Copy the .env.example
file to .env
and add your key to the OPENAI_API_KEY
variable. You can also change the model which is used to make predictions. In the time of writing, gpt-4
is in closed beta, so the backend might not work if you select that model.
Create virtual environment (only need to do this once)
python3 -m venv data-whisperer-backend/myenv
activate virtual environment
source data-whisperer-backend/myenv/bin/activate
# install dependencies
pip install -r data-whisperer-backend/requirements.txt
seed the database
python data-whisperer-backend/setup/create_and_seed_db.py
finally, run the backend
python data-whisperer-backend/run.py
cd data-whisperer-frontend/
npm install # only need to do this once
npm start
# deactivate virtual environment after you are done
deactivate