Backend service for LLM AMY
POST /query
{
"query": "mero ko ek 5g phone chaiye jisme AMOLED display ho",
"device": "Android/iOS",
"language": "English"
}{
"status": true,
"response": "PRODUCT_IDs: 1289"
}- Build the docker image with the following command
sudo docker build -t amazon_hackon_amy_backend . - Run the docker image
sudo docker run -dit --rm -p 4321:4321 amazon_hackon_amy_backend
- The service will be live on
localhost:4321
- Setup the virtual environment
python -m venv .venv
- Activate the virtual environment
source /.venv/bin/activate - Install all the dependencies
pip install -r requirements.txt
- Start the application
uvicorn main:app --host 0.0.0.0 --port 4321
- The application will be live on
localhost:4321 - If you encounter any error, try using Python 3.10.0
- The response of the model is strictly based on the training dataset (only 2000 products)
- The LLM model can cause hallucinations sometimes