A web application uses FastAPI with Databricks' dolly-v2-3b model sourced from Hugging Face and exposes a single endpoint that you can interact with it.
- Install docker in local machine if not already installed. For debian version, follow instruction in this link
- Build container (using root if needed): sudo docker build -t hugginface:local .
- Run the app inside the container: docker run -i -p 8000:8000 huggingface:local