This repo contains the code needed to run Falcon 7B using Truss and containerize it using Docker. It also contains a yaml file for deploying this model using a GPU-enabled kubernetes cluster.
matthewaltenburg / falcon-7b-truss Goto Github PK
View Code? Open in Web Editor NEWThis project forked from htrivedi99/falcon-7b-truss