propsai / proxy

Props AI provides this open source proxy for Open AI that allows you to track token usage and send it into a kafka stream

Props AI Proxy

Built and used by Props AI

Description

Props AI Proxy is an open-source, lightweight, and high-performance proxy server written in Go to enable cost monitoring and usage tracking for Open AI apps. This will be in constant development and has been open sourced to provide transparency into what parts of the request we see and use as part of our cloud offering at https://getprops.ai

Getting Started

Prerequisites

• Go 1.16 or higher

Installing

Clone the repository to your local machine:

git clone https://github.com/PropsAI/proxy

Navigate to the project directory:

cd proxy

Build the project:

go build

Running the Proxy

To start the proxy server, simply run:

go run .

Contributing

Contributions are what make the open-source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

License

Distributed under the Apache 2.0 License. See LICENSE for more information.

Contact

Peter Kirkham - @k11kirky

Props AI - Website