meryemchafry / psychic

Data integration platform for LLMs. Connect to SaaS tools with turnkey auth and sync documents from N data sources with only one integration

Data integration platform for LLMs

Psychic is an open source integration platform to extract and transform unstructured data from SaaS applications like Notion, Slack, Zendesk, Confluence, and Google Drive. Instead of building one integration for each data sources, you can build one integration that works for all data sources. Psychic is designed for startups that use LLMs and need to retrieve documents to use as context.

There are 3 parts of the platform

• 🪄 Psychic Link: A modal that lets end users to connect their data sources with a point and click interface, using OAuth. Available as an NPM package for React projects, or as a magic link.
• 🪢 Universal API: Abstractions to make it easy to ingest Document and Conversation data from any connected source through a single API endpoint. Filter based on connector_id and account_id. New integrations can be added by implementing a new DataConnector in the server-side code.
• 🎩 Psychic Dashboard: A front-end for the Psychic platform that makes it easy to manage connections and connect data sources without having to add Link to an existing app.

Read the docs

Demo

Using Psychic to connect data from a Notion workspace with a LangChain question and answer app.

Psychic.Twitter.Demo.May.21.2023.1225.PM.mp4

Get an API key to test out the cloud version by creating an account on the Psychic dashboard.

If you have any questions on how to get started, come join our Slack community!.

Roadmap

• ✅ LangChain DataLoader
• ✅ Webhook support to push data to an endpoint at predetermined intervals
• 🚧 CRM integrations (Salesforce, HubSpot, etc)
• 🚧 Support for write scopes for each connector, in addition to read scopes

Getting Started - 15 min

Check out the quickstart tutorial to get started.

Contributing

See CONTRIBUTING.md