meltano / cloud-docs

Documentation for Meltano Cloud.

The declarative code-first data integration engine

Say goodbye to writing, maintaining, and scaling your own API integrations.
Unlock 600+ APIs and DBs and realize your wildest data and ML-powered product ideas.

---

Integrations

Meltano Hub is the single source of truth to find any Meltano plugins as well as Singer taps and targets. Users are also able to add more plugins to the Hub and have them immediately discoverable and usable within Meltano. The Hub is lovingly curated by Meltano and the wider Meltano community.

Installation

If you're ready to build your ideal data platform and start running data workflows across multiple tools, start by following the Installation guide to have Meltano up and running in your device.

Documentation

Check out the "Getting Started" guide or find the full documentation at https://docs.meltano.com.

Contributing

Meltano is a truly open-source project, built for and by its community. We happily welcome and encourage your contributions. Start by browsing through our issue tracker to add your ideas to the roadmap. If you're still unsure on what to contribute at the moment, you can always check out the list of open issues labeled as "Accepting Merge Requests".

For more information on how to contribute to Meltano, refer to our contribution guidelines.

Community

We host weekly online events where you can engage with us directly. Check out more information in our Community page.

If you have any questions, want sneak peeks of features or would just like to say hello and network, join our community of over +2,500 data professionals!

👋 Join us on Slack!

Responsible Disclosure Policy

Please refer to the responsible disclosure policy on our website.

License

This code is distributed under the MIT license, see the LICENSE file.

cloud-docs's Issues

Update Docs on Feature Roadmap Plans

And some very basic infra info.
Where is meltano cloud hosted? What region?

Documentation for On-Demand Job Run API Feature

Add documentation for Alpha phase on-demand job run API usage once deployed and ready for use.

Document `meltano cloud` CLI here in `cloud-docs`

As suggested by @cjohnhanson, we should have a place to document Cloud CLI patterns.

We can add docs to the meltano/meltano repo, but those will not automatically be published to docs.meltano.com until the changes merge to main. This cloud-docs repo is a good place to put Cloud CLI docs and usage examples.

Optionally, we can also link over to additional markdown docs in the meltano/meltano repo itself, pinning our URL refs to the cloud branch in that case.

Document Cloud limitations

Task is to make sure all of these are documented.

As of now not confirmed for GA:

• Not supporting Airflow, Superset (due to state management and required ingress from public internet).
• Not supporting tap-google-analytics key_file_location (no 'secrets file' support in scope. recommendation: use other config inputs for auth).
• No "too old" Meltano versions.
• No custom Dockerfiles.

Confirmed for GA, but not in Alpha or Early Beta:

• No container_spec support.
• No private pip_url access. (Although may be possible to solve automatically by using an encrypted .env file.)

docs: Add more details for encrypting secrets

I was attempting to add new encrypted secrets to the squared project and it would be helpful to have more detailed docs on how to do this, especially because I'm extra sensitive to making sure this is right to avoid exposing secrets or breaking pipelines accidentally. I saw these docs. Things that could be helpful:

• should I install the kms-ext in my meltano project (like in Squared) or just run via command line
• full how-to guide with commands and what the expected output should be. All keys were updated in my diff is that expected or not?
• can I decrypt my updated encrypted secrets to check everything worked before commiting? Or how can I know it worked?
• limitations of kms tool - i.e. my tap-google-analytics env var isnt supported

cc @magreenbaum