gupy-io / tap-sensedata

tap-sensedata

tap-sensedata is a Singer tap for sensedata.

Built with the Meltano Tap SDK for Singer Taps.

Configuration

Accepted Config Options

A full list of supported settings and capabilities for this tap is available by running:

tap-sensedata --about

Configure using environment variables

This Singer tap will automatically import any environment variables within the working directory's .env if the --config=ENV is provided, such that config values will be considered if a matching environment variable is set either in the terminal context or in the .env file.

Source Authentication and Authorization

Usage

You can easily run tap-sensedata by itself or in a pipeline using Meltano.

Executing the Tap Directly

tap-sensedata --version
tap-sensedata --help
tap-sensedata --config CONFIG --discover > ./catalog.json

Developer Resources

Follow these instructions to contribute to this project.

Initialize your Development Environment

pipx install poetry
poetry install

Create and Run Tests

Create tests within the tap_sensedata/tests subfolder and then run:

poetry run pytest

You can also test the tap-sensedata CLI interface directly using poetry run:

poetry run tap-sensedata --help

Testing with Meltano

Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.

Next, install Meltano (if you haven't already) and any needed plugins:

# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-sensedata
meltano install

Now you can test and orchestrate using Meltano:

# Test invocation:
meltano invoke tap-sensedata --version
# OR run a test `elt` pipeline:
meltano elt tap-sensedata target-jsonl

SDK Dev Guide

See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.

tap-sensedata's Issues

TypeError when running `--help`

Hey! I'm getting this error when I ran meltano invoke tap-sensedata --help is there a way to not access config values for --help/--about?

Traceback (most recent call last):
  File "/Users/pnadolny/Documents/Git/GitHub/pnadolny/hub-utils/hub_utils/test_meltano_project/.meltano/extractors/tap-sensedata/venv/bin/tap-sensedata", line 5, in <module>
    from tap_sensedata.tap import Tapsensedata
  File "/Users/pnadolny/Documents/Git/GitHub/pnadolny/hub-utils/hub_utils/test_meltano_project/.meltano/extractors/tap-sensedata/venv/lib/python3.9/site-packages/tap_sensedata/tap.py", line 5, in <module>
    from tap_sensedata.streams import (
  File "/Users/pnadolny/Documents/Git/GitHub/pnadolny/hub-utils/hub_utils/test_meltano_project/.meltano/extractors/tap-sensedata/venv/lib/python3.9/site-packages/tap_sensedata/streams.py", line 18, in <module>
    class CustomDataStream(sensedataStream):
  File "/Users/pnadolny/Documents/Git/GitHub/pnadolny/hub-utils/hub_utils/test_meltano_project/.meltano/extractors/tap-sensedata/venv/lib/python3.9/site-packages/tap_sensedata/streams.py", line 22, in CustomDataStream
    ref_date_start = date.today() - timedelta(days=int(os.getenv("TAP_SENSEDATA_CUSTOM_DATA_REF_DATE_START")))
TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType'