greptimeteam / demo-scene

👾Scripts and samples to support Greptime Demos and Talks. ⚠️Might be rough around the edges ;-)

Demo Scene

Scripts and samples to support Greptime Demos and Talks. Might be rough around the edges ;-)

Content

Applications

• Keyboard Monitor (✍️ blog)

Data pipelines (Ingestion + Greptime + Analysis or Display)

• InfluxDB Line Protocol + GreptimeCloud + SQL/PromQL (🎥 tutorial)

Data Migrations

• From InfluxDB v2 to GreptimeDB (✍️ blog)
• From InfluxDB v1 to GreptimeDB

Feedback & Questions

• Bugs or issues with demo: raise an issue on this GitHub project
• General question and assistance: GitHub Discussions / Slack

demo-scene's Issues

Error- write request banned

I keep running into the following error:

ERROR <module> Unhandled exception for futures: (MySQLdb.OperationalError) (1815, 'Write request banned for [Database] until [time UTC]

I'm using a Windows 10 22H2 and use Windows Powershell to run
python agent.py
as the command.

Adding minimal demos for various client api to write data into Greptime database

We now have various protocol supported in HTTP api, Here are some entry paths for read and/or write:

/v1/sql 
/v1/promql 

/v1/influxdb/write 
/v1/influxdb/api/v2/write 

/v1/prometheus/read 
/v1/prometheus/write 

/v1/prometheus/api/v1/query 
/v1/prometheus/api/v1/query_range 
/v1/prometheus/api/v1/labels 
/v1/prometheus/api/v1/series 
/v1/prometheus/api/v1/label/:label_name/values 

/v1/oltp/v1/metrics 
/v1/oltp/v1/traces

For simple protocols like influxdb, a curl command would be enough to actually for users to follow up and write data into out database; However for protocols like OTLP, a step by step example of modifying docker config using Greptime endpoint, running OTLP official docker image and be able to write data into the database would be much more straight forward than just showing how to config Greptime endpoint.

For example, save the following code as config.yaml

# config.yaml
receivers:
  hostmetrics:
    scrapers:
      cpu:
      disk:
      filesystem:
      load:
      memory:
      network:
      process:
      processes:
      paging:

exporters:
  otlphttp:
    endpoint: http://localhost:4000/v1/otlp
    compression: none
    tls:
      insecure: true

extensions:
  health_check:
  pprof:
  zpages:

service:
  extensions: [health_check, pprof, zpages]
  pipelines:
    metrics:
      receivers: [hostmetrics]
      exporters: [otlphttp]

And run docker run --rm --network host -v ./config.yaml:/etc/otelcol/config.yaml otel/opentelemetry-collector will start an exporter and write metrics data using Greptime's HTTP OTLP metrics api.

Missing dotenv in keyboard-monitor requirements.txt

Traceback (most recent call last):
  File "/Users/dennis/programming/python/demo-scene/keyboard-monitor/agent.py", line 1, in <module>
    from dotenv import load_dotenv
ModuleNotFoundError: No module named 'dotenv'

Implement itertools.batched with a function to drop requirement of Python 3.12+ in InfluxDB demo

demo-scene/influxdb-lineprotocol/ingest.py

Lines 27 to 31 in 2f46a3d

	# TODO implement itertools.batched with a functionn to drop requirement of Python 3.12+
	for batch_lines in itertools.batched(lines, 1000):
	write_api.write(bucket=bucket, write_precision=args.precision, record=batch_lines)
	print(f'Wrote {len(batch_lines)} lines')
	sleep(1) # sleep for 1 second avoid rate limit

Ref Python Doc - https://docs.python.org/3/library/itertools.html#itertools.batched

Make an InfluxDB Line Protocol compatible demo

Ingestion with InfluxDB Line Protocol, Analysis with SQL and PromQL.

[Bug] Monitor keyboard key combination exceptions on Windows systems

On Windows systems, monitor keyboard key combination exceptions. When using a key combination, ctrl + any letter key, the letter key is not displayed properly. It is normal to use keys like alt, or shift in combination with letters.