thekevjames / tools

collection of tools too small to deserve their own repo

Various Tools

This repository is a collection of tools too small to be worth managing as their own repo. Many of these originally started as an experiment or, before I started trying to organize my GitHub presence, as a couple-line repo I'd completely forgotten about.

• 32-bit Ubuntu Docker Images
• CCTUI
• CSS UserStyles
• DDTUI
• Dockerized caddy + caddy-security
• Dockerized Fava
• Dockerized gcloud Pubsub Emulator
• Dockerized MySQLTuner
• Dockerized Nox
• Dockerized Tuning-Primer
• Slack Notifier

Renovate

This repository also contains my Renovate configurations, which are shared across all my projects. You can grab the common "make it work for anything Kevin has done anywhere" config with:

{
    "extends": ["github>thekevjames/tools"]
}

tools's Issues

Multi-arch docker builds for gcloud-pubsub-emulator

Tracking ticket for getting multi-arch builds working.

Blocked on:

• https://hub.docker.com/r/google/cloud-sdk/tags needs to support multi-arch builds

After which:

• Determine how to make CircleCI use buildx
• Update CI to use buildx to much all supported archs

Action Required: Fix Renovate Configuration

There is an error with this repository's Renovate configuration that needs to be fixed. As a precaution, Renovate will stop PRs until it is resolved.

Error type: Cannot find preset's package (github>thekevjames/tools>trustedpackages). Note: this is a nested preset so please contact the preset author if you are unable to fix it yourself.

autobuild nox image on new release

Figure out a way to either:

• at best: build and tag a new version of thekevjames/nox whenever there's a new nox release, or
• at least: send an alert / set a failure tag / etc on each nox release

Update the minify container

The release 2.9.3 is broken (tdewolff/minify#326) - I would love if you could add an other version tag to Docker Hub (and update it of course).

Thank you very much!

minify: Numeric separators not supported

There appears to be a problem with the Numeric separators support.

Having the file:

// a.js
const x = 10_000;

and running

docker run --rm -it \                                                                                                                                                                                                       
    -v $(pwd):/app \
    thekevjames/minify:2.9.4 \
    minify --output /app/build/ /app/a.js

Results in

ERROR: cannot minify /app/a.js: unexpected identifier after number on line 1 and column 17
    1: const x = 10_000;
                       ^

linter orb: Run pip install as root?

The linter/pre-commit command fails on the official circleci/python image (as opposed to the base python image) due to tighter permissions:

Installing collected packages: pyyaml, cfgv, zipp, importlib-metadata, toml, nodeenv, identify, aspy.yaml, pre-commit
ERROR: Could not install packages due to an EnvironmentError: [Errno 13] Permission denied: '/usr/local/lib/python3.7/site-packages/_yaml.cpython-37m-x86_64-linux-gnu.so'
Consider using the `--user` option or check the permissions.

Exited with code 1

Consider running the pip install step with sudo.

mysql-tuner / perl error message: diagnostics

Hi, thanks for providing the mysql-tuner docker file.

At the moment I am unable to run it, because its seems that some perl dependency is missing:

couldn't find diagnostic data in /usr/share/perl5/core_perl/pods/perldiag.pod /usr/local/lib/perl5/site_perl /usr/local/share/perl5/site_perl /usr/lib/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib/perl5/core_perl /usr/share/perl5/core_perl /mysqltuner.pl at /usr/share/perl5/core_perl/diagnostics.pm line 259, <POD_DIAG> line 711.
Compilation failed in require at /mysqltuner.pl line 45.
BEGIN failed--compilation aborted at /mysqltuner.pl line 45.

All I could find was, that the perl installation would be incomplete. But reinstalling perl did not seem to help.

Maybe it is a problem with the latest alpine version?

Support pubsub push subscriptions through subscription config var

Sorry if this is already supported and I missed it in the documentation, but I don't see any support for push subscriptions with the config vars to set the subscription type to push and provide an endpoint for it to push to. It would be very convenient if this were an option.

Update docker-nox base image's ubuntu

docker-nox installs all supported Python versions to provide a matrix environment.

The base ubuntu image no longer supports this.

Find a way to build/use a base image which is up-to-date and can install the full matrix of versions.

Pub/Sub topic and subscription creation timeout

The issue I am seeing is that pubsubc fails to create topics + subscriptions when the container starts up, and when this happens I can just see Operation timed out in the logs. When this happens it doesn't retry or anything. I'm guessing this happens when the server takes too long to start. Here the pubsub client is run in the background before the actual server starts so I guess there is a race.

If I run pubsubc manually after the topics are created fine.

I'm running the image in minikube using onechart.

Subscription is not being created automatically

Hi,

We are currently having an issue with the subscription not being created automatically once we started the docker container. In our docker-compose file, we have a setting for the environment for setting the topics and subscriptions like below
environment: - PUBSUB_PROJECT1=test-project,test_topic:test_sub,prod_topic:prod_sub
Once the container of the emulator is running, I found an issue from our app that the Subscription is unavailable
But, since I kill and start the container, the subscriptions will be available.
Any idea why they are not being created automatically?

Thanks,
Calvin

Unable to execute the java that was found on your PATH

Overview

I tried upgrading from version 9ade2475e2 to 452.0.1 but now the app fails to start and shows the following logs:

Waiting for emulator...
Operation timed out
ERROR: (gcloud.beta.emulators.pubsub.start) Unable to execute the java that was found on your PATH. The Google Cloud Pub/Sub emulator requires a Java 7+ JRE installed and on your system PATH

I've tried version 451.0.0 as well and I'm getting the same error so I'm not sure when this was introduced.

Hmm I've actually just tried version 420.0.0 as well and got the same error 🤔

My setup is I'm running the emulator in minikube. I'm on an M1 MacBook Pro, I'm wondering if its because I'm on an M1.