qiime2 / busywork

busywork

Concourse system for automating QIIME 2 development tasks, including continuous integration and continuous deployment (CI/CD).

busywork's Issues

biocore channel is now deprecated

biocore/conda-recipes#121

Build dev-docs

Proposed Behavior
We might need to split up the integration step so that we can build dev docs and user docs in parallel (or some variation of that idea).

Wire up q2-shogun to GH templates Pipeline

Improvement Description
Wire up q2-shogun to GH templates Pipeline

Update copyright year

Improvement Description
https://github.com/qiime2/busywork/tree/master/extra/github handles updating and maintaining things like issue labels and GH-specific repo templates. It would be great to extend this functionality to also allow for ad-hoc running of the q2lint functionality proposed in qiime2/q2lint#23, which would basically let us run a push-button task to update the copyright year across all QIIME 2 repos.

References

1. Related to qiime2/q2lint#23

Provision and deploy darwin worker: 17" MB

Anaconda Labels not synced?

Is the main label not being updated correctly? e.g. https://anaconda.org/qiime2/qiime2/labels

Provision and deploy darwin worker: 15" MB

@gregcaporaso's old dev machine

Update linux host OS and docker version

Bug Description
The current version of docker available on the Ubuntu 14.04 LTS channel seems to leak inodes, which is the cause of the out of space errors.

Just running most of the test group on a distribution pipeline causes 70% inode utilization. Even small inode leaks will eventually crash this.

Steps to reproduce the behavior

1. Run busywork for several months uninterrupted.

Computation Environment

• Ubuntu 14.04

Comments

1. We might consider changing the RAID configuration to just pooled (0). This will give us an obscene number of inodes. Recovering the filesystem in the case of disk failure is more or less pointless given this hardware has become more or less exclusively a build system. We can just reprovision it on hardware failure.

Wire up q2-fragment-insertion

create provisioning playbooks

Move private ci-playbooks repo to this repo, split out secrets

Wire up q2cwl

Improvement Description
q2cwl should be built by busywork.

Wire up q2-fragment-insertion to GH templates Pipeline

Improvement Description
Wire up q2-fragment-insertion to GH templates Pipeline

Ordered Maps not supported for `params`

New concourse versions will not support:

params:
  - example: 1
  - other: 2

They should be:

params:
   example: 1
   other: 2

Most of our pipelines look like that, so we'll need to update. There isn't anything meaningfully different, it is just no longer supported.