odahu / odahu-trainer Goto Github PK

License: Apache License 2.0

Makefile 5.79% Dockerfile 6.17% Python 71.65% Shell 4.68% Mustache 11.70%

odahu-trainer's Introduction

1. About

This repository contains MLFlow integration toolchain for Odahu platform.

2. What does it do?

Legion's toolchain for MLFlow is responsible for running process of training MLFlow models. It produces model as ZIP archive in Legion's General Python Prediction Interface.

3. Requirements

This toolchain requires MLFlow tracking server to be installed (MLFlow tracking server is bundled in HELM Chart).

odahu-trainer's People

Contributors

Stargazers

Watchers

odahu-trainer's Issues

Support MLFlow artifact storage in Azure

Parametrize copying `data` folder to result artifact for `mlflow-project` trainings

Parametrize copying data folder to result artifact for mlflow-project trainings

e.g: let user specify folder with static artifacts to put in result archive

[Waiting for AWS/Azure workable]Update MLFlow version to the latest stable version

PyPi publishing package

Add a step in Jenkinsfile that publish the mlflow package to PyPI according to current release cycle.

Volume for mlflow metric server

In order to persist model metrics and artifacts, we have to add a volume for the tracking server.

The volume must be optional, but it should be enabled in our deployments.

Make possible to run gppi convertation as a separate step.

Is your feature request related to a problem? Please describe.
GPPI packaging is part or ODAHU toolchain, it makes impossible to deploy models in other formats without training

Describe the solution you'd like
The idea is to make packaging a separate step to allow call it as from toolchain to provide current behaviour as from odahu-flow-ctl to convert existing models to ODAHU compatible format.

Describe alternatives you've considered
Alternative is to run any model you want to deploy via full ODAHU toolchain which can be very expensive in terms of time and machine power.

Additional context
Add any other context or screenshots about the feature request here.

Integrate SageMaker to ODAHU

Write MLFlow SageMaker compatible container
Or contribute to MLFlow to allow run training in sagemaker
Odahu trainer 'mlflow-sagemaker' integration
Modify API to allow pass sagemaker specific arguments to trainer (instance type etc)

MLFlow Project toolchain with custom trained artifact format

For cases when GPPI is not applicable (such as packaging model in Triton server) we have to create a separate toolchain that trains model via MLFlow Project, but instead of wrapping it with GPPI it allows user to manually provide all files to pack in 2 ways:

a directory with fixed name in VCS root, e.g. /data/. ~~Optionally, we can add a Toolchain argument that overrides this path.~~ (not for now, about custom path)
In training script (that is triggered by MLFlow entrypoint) manually save needed files (model itself, or whatever else) to a directory with fixed name /output.

Example pipeline:

Project structure in VCS

MLproject
train_conda.yaml
train.py
data/ (directory with any additional files to inject into training artifact)
- model.py
- conda.yaml
- config.pbtxt

MLproject trainer:

executes main entrypoint of MLproject. All files that need to be packed into training artifact must be saved in /output/. For Triton scenario model file name must match Triton's expectations.
creates simple manifest in /output (e.g. odahuflow.model.yaml) that stores model name and version
copies all files from data directory to /output directory
move all the content of /output into directory provided as --target parameter to Tekton step

The rest will be handled by common logic for any toolchain.

Important note:

currently as a part of any training pipeline there's a GPPI-validation step. From now on, GPPI will not be the only format produced by training. So this step should also be dynamic depending on toolchain.

Can't build containers from `develop` branch

How to reproduce:

git clone [email protected]:odahu/odahu-packager.git
cd odahu-packager
git checkout develop
docker build -f containers/docker-packager/Dockerfile .

Full build log below:

Sending build context to Docker daemon  168.4kB
Step 1/10 : FROM fedora:31
 ---> 4d1ff2457258
Step 2/10 : ARG PIP_EXTRA_INDEX_URL
 ---> Using cache
 ---> ed97cd2e096b
Step 3/10 : ENV WORK_DIR="/opt/odahu-flow"
 ---> Using cache
 ---> 00141fcb4a16
Step 4/10 : WORKDIR "${WORK_DIR}/"
 ---> Using cache
 ---> c49a551c77a8
Step 5/10 : RUN dnf -y update && dnf -y reinstall shadow-utils &&     dnf -y install buildah runc python3-pip --exclude container-selinux &&     rm -rf /var/cache /var/log/dnf* /var/log/yum.*
 ---> Running in e42d2dc3ec79
Fedora Modular 31 - x86_64                      1.4 MB/s | 5.2 MB     00:03    
Fedora Modular 31 - x86_64 - Updates            1.4 MB/s | 4.4 MB     00:03    
Fedora 31 - x86_64 - Updates                    2.5 MB/s |  27 MB     00:10    
Fedora 31 - x86_64                              2.7 MB/s |  71 MB     00:26    
Last metadata expiration check: 0:00:02 ago on Sun Oct 25 18:07:41 2020.
Dependencies resolved.
================================================================================
 Package                       Arch      Version               Repository  Size
================================================================================
Upgrading:
 bash                          x86_64    5.0.17-1.fc31         updates    1.6 M
 brotli                        x86_64    1.0.9-3.fc31          updates    329 k
 ca-certificates               noarch    2020.2.41-1.1.fc31    updates    352 k
 curl                          x86_64    7.66.0-3.fc31         updates    292 k
 dnf                           noarch    4.2.23-1.fc31         updates    419 k
 dnf-data                      noarch    4.2.23-1.fc31         updates     50 k
 fedora-gpg-keys               noarch    31-5                  updates    104 k
 fedora-repos                  noarch    31-5                  updates    9.8 k
 glib2                         x86_64    2.62.6-2.fc31         updates    2.6 M
 glibc                         x86_64    2.30-13.fc31          updates    3.5 M
 glibc-common                  x86_64    2.30-13.fc31          updates    702 k
 glibc-minimal-langpack        x86_64    2.30-13.fc31          updates     44 k
 gnutls                        x86_64    3.6.15-1.fc31         updates    1.0 M
 json-c                        x86_64    0.13.1-13.fc31        updates     37 k
 libarchive                    x86_64    3.4.3-1.fc31          updates    384 k
 libcap-ng                     x86_64    0.7.11-1.fc31         updates     28 k
 libcurl                       x86_64    7.66.0-3.fc31         updates    265 k
 libdnf                        x86_64    0.48.0-1.fc31         updates    645 k
 libmetalink                   x86_64    0.1.3-13.fc31         updates     31 k
 libnghttp2                    x86_64    1.41.0-1.fc31         updates     77 k
 librepo                       x86_64    1.12.1-1.fc31         updates     97 k
 libreport-filesystem          noarch    2.13.1-3.fc31         updates     14 k
 libselinux                    x86_64    2.9-6.fc31            updates     84 k
 libsolv                       x86_64    0.7.14-1.fc31         updates    396 k
 libssh                        x86_64    0.9.4-3.fc31          updates    214 k
 libssh-config                 noarch    0.9.4-3.fc31          updates     11 k
 libtirpc                      x86_64    1.2.6-1.rc4.fc31      updates     96 k
 libxcrypt                     x86_64    4.4.17-1.fc31         updates    124 k
 libxml2                       x86_64    2.9.10-4.fc31         updates    692 k
 lua-libs                      x86_64    5.3.5-8.fc31          updates    115 k
 p11-kit                       x86_64    0.23.21-2.fc31        updates    342 k
 p11-kit-trust                 x86_64    0.23.21-2.fc31        updates    139 k
 pam                           x86_64    1.3.1-25.fc31         updates    661 k
 pcre2                         x86_64    10.35-7.fc31          updates    228 k
 pcre2-syntax                  noarch    10.35-7.fc31          updates    141 k
 python3                       x86_64    3.7.9-1.fc31          updates     28 k
 python3-dnf                   noarch    4.2.23-1.fc31         updates    407 k
 python3-hawkey                x86_64    0.48.0-1.fc31         updates    114 k
 python3-libdnf                x86_64    0.48.0-1.fc31         updates    774 k
 python3-libs                  x86_64    3.7.9-1.fc31          updates    7.3 M
 sudo                          x86_64    1.9.2-1.fc31          updates    1.0 M
 systemd-libs                  x86_64    243.9-1.fc31          updates    522 k
 tar                           x86_64    2:1.32-3.fc31         updates    887 k
 vim-minimal                   x86_64    2:8.2.1770-1.fc31     updates    653 k
 xz-libs                       x86_64    5.2.5-1.fc31          updates     89 k
 yum                           noarch    4.2.23-1.fc31         updates     47 k
Installing dependencies:
 acl                           x86_64    2.2.53-4.fc31         fedora      72 k
 cryptsetup-libs               x86_64    2.3.4-1.fc31          updates    474 k
 dbus                          x86_64    1:1.12.20-1.fc31      updates    9.6 k
 dbus-broker                   x86_64    21-6.fc31             fedora     175 k
 dbus-common                   noarch    1:1.12.20-1.fc31      updates     16 k
 dbus-libs                     x86_64    1:1.12.20-1.fc31      updates    160 k
 device-mapper                 x86_64    1.02.171-1.fc31       updates    143 k
 device-mapper-libs            x86_64    1.02.171-1.fc31       updates    177 k
 iptables-libs                 x86_64    1.8.3-7.fc31          updates     56 k
 kmod-libs                     x86_64    26-4.fc31             fedora      64 k
 libargon2                     x86_64    20171227-3.fc31       fedora      30 k
 libbrotli                     x86_64    1.0.9-3.fc31          updates    329 k
 libevent                      x86_64    2.1.8-7.fc31          fedora     258 k
 libpcap                       x86_64    14:1.9.1-2.fc31       updates    168 k
 libseccomp                    x86_64    2.5.0-3.fc31          updates     72 k
 qrencode-libs                 x86_64    4.0.2-4.fc31          fedora      61 k
 systemd                       x86_64    243.9-1.fc31          updates    3.8 M
 systemd-pam                   x86_64    243.9-1.fc31          updates    164 k
 systemd-rpm-macros            noarch    243.9-1.fc31          updates     19 k
 trousers-lib                  x86_64    0.3.13-13.fc31        fedora     171 k
 unbound-libs                  x86_64    1.10.1-1.fc31         updates    525 k
 whois-nls                     noarch    5.5.7-1.fc31          updates     34 k
 xkeyboard-config              noarch    2.28-1.fc31           updates    753 k
Installing weak dependencies:
 cracklib-dicts                x86_64    2.9.6-21.fc31         fedora     3.7 M
 deltarpm                      x86_64    3.6.2-2.fc31          fedora      87 k
 diffutils                     x86_64    3.7-3.fc31            fedora     401 k
 libxcrypt-compat              x86_64    4.4.17-1.fc31         updates     96 k
 libxkbcommon                  x86_64    0.9.1-3.fc31          updates    120 k
 mkpasswd                      x86_64    5.5.7-1.fc31          updates     41 k
 python-unversioned-command    noarch    3.7.9-1.fc31          updates     11 k
 python3-pip                   noarch    19.1.1-8.fc31         updates    1.6 M
 python3-setuptools            noarch    41.6.0-1.fc31         updates    585 k
 python3-unbound               x86_64    1.10.1-1.fc31         updates    100 k
 rpm-plugin-systemd-inhibit    x86_64    4.15.1-2.fc31         updates     21 k
 shared-mime-info              x86_64    1.15-1.fc31           updates    303 k
 trousers                      x86_64    0.3.13-13.fc31        fedora     150 k

Transaction Summary
================================================================================
Install  36 Packages
Upgrade  46 Packages

Total download size: 42 M
Downloading Packages:
(1/82): dbus-1.12.20-1.fc31.x86_64.rpm          115 kB/s | 9.6 kB     00:00    
(2/82): dbus-common-1.12.20-1.fc31.noarch.rpm   100 kB/s |  16 kB     00:00    
(3/82): dbus-libs-1.12.20-1.fc31.x86_64.rpm     1.0 MB/s | 160 kB     00:00    
(4/82): device-mapper-libs-1.02.171-1.fc31.x86_ 1.7 MB/s | 177 kB     00:00    
(5/82): device-mapper-1.02.171-1.fc31.x86_64.rp 601 kB/s | 143 kB     00:00    
(6/82): cryptsetup-libs-2.3.4-1.fc31.x86_64.rpm 1.1 MB/s | 474 kB     00:00    
(7/82): iptables-libs-1.8.3-7.fc31.x86_64.rpm   564 kB/s |  56 kB     00:00    
(8/82): libbrotli-1.0.9-3.fc31.x86_64.rpm       3.7 MB/s | 329 kB     00:00    
(9/82): libpcap-1.9.1-2.fc31.x86_64.rpm         1.4 MB/s | 168 kB     00:00    
(10/82): libxcrypt-compat-4.4.17-1.fc31.x86_64. 1.2 MB/s |  96 kB     00:00    
(11/82): libseccomp-2.5.0-3.fc31.x86_64.rpm     486 kB/s |  72 kB     00:00    
(12/82): python-unversioned-command-3.7.9-1.fc3 581 kB/s |  11 kB     00:00    
(13/82): mkpasswd-5.5.7-1.fc31.x86_64.rpm       356 kB/s |  41 kB     00:00    
(14/82): libxkbcommon-0.9.1-3.fc31.x86_64.rpm   748 kB/s | 120 kB     00:00    
(15/82): python3-unbound-1.10.1-1.fc31.x86_64.r 499 kB/s | 100 kB     00:00    
(16/82): rpm-plugin-systemd-inhibit-4.15.1-2.fc  95 kB/s |  21 kB     00:00    
(17/82): python3-pip-19.1.1-8.fc31.noarch.rpm   2.5 MB/s | 1.6 MB     00:00    
(18/82): shared-mime-info-1.15-1.fc31.x86_64.rp 863 kB/s | 303 kB     00:00    
(19/82): systemd-pam-243.9-1.fc31.x86_64.rpm    1.0 MB/s | 164 kB     00:00    
(20/82): systemd-rpm-macros-243.9-1.fc31.noarch 107 kB/s |  19 kB     00:00    
(21/82): unbound-libs-1.10.1-1.fc31.x86_64.rpm  2.3 MB/s | 525 kB     00:00    
(22/82): whois-nls-5.5.7-1.fc31.noarch.rpm      1.3 MB/s |  34 kB     00:00    
(23/82): python3-setuptools-41.6.0-1.fc31.noarc 329 kB/s | 585 kB     00:01    
(24/82): acl-2.2.53-4.fc31.x86_64.rpm           597 kB/s |  72 kB     00:00    
(25/82): systemd-243.9-1.fc31.x86_64.rpm        2.6 MB/s | 3.8 MB     00:01    
(26/82): xkeyboard-config-2.28-1.fc31.noarch.rp 1.1 MB/s | 753 kB     00:00    
(27/82): deltarpm-3.6.2-2.fc31.x86_64.rpm       905 kB/s |  87 kB     00:00    
(28/82): dbus-broker-21-6.fc31.x86_64.rpm       1.4 MB/s | 175 kB     00:00    
(29/82): kmod-libs-26-4.fc31.x86_64.rpm         1.0 MB/s |  64 kB     00:00    
(30/82): diffutils-3.7-3.fc31.x86_64.rpm        1.9 MB/s | 401 kB     00:00    
(31/82): libevent-2.1.8-7.fc31.x86_64.rpm       2.5 MB/s | 258 kB     00:00    
(32/82): qrencode-libs-4.0.2-4.fc31.x86_64.rpm  1.1 MB/s |  61 kB     00:00    
(33/82): trousers-0.3.13-13.fc31.x86_64.rpm     1.4 MB/s | 150 kB     00:00    
(34/82): libargon2-20171227-3.fc31.x86_64.rpm    77 kB/s |  30 kB     00:00    
(35/82): trousers-lib-0.3.13-13.fc31.x86_64.rpm 1.2 MB/s | 171 kB     00:00    
(36/82): brotli-1.0.9-3.fc31.x86_64.rpm         1.1 MB/s | 329 kB     00:00    
(37/82): ca-certificates-2020.2.41-1.1.fc31.noa 1.4 MB/s | 352 kB     00:00    
(38/82): curl-7.66.0-3.fc31.x86_64.rpm          778 kB/s | 292 kB     00:00    
(39/82): dnf-4.2.23-1.fc31.noarch.rpm           2.7 MB/s | 419 kB     00:00    
(40/82): dnf-data-4.2.23-1.fc31.noarch.rpm      259 kB/s |  50 kB     00:00    
(41/82): fedora-gpg-keys-31-5.noarch.rpm        874 kB/s | 104 kB     00:00    
(42/82): fedora-repos-31-5.noarch.rpm           109 kB/s | 9.8 kB     00:00    
(43/82): bash-5.0.17-1.fc31.x86_64.rpm          964 kB/s | 1.6 MB     00:01    
(44/82): glib2-2.62.6-2.fc31.x86_64.rpm         3.7 MB/s | 2.6 MB     00:00    
(45/82): glibc-common-2.30-13.fc31.x86_64.rpm   1.8 MB/s | 702 kB     00:00    
(46/82): glibc-minimal-langpack-2.30-13.fc31.x8 844 kB/s |  44 kB     00:00    
(47/82): gnutls-3.6.15-1.fc31.x86_64.rpm        2.2 MB/s | 1.0 MB     00:00    
(48/82): cracklib-dicts-2.9.6-21.fc31.x86_64.rp 944 kB/s | 3.7 MB     00:03    
(49/82): json-c-0.13.1-13.fc31.x86_64.rpm       779 kB/s |  37 kB     00:00    
(50/82): libcap-ng-0.7.11-1.fc31.x86_64.rpm     428 kB/s |  28 kB     00:00    
(51/82): libarchive-3.4.3-1.fc31.x86_64.rpm     2.1 MB/s | 384 kB     00:00    
(52/82): libcurl-7.66.0-3.fc31.x86_64.rpm       1.2 MB/s | 265 kB     00:00    
(53/82): libmetalink-0.1.3-13.fc31.x86_64.rpm    96 kB/s |  31 kB     00:00    
(54/82): libdnf-0.48.0-1.fc31.x86_64.rpm        1.3 MB/s | 645 kB     00:00    
(55/82): libnghttp2-1.41.0-1.fc31.x86_64.rpm    502 kB/s |  77 kB     00:00    
(56/82): librepo-1.12.1-1.fc31.x86_64.rpm       604 kB/s |  97 kB     00:00    
(57/82): glibc-2.30-13.fc31.x86_64.rpm          1.4 MB/s | 3.5 MB     00:02    
(58/82): libreport-filesystem-2.13.1-3.fc31.noa  85 kB/s |  14 kB     00:00    
(59/82): libselinux-2.9-6.fc31.x86_64.rpm       555 kB/s |  84 kB     00:00    
(60/82): libssh-config-0.9.4-3.fc31.noarch.rpm  173 kB/s |  11 kB     00:00    
(61/82): libsolv-0.7.14-1.fc31.x86_64.rpm       2.2 MB/s | 396 kB     00:00    
(62/82): libssh-0.9.4-3.fc31.x86_64.rpm         1.8 MB/s | 214 kB     00:00    
(63/82): libtirpc-1.2.6-1.rc4.fc31.x86_64.rpm   887 kB/s |  96 kB     00:00    
(64/82): libxcrypt-4.4.17-1.fc31.x86_64.rpm     939 kB/s | 124 kB     00:00    
(65/82): lua-libs-5.3.5-8.fc31.x86_64.rpm       786 kB/s | 115 kB     00:00    
(66/82): libxml2-2.9.10-4.fc31.x86_64.rpm       2.0 MB/s | 692 kB     00:00    
(67/82): p11-kit-trust-0.23.21-2.fc31.x86_64.rp 1.2 MB/s | 139 kB     00:00    
(68/82): p11-kit-0.23.21-2.fc31.x86_64.rpm      1.3 MB/s | 342 kB     00:00    
(69/82): pcre2-10.35-7.fc31.x86_64.rpm          3.3 MB/s | 228 kB     00:00    
(70/82): pcre2-syntax-10.35-7.fc31.noarch.rpm   960 kB/s | 141 kB     00:00    
(71/82): python3-3.7.9-1.fc31.x86_64.rpm        260 kB/s |  28 kB     00:00    
(72/82): pam-1.3.1-25.fc31.x86_64.rpm           2.1 MB/s | 661 kB     00:00    
(73/82): python3-dnf-4.2.23-1.fc31.noarch.rpm   1.2 MB/s | 407 kB     00:00    
(74/82): python3-hawkey-0.48.0-1.fc31.x86_64.rp 341 kB/s | 114 kB     00:00    
(75/82): python3-libdnf-0.48.0-1.fc31.x86_64.rp 946 kB/s | 774 kB     00:00    
(76/82): sudo-1.9.2-1.fc31.x86_64.rpm           1.1 MB/s | 1.0 MB     00:00    
(77/82): systemd-libs-243.9-1.fc31.x86_64.rpm   285 kB/s | 522 kB     00:01    
(78/82): vim-minimal-8.2.1770-1.fc31.x86_64.rpm 346 kB/s | 653 kB     00:01    
(79/82): xz-libs-5.2.5-1.fc31.x86_64.rpm        645 kB/s |  89 kB     00:00    
(80/82): yum-4.2.23-1.fc31.noarch.rpm           360 kB/s |  47 kB     00:00    
(81/82): tar-1.32-3.fc31.x86_64.rpm             186 kB/s | 887 kB     00:04    
(82/82): python3-libs-3.7.9-1.fc31.x86_64.rpm   1.2 MB/s | 7.3 MB     00:06    
--------------------------------------------------------------------------------
Total                                           2.6 MB/s |  42 MB     00:15     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Upgrading        : pcre2-syntax-10.35-7.fc31.noarch                     1/128 
  Upgrading        : libselinux-2.9-6.fc31.x86_64                         2/128 
  Upgrading        : pcre2-10.35-7.fc31.x86_64                            3/128 
  Running scriptlet: glibc-2.30-13.fc31.x86_64                            4/128 
  Upgrading        : glibc-2.30-13.fc31.x86_64                            4/128 
  Running scriptlet: glibc-2.30-13.fc31.x86_64                            4/128 
  Upgrading        : bash-5.0.17-1.fc31.x86_64                            5/128 
  Running scriptlet: bash-5.0.17-1.fc31.x86_64                            5/128 
  Upgrading        : glibc-common-2.30-13.fc31.x86_64                     6/128 
  Upgrading        : glibc-minimal-langpack-2.30-13.fc31.x86_64           7/128 
  Upgrading        : xz-libs-5.2.5-1.fc31.x86_64                          8/128 
  Upgrading        : libxml2-2.9.10-4.fc31.x86_64                         9/128 
  Upgrading        : systemd-libs-243.9-1.fc31.x86_64                    10/128 
  Running scriptlet: systemd-libs-243.9-1.fc31.x86_64                    10/128 
  Upgrading        : p11-kit-0.23.21-2.fc31.x86_64                       11/128 
  Upgrading        : p11-kit-trust-0.23.21-2.fc31.x86_64                 12/128 
  Running scriptlet: p11-kit-trust-0.23.21-2.fc31.x86_64                 12/128 
  Upgrading        : libsolv-0.7.14-1.fc31.x86_64                        13/128 
  Installing       : libbrotli-1.0.9-3.fc31.x86_64                       14/128 
  Installing       : libevent-2.1.8-7.fc31.x86_64                        15/128 
  Upgrading        : json-c-0.13.1-13.fc31.x86_64                        16/128 
  Upgrading        : libtirpc-1.2.6-1.rc4.fc31.x86_64                    17/128 
  Running scriptlet: ca-certificates-2020.2.41-1.1.fc31.noarch           18/128 
  Upgrading        : ca-certificates-2020.2.41-1.1.fc31.noarch           18/128 
  Running scriptlet: ca-certificates-2020.2.41-1.1.fc31.noarch           18/128 
  Installing       : dbus-libs-1:1.12.20-1.fc31.x86_64                   19/128 
  Upgrading        : glib2-2.62.6-2.fc31.x86_64                          20/128 
  Installing       : shared-mime-info-1.15-1.fc31.x86_64                 21/128 
  Running scriptlet: shared-mime-info-1.15-1.fc31.x86_64                 21/128 
  Installing       : deltarpm-3.6.2-2.fc31.x86_64                        22/128 
  Installing       : kmod-libs-26-4.fc31.x86_64                          23/128 
  Installing       : libpcap-14:1.9.1-2.fc31.x86_64                      24/128 
  Installing       : iptables-libs-1.8.3-7.fc31.x86_64                   25/128 
  Installing       : libseccomp-2.5.0-3.fc31.x86_64                      26/128 
  Installing       : acl-2.2.53-4.fc31.x86_64                            27/128 
  Installing       : diffutils-3.7-3.fc31.x86_64                         28/128 
  Installing       : libargon2-20171227-3.fc31.x86_64                    29/128 
  Installing       : qrencode-libs-4.0.2-4.fc31.x86_64                   30/128 
  Installing       : trousers-lib-0.3.13-13.fc31.x86_64                  31/128 
  Upgrading        : libcap-ng-0.7.11-1.fc31.x86_64                      32/128 
  Upgrading        : libmetalink-0.1.3-13.fc31.x86_64                    33/128 
  Upgrading        : libnghttp2-1.41.0-1.fc31.x86_64                     34/128 
  Upgrading        : lua-libs-5.3.5-8.fc31.x86_64                        35/128 
  Installing       : rpm-plugin-systemd-inhibit-4.15.1-2.fc31.x86_64     36/128 
  Upgrading        : vim-minimal-2:8.2.1770-1.fc31.x86_64                37/128 
  Upgrading        : libssh-config-0.9.4-3.fc31.noarch                   38/128 
  Upgrading        : libssh-0.9.4-3.fc31.x86_64                          39/128 
  Upgrading        : libcurl-7.66.0-3.fc31.x86_64                        40/128 
  Upgrading        : librepo-1.12.1-1.fc31.x86_64                        41/128 
  Upgrading        : libdnf-0.48.0-1.fc31.x86_64                         42/128 
  Upgrading        : libreport-filesystem-2.13.1-3.fc31.noarch           43/128 
  Upgrading        : dnf-data-4.2.23-1.fc31.noarch                       44/128 
  Upgrading        : fedora-gpg-keys-31-5.noarch                         45/128 
  Installing       : cracklib-dicts-2.9.6-21.fc31.x86_64                 46/128 
  Installing       : xkeyboard-config-2.28-1.fc31.noarch                 47/128 
  Installing       : libxkbcommon-0.9.1-3.fc31.x86_64                    48/128 
  Installing       : whois-nls-5.5.7-1.fc31.noarch                       49/128 
  Upgrading        : libxcrypt-4.4.17-1.fc31.x86_64                      50/128 
  Installing       : mkpasswd-5.5.7-1.fc31.x86_64                        51/128 
  Upgrading        : pam-1.3.1-25.fc31.x86_64                            52/128 
  Installing       : libxcrypt-compat-4.4.17-1.fc31.x86_64               53/128 
  Installing       : python-unversioned-command-3.7.9-1.fc31.noarch      54/128 
  Installing       : python3-setuptools-41.6.0-1.fc31.noarch             55/128 
  Upgrading        : python3-libs-3.7.9-1.fc31.x86_64                    56/128 
  Upgrading        : python3-3.7.9-1.fc31.x86_64                         57/128 
  Installing       : python3-pip-19.1.1-8.fc31.noarch                    58/128 
  Upgrading        : python3-libdnf-0.48.0-1.fc31.x86_64                 59/128 
  Upgrading        : python3-hawkey-0.48.0-1.fc31.x86_64                 60/128 
  Running scriptlet: unbound-libs-1.10.1-1.fc31.x86_64                   61/128 
  Installing       : unbound-libs-1.10.1-1.fc31.x86_64                   61/128 
  Running scriptlet: unbound-libs-1.10.1-1.fc31.x86_64                   61/128 
  Installing       : python3-unbound-1.10.1-1.fc31.x86_64                62/128 
  Upgrading        : python3-dnf-4.2.23-1.fc31.noarch                    63/128 
  Upgrading        : dnf-4.2.23-1.fc31.noarch                            64/128 
  Running scriptlet: dnf-4.2.23-1.fc31.noarch                            64/128 
  Installing       : systemd-rpm-macros-243.9-1.fc31.noarch              65/128 
  Installing       : device-mapper-1.02.171-1.fc31.x86_64                66/128 
  Installing       : device-mapper-libs-1.02.171-1.fc31.x86_64           67/128 
  Installing       : cryptsetup-libs-2.3.4-1.fc31.x86_64                 68/128 
  Installing       : systemd-pam-243.9-1.fc31.x86_64                     69/128 
  Installing       : dbus-1:1.12.20-1.fc31.x86_64                        70/128 
  Upgrading        : gnutls-3.6.15-1.fc31.x86_64                         71/128 
  Running scriptlet: systemd-243.9-1.fc31.x86_64                         72/128 
  Installing       : systemd-243.9-1.fc31.x86_64                         72/128 
  Running scriptlet: systemd-243.9-1.fc31.x86_64                         72/128 
  Installing       : dbus-common-1:1.12.20-1.fc31.noarch                 73/128 
  Running scriptlet: dbus-common-1:1.12.20-1.fc31.noarch                 73/128 
Created symlink /etc/systemd/system/sockets.target.wants/dbus.socket → /usr/lib/systemd/system/dbus.socket.
Created symlink /etc/systemd/user/sockets.target.wants/dbus.socket → /usr/lib/systemd/user/dbus.socket.

  Running scriptlet: dbus-broker-21-6.fc31.x86_64                        74/128 
  Installing       : dbus-broker-21-6.fc31.x86_64                        74/128 
  Running scriptlet: dbus-broker-21-6.fc31.x86_64                        74/128 
Failed to get unit file state for dbus-daemon.service: No such file or directory
Failed to get unit file state for dbus-daemon.service: No such file or directory
Failed to disable unit, unit dbus-daemon.service does not exist.
Failed to disable unit, unit dbus-daemon.service does not exist.

  Running scriptlet: trousers-0.3.13-13.fc31.x86_64                      75/128 
  Installing       : trousers-0.3.13-13.fc31.x86_64                      75/128 
  Running scriptlet: trousers-0.3.13-13.fc31.x86_64                      75/128 
  Upgrading        : yum-4.2.23-1.fc31.noarch                            76/128 
  Upgrading        : sudo-1.9.2-1.fc31.x86_64                            77/128 
  Running scriptlet: sudo-1.9.2-1.fc31.x86_64                            77/128 
  Upgrading        : fedora-repos-31-5.noarch                            78/128 
  Upgrading        : curl-7.66.0-3.fc31.x86_64                           79/128 
  Upgrading        : brotli-1.0.9-3.fc31.x86_64                          80/128 
  Upgrading        : libarchive-3.4.3-1.fc31.x86_64                      81/128 
  Upgrading        : tar-2:1.32-3.fc31.x86_64                            82/128 
  Cleanup          : ca-certificates-2020.2.40-1.1.fc31.noarch           83/128 
  Cleanup          : systemd-libs-243.8-1.fc31.x86_64                    84/128 
  Cleanup          : sudo-1.9.0-0.1.b4.fc31.x86_64                       85/128 
  Cleanup          : pam-1.3.1-21.fc31.x86_64                            86/128 
  Cleanup          : libarchive-3.4.2-1.fc31.x86_64                      87/128 
  Cleanup          : gnutls-3.6.13-1.fc31.x86_64                         88/128 
  Cleanup          : p11-kit-trust-0.23.20-1.fc31.x86_64                 89/128 
  Running scriptlet: p11-kit-trust-0.23.20-1.fc31.x86_64                 89/128 
  Cleanup          : p11-kit-0.23.20-1.fc31.x86_64                       90/128 
  Cleanup          : tar-2:1.32-2.fc31.x86_64                            91/128 
  Cleanup          : curl-7.66.0-1.fc31.x86_64                           92/128 
  Cleanup          : yum-4.2.21-1.fc31.noarch                            93/128 
  Running scriptlet: dnf-4.2.21-1.fc31.noarch                            94/128 
  Cleanup          : dnf-4.2.21-1.fc31.noarch                            94/128 
  Running scriptlet: dnf-4.2.21-1.fc31.noarch                            94/128 
System has not been booted with systemd as init system (PID 1). Can't operate.
Failed to connect to bus: Host is down

  Cleanup          : python3-dnf-4.2.21-1.fc31.noarch                    95/128 
  Cleanup          : dnf-data-4.2.21-1.fc31.noarch                       96/128 
  Cleanup          : fedora-repos-31-3.noarch                            97/128 
  Cleanup          : python3-hawkey-0.47.0-1.fc31.x86_64                 98/128 
  Cleanup          : lua-libs-5.3.5-6.fc31.x86_64                        99/128 
  Cleanup          : libcap-ng-0.7.10-1.fc31.x86_64                     100/128 
  Cleanup          : python3-libdnf-0.47.0-1.fc31.x86_64                101/128 
  Cleanup          : python3-libs-3.7.7-1.fc31.x86_64                   102/128 
  Cleanup          : python3-3.7.7-1.fc31.x86_64                        103/128 
  Cleanup          : libdnf-0.47.0-1.fc31.x86_64                        104/128 
  Cleanup          : libsolv-0.7.12-1.fc31.x86_64                       105/128 
  Cleanup          : libtirpc-1.2.6-0.fc31.x86_64                       106/128 
  Cleanup          : librepo-1.11.3-1.fc31.x86_64                       107/128 
  Cleanup          : glib2-2.62.6-1.fc31.x86_64                         108/128 
  Cleanup          : libcurl-7.66.0-1.fc31.x86_64                       109/128 
  Cleanup          : libxml2-2.9.10-3.fc31.x86_64                       110/128 
  Cleanup          : libssh-0.9.4-2.fc31.x86_64                         111/128 
  Cleanup          : xz-libs-5.2.4-6.fc31.x86_64                        112/128 
  Cleanup          : json-c-0.13.1-12.fc31.x86_64                       113/128 
  Cleanup          : vim-minimal-2:8.2.752-1.fc31.x86_64                114/128 
  Cleanup          : brotli-1.0.7-6.fc31.x86_64                         115/128 
  Cleanup          : libxcrypt-4.4.16-3.fc31.x86_64                     116/128 
  Cleanup          : libnghttp2-1.40.0-1.fc31.x86_64                    117/128 
  Cleanup          : libmetalink-0.1.3-9.fc31.x86_64                    118/128 
  Cleanup          : libssh-config-0.9.4-2.fc31.noarch                  119/128 
  Cleanup          : fedora-gpg-keys-31-3.noarch                        120/128 
  Cleanup          : libreport-filesystem-2.12.0-1.fc31.noarch          121/128 
  Cleanup          : pcre2-10.35-1.fc31.x86_64                          122/128 
  Cleanup          : libselinux-2.9-5.fc31.x86_64                       123/128 
  Cleanup          : glibc-common-2.30-11.fc31.x86_64                   124/128 
  Cleanup          : bash-5.0.11-1.fc31.x86_64                          125/128 
  Running scriptlet: bash-5.0.11-1.fc31.x86_64                          125/128 
  Cleanup          : glibc-2.30-11.fc31.x86_64                          126/128 
  Cleanup          : glibc-minimal-langpack-2.30-11.fc31.x86_64         127/128 
  Cleanup          : pcre2-syntax-10.35-1.fc31.noarch                   128/128 
  Running scriptlet: ca-certificates-2020.2.41-1.1.fc31.noarch          128/128 
  Running scriptlet: pcre2-syntax-10.35-1.fc31.noarch                   128/128  
  Verifying        : cryptsetup-libs-2.3.4-1.fc31.x86_64                  1/128 
  Verifying        : dbus-1:1.12.20-1.fc31.x86_64                         2/128 
  Verifying        : dbus-common-1:1.12.20-1.fc31.noarch                  3/128 
  Verifying        : dbus-libs-1:1.12.20-1.fc31.x86_64                    4/128 
  Verifying        : device-mapper-1.02.171-1.fc31.x86_64                 5/128 
  Verifying        : device-mapper-libs-1.02.171-1.fc31.x86_64            6/128 
  Verifying        : iptables-libs-1.8.3-7.fc31.x86_64                    7/128 
  Verifying        : libbrotli-1.0.9-3.fc31.x86_64                        8/128 
  Verifying        : libpcap-14:1.9.1-2.fc31.x86_64                       9/128 
  Verifying        : libseccomp-2.5.0-3.fc31.x86_64                      10/128 
  Verifying        : libxcrypt-compat-4.4.17-1.fc31.x86_64               11/128 
  Verifying        : libxkbcommon-0.9.1-3.fc31.x86_64                    12/128 
  Verifying        : mkpasswd-5.5.7-1.fc31.x86_64                        13/128 
  Verifying        : python-unversioned-command-3.7.9-1.fc31.noarch      14/128 
  Verifying        : python3-pip-19.1.1-8.fc31.noarch                    15/128 
  Verifying        : python3-setuptools-41.6.0-1.fc31.noarch             16/128 
  Verifying        : python3-unbound-1.10.1-1.fc31.x86_64                17/128 
  Verifying        : rpm-plugin-systemd-inhibit-4.15.1-2.fc31.x86_64     18/128 
  Verifying        : shared-mime-info-1.15-1.fc31.x86_64                 19/128 
  Verifying        : systemd-243.9-1.fc31.x86_64                         20/128 
  Verifying        : systemd-pam-243.9-1.fc31.x86_64                     21/128 
  Verifying        : systemd-rpm-macros-243.9-1.fc31.noarch              22/128 
  Verifying        : unbound-libs-1.10.1-1.fc31.x86_64                   23/128 
  Verifying        : whois-nls-5.5.7-1.fc31.noarch                       24/128 
  Verifying        : xkeyboard-config-2.28-1.fc31.noarch                 25/128 
  Verifying        : acl-2.2.53-4.fc31.x86_64                            26/128 
  Verifying        : cracklib-dicts-2.9.6-21.fc31.x86_64                 27/128 
  Verifying        : dbus-broker-21-6.fc31.x86_64                        28/128 
  Verifying        : deltarpm-3.6.2-2.fc31.x86_64                        29/128 
  Verifying        : diffutils-3.7-3.fc31.x86_64                         30/128 
  Verifying        : kmod-libs-26-4.fc31.x86_64                          31/128 
  Verifying        : libargon2-20171227-3.fc31.x86_64                    32/128 
  Verifying        : libevent-2.1.8-7.fc31.x86_64                        33/128 
  Verifying        : qrencode-libs-4.0.2-4.fc31.x86_64                   34/128 
  Verifying        : trousers-0.3.13-13.fc31.x86_64                      35/128 
  Verifying        : trousers-lib-0.3.13-13.fc31.x86_64                  36/128 
  Verifying        : bash-5.0.17-1.fc31.x86_64                           37/128 
  Verifying        : bash-5.0.11-1.fc31.x86_64                           38/128 
  Verifying        : brotli-1.0.9-3.fc31.x86_64                          39/128 
  Verifying        : brotli-1.0.7-6.fc31.x86_64                          40/128 
  Verifying        : ca-certificates-2020.2.41-1.1.fc31.noarch           41/128 
  Verifying        : ca-certificates-2020.2.40-1.1.fc31.noarch           42/128 
  Verifying        : curl-7.66.0-3.fc31.x86_64                           43/128 
  Verifying        : curl-7.66.0-1.fc31.x86_64                           44/128 
  Verifying        : dnf-4.2.23-1.fc31.noarch                            45/128 
  Verifying        : dnf-4.2.21-1.fc31.noarch                            46/128 
  Verifying        : dnf-data-4.2.23-1.fc31.noarch                       47/128 
  Verifying        : dnf-data-4.2.21-1.fc31.noarch                       48/128 
  Verifying        : fedora-gpg-keys-31-5.noarch                         49/128 
  Verifying        : fedora-gpg-keys-31-3.noarch                         50/128 
  Verifying        : fedora-repos-31-5.noarch                            51/128 
  Verifying        : fedora-repos-31-3.noarch                            52/128 
  Verifying        : glib2-2.62.6-2.fc31.x86_64                          53/128 
  Verifying        : glib2-2.62.6-1.fc31.x86_64                          54/128 
  Verifying        : glibc-2.30-13.fc31.x86_64                           55/128 
  Verifying        : glibc-2.30-11.fc31.x86_64                           56/128 
  Verifying        : glibc-common-2.30-13.fc31.x86_64                    57/128 
  Verifying        : glibc-common-2.30-11.fc31.x86_64                    58/128 
  Verifying        : glibc-minimal-langpack-2.30-13.fc31.x86_64          59/128 
  Verifying        : glibc-minimal-langpack-2.30-11.fc31.x86_64          60/128 
  Verifying        : gnutls-3.6.15-1.fc31.x86_64                         61/128 
  Verifying        : gnutls-3.6.13-1.fc31.x86_64                         62/128 
  Verifying        : json-c-0.13.1-13.fc31.x86_64                        63/128 
  Verifying        : json-c-0.13.1-12.fc31.x86_64                        64/128 
  Verifying        : libarchive-3.4.3-1.fc31.x86_64                      65/128 
  Verifying        : libarchive-3.4.2-1.fc31.x86_64                      66/128 
  Verifying        : libcap-ng-0.7.11-1.fc31.x86_64                      67/128 
  Verifying        : libcap-ng-0.7.10-1.fc31.x86_64                      68/128 
  Verifying        : libcurl-7.66.0-3.fc31.x86_64                        69/128 
  Verifying        : libcurl-7.66.0-1.fc31.x86_64                        70/128 
  Verifying        : libdnf-0.48.0-1.fc31.x86_64                         71/128 
  Verifying        : libdnf-0.47.0-1.fc31.x86_64                         72/128 
  Verifying        : libmetalink-0.1.3-13.fc31.x86_64                    73/128 
  Verifying        : libmetalink-0.1.3-9.fc31.x86_64                     74/128 
  Verifying        : libnghttp2-1.41.0-1.fc31.x86_64                     75/128 
  Verifying        : libnghttp2-1.40.0-1.fc31.x86_64                     76/128 
  Verifying        : librepo-1.12.1-1.fc31.x86_64                        77/128 
  Verifying        : librepo-1.11.3-1.fc31.x86_64                        78/128 
  Verifying        : libreport-filesystem-2.13.1-3.fc31.noarch           79/128 
  Verifying        : libreport-filesystem-2.12.0-1.fc31.noarch           80/128 
  Verifying        : libselinux-2.9-6.fc31.x86_64                        81/128 
  Verifying        : libselinux-2.9-5.fc31.x86_64                        82/128 
  Verifying        : libsolv-0.7.14-1.fc31.x86_64                        83/128 
  Verifying        : libsolv-0.7.12-1.fc31.x86_64                        84/128 
  Verifying        : libssh-0.9.4-3.fc31.x86_64                          85/128 
  Verifying        : libssh-0.9.4-2.fc31.x86_64                          86/128 
  Verifying        : libssh-config-0.9.4-3.fc31.noarch                   87/128 
  Verifying        : libssh-config-0.9.4-2.fc31.noarch                   88/128 
  Verifying        : libtirpc-1.2.6-1.rc4.fc31.x86_64                    89/128 
  Verifying        : libtirpc-1.2.6-0.fc31.x86_64                        90/128 
  Verifying        : libxcrypt-4.4.17-1.fc31.x86_64                      91/128 
  Verifying        : libxcrypt-4.4.16-3.fc31.x86_64                      92/128 
  Verifying        : libxml2-2.9.10-4.fc31.x86_64                        93/128 
  Verifying        : libxml2-2.9.10-3.fc31.x86_64                        94/128 
  Verifying        : lua-libs-5.3.5-8.fc31.x86_64                        95/128 
  Verifying        : lua-libs-5.3.5-6.fc31.x86_64                        96/128 
  Verifying        : p11-kit-0.23.21-2.fc31.x86_64                       97/128 
  Verifying        : p11-kit-0.23.20-1.fc31.x86_64                       98/128 
  Verifying        : p11-kit-trust-0.23.21-2.fc31.x86_64                 99/128 
  Verifying        : p11-kit-trust-0.23.20-1.fc31.x86_64                100/128 
  Verifying        : pam-1.3.1-25.fc31.x86_64                           101/128 
  Verifying        : pam-1.3.1-21.fc31.x86_64                           102/128 
  Verifying        : pcre2-10.35-7.fc31.x86_64                          103/128 
  Verifying        : pcre2-10.35-1.fc31.x86_64                          104/128 
  Verifying        : pcre2-syntax-10.35-7.fc31.noarch                   105/128 
  Verifying        : pcre2-syntax-10.35-1.fc31.noarch                   106/128 
  Verifying        : python3-3.7.9-1.fc31.x86_64                        107/128 
  Verifying        : python3-3.7.7-1.fc31.x86_64                        108/128 
  Verifying        : python3-dnf-4.2.23-1.fc31.noarch                   109/128 
  Verifying        : python3-dnf-4.2.21-1.fc31.noarch                   110/128 
  Verifying        : python3-hawkey-0.48.0-1.fc31.x86_64                111/128 
  Verifying        : python3-hawkey-0.47.0-1.fc31.x86_64                112/128 
  Verifying        : python3-libdnf-0.48.0-1.fc31.x86_64                113/128 
  Verifying        : python3-libdnf-0.47.0-1.fc31.x86_64                114/128 
  Verifying        : python3-libs-3.7.9-1.fc31.x86_64                   115/128 
  Verifying        : python3-libs-3.7.7-1.fc31.x86_64                   116/128 
  Verifying        : sudo-1.9.2-1.fc31.x86_64                           117/128 
  Verifying        : sudo-1.9.0-0.1.b4.fc31.x86_64                      118/128 
  Verifying        : systemd-libs-243.9-1.fc31.x86_64                   119/128 
  Verifying        : systemd-libs-243.8-1.fc31.x86_64                   120/128 
  Verifying        : tar-2:1.32-3.fc31.x86_64                           121/128 
  Verifying        : tar-2:1.32-2.fc31.x86_64                           122/128 
  Verifying        : vim-minimal-2:8.2.1770-1.fc31.x86_64               123/128 
  Verifying        : vim-minimal-2:8.2.752-1.fc31.x86_64                124/128 
  Verifying        : xz-libs-5.2.5-1.fc31.x86_64                        125/128 
  Verifying        : xz-libs-5.2.4-6.fc31.x86_64                        126/128 
  Verifying        : yum-4.2.23-1.fc31.noarch                           127/128 
  Verifying        : yum-4.2.21-1.fc31.noarch                           128/128 

Upgraded:
  bash-5.0.17-1.fc31.x86_64                                                     
  brotli-1.0.9-3.fc31.x86_64                                                    
  ca-certificates-2020.2.41-1.1.fc31.noarch                                     
  curl-7.66.0-3.fc31.x86_64                                                     
  dnf-4.2.23-1.fc31.noarch                                                      
  dnf-data-4.2.23-1.fc31.noarch                                                 
  fedora-gpg-keys-31-5.noarch                                                   
  fedora-repos-31-5.noarch                                                      
  glib2-2.62.6-2.fc31.x86_64                                                    
  glibc-2.30-13.fc31.x86_64                                                     
  glibc-common-2.30-13.fc31.x86_64                                              
  glibc-minimal-langpack-2.30-13.fc31.x86_64                                    
  gnutls-3.6.15-1.fc31.x86_64                                                   
  json-c-0.13.1-13.fc31.x86_64                                                  
  libarchive-3.4.3-1.fc31.x86_64                                                
  libcap-ng-0.7.11-1.fc31.x86_64                                                
  libcurl-7.66.0-3.fc31.x86_64                                                  
  libdnf-0.48.0-1.fc31.x86_64                                                   
  libmetalink-0.1.3-13.fc31.x86_64                                              
  libnghttp2-1.41.0-1.fc31.x86_64                                               
  librepo-1.12.1-1.fc31.x86_64                                                  
  libreport-filesystem-2.13.1-3.fc31.noarch                                     
  libselinux-2.9-6.fc31.x86_64                                                  
  libsolv-0.7.14-1.fc31.x86_64                                                  
  libssh-0.9.4-3.fc31.x86_64                                                    
  libssh-config-0.9.4-3.fc31.noarch                                             
  libtirpc-1.2.6-1.rc4.fc31.x86_64                                              
  libxcrypt-4.4.17-1.fc31.x86_64                                                
  libxml2-2.9.10-4.fc31.x86_64                                                  
  lua-libs-5.3.5-8.fc31.x86_64                                                  
  p11-kit-0.23.21-2.fc31.x86_64                                                 
  p11-kit-trust-0.23.21-2.fc31.x86_64                                           
  pam-1.3.1-25.fc31.x86_64                                                      
  pcre2-10.35-7.fc31.x86_64                                                     
  pcre2-syntax-10.35-7.fc31.noarch                                              
  python3-3.7.9-1.fc31.x86_64                                                   
  python3-dnf-4.2.23-1.fc31.noarch                                              
  python3-hawkey-0.48.0-1.fc31.x86_64                                           
  python3-libdnf-0.48.0-1.fc31.x86_64                                           
  python3-libs-3.7.9-1.fc31.x86_64                                              
  sudo-1.9.2-1.fc31.x86_64                                                      
  systemd-libs-243.9-1.fc31.x86_64                                              
  tar-2:1.32-3.fc31.x86_64                                                      
  vim-minimal-2:8.2.1770-1.fc31.x86_64                                          
  xz-libs-5.2.5-1.fc31.x86_64                                                   
  yum-4.2.23-1.fc31.noarch                                                      

Installed:
  acl-2.2.53-4.fc31.x86_64                                                      
  cracklib-dicts-2.9.6-21.fc31.x86_64                                           
  cryptsetup-libs-2.3.4-1.fc31.x86_64                                           
  dbus-1:1.12.20-1.fc31.x86_64                                                  
  dbus-broker-21-6.fc31.x86_64                                                  
  dbus-common-1:1.12.20-1.fc31.noarch                                           
  dbus-libs-1:1.12.20-1.fc31.x86_64                                             
  deltarpm-3.6.2-2.fc31.x86_64                                                  
  device-mapper-1.02.171-1.fc31.x86_64                                          
  device-mapper-libs-1.02.171-1.fc31.x86_64                                     
  diffutils-3.7-3.fc31.x86_64                                                   
  iptables-libs-1.8.3-7.fc31.x86_64                                             
  kmod-libs-26-4.fc31.x86_64                                                    
  libargon2-20171227-3.fc31.x86_64                                              
  libbrotli-1.0.9-3.fc31.x86_64                                                 
  libevent-2.1.8-7.fc31.x86_64                                                  
  libpcap-14:1.9.1-2.fc31.x86_64                                                
  libseccomp-2.5.0-3.fc31.x86_64                                                
  libxcrypt-compat-4.4.17-1.fc31.x86_64                                         
  libxkbcommon-0.9.1-3.fc31.x86_64                                              
  mkpasswd-5.5.7-1.fc31.x86_64                                                  
  python-unversioned-command-3.7.9-1.fc31.noarch                                
  python3-pip-19.1.1-8.fc31.noarch                                              
  python3-setuptools-41.6.0-1.fc31.noarch                                       
  python3-unbound-1.10.1-1.fc31.x86_64                                          
  qrencode-libs-4.0.2-4.fc31.x86_64                                             
  rpm-plugin-systemd-inhibit-4.15.1-2.fc31.x86_64                               
  shared-mime-info-1.15-1.fc31.x86_64                                           
  systemd-243.9-1.fc31.x86_64                                                   
  systemd-pam-243.9-1.fc31.x86_64                                               
  systemd-rpm-macros-243.9-1.fc31.noarch                                        
  trousers-0.3.13-13.fc31.x86_64                                                
  trousers-lib-0.3.13-13.fc31.x86_64                                            
  unbound-libs-1.10.1-1.fc31.x86_64                                             
  whois-nls-5.5.7-1.fc31.noarch                                                 
  xkeyboard-config-2.28-1.fc31.noarch                                           

Complete!
Last metadata expiration check: 0:01:31 ago on Sun Oct 25 18:07:41 2020.
Dependencies resolved.
================================================================================
 Package             Architecture  Version                 Repository      Size
================================================================================
Reinstalling:
 shadow-utils        x86_64        2:4.6-18.fc31           updates        1.2 M

Transaction Summary
================================================================================

Total download size: 1.2 M
Installed size: 3.9 M
Downloading Packages:
shadow-utils-4.6-18.fc31.x86_64.rpm             3.2 MB/s | 1.2 MB     00:00    
--------------------------------------------------------------------------------
Total                                           958 kB/s | 1.2 MB     00:01     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Reinstalling     : shadow-utils-2:4.6-18.fc31.x86_64                      1/2 
  Cleanup          : shadow-utils-2:4.6-18.fc31.x86_64                      2/2 
  Running scriptlet: shadow-utils-2:4.6-18.fc31.x86_64                      2/2 
  Verifying        : shadow-utils-2:4.6-18.fc31.x86_64                      1/2 
  Verifying        : shadow-utils-2:4.6-18.fc31.x86_64                      2/2 

Reinstalled:
  shadow-utils-2:4.6-18.fc31.x86_64                                             

Complete!
Last metadata expiration check: 0:01:48 ago on Sun Oct 25 18:07:41 2020.
Package python3-pip-19.1.1-8.fc31.noarch is already installed.
Dependencies resolved.
================================================================================
 Package             Arch     Version                           Repo       Size
================================================================================
Installing:
 buildah             x86_64   1.16.4-1.fc31                     updates   8.1 M
 runc                x86_64   2:1.0.0-102.dev.gitdc9208a.fc31   updates   2.7 M
Installing dependencies:
 containers-common   x86_64   1:1.2.0-1.fc31                    updates    47 k
 crun                x86_64   0.15-5.fc31                       updates   186 k
 fuse-common         x86_64   3.6.2-1.fc31                      fedora    7.8 k
 fuse3               x86_64   3.6.2-1.fc31                      fedora     54 k
 fuse3-libs          x86_64   3.6.2-1.fc31                      fedora     92 k
 kmod                x86_64   26-4.fc31                         fedora    122 k
 libbsd              x86_64   0.9.1-4.fc31                      fedora    101 k
 libnet              x86_64   1.1.6-18.fc31                     fedora     64 k
 libnl3              x86_64   3.5.0-1.fc31                      fedora    331 k
 libslirp            x86_64   4.1.0-2.fc31                      updates    67 k
 protobuf-c          x86_64   1.3.1-3.fc31                      fedora     35 k
 yajl                x86_64   2.1.0-13.fc31                     fedora     39 k
Installing weak dependencies:
 criu                x86_64   3.14-1.fc31                       updates   505 k
 fuse-overlayfs      x86_64   1.2.0-1.fc31                      updates    68 k
 slirp4netns         x86_64   1.1.4-1.fc31                      updates    51 k

Transaction Summary
================================================================================
Install  17 Packages

Total download size: 12 M
Installed size: 46 M
Downloading Packages:
(1/17): containers-common-1.2.0-1.fc31.x86_64.r 189 kB/s |  47 kB     00:00    
(2/17): crun-0.15-5.fc31.x86_64.rpm             395 kB/s | 186 kB     00:00    
(3/17): fuse-overlayfs-1.2.0-1.fc31.x86_64.rpm  659 kB/s |  68 kB     00:00    
(4/17): libslirp-4.1.0-2.fc31.x86_64.rpm        608 kB/s |  67 kB     00:00    
(5/17): criu-3.14-1.fc31.x86_64.rpm             492 kB/s | 505 kB     00:01    
(6/17): slirp4netns-1.1.4-1.fc31.x86_64.rpm     386 kB/s |  51 kB     00:00    
(7/17): fuse-common-3.6.2-1.fc31.x86_64.rpm      26 kB/s | 7.8 kB     00:00    
(8/17): fuse3-3.6.2-1.fc31.x86_64.rpm           100 kB/s |  54 kB     00:00    
(9/17): buildah-1.16.4-1.fc31.x86_64.rpm        3.5 MB/s | 8.1 MB     00:02    
(10/17): fuse3-libs-3.6.2-1.fc31.x86_64.rpm     288 kB/s |  92 kB     00:00    
(11/17): runc-1.0.0-102.dev.gitdc9208a.fc31.x86 1.8 MB/s | 2.7 MB     00:01    
(12/17): libbsd-0.9.1-4.fc31.x86_64.rpm         403 kB/s | 101 kB     00:00    
(13/17): kmod-26-4.fc31.x86_64.rpm              348 kB/s | 122 kB     00:00    
(14/17): libnet-1.1.6-18.fc31.x86_64.rpm        267 kB/s |  64 kB     00:00    
(15/17): yajl-2.1.0-13.fc31.x86_64.rpm          326 kB/s |  39 kB     00:00    
(16/17): protobuf-c-1.3.1-3.fc31.x86_64.rpm     255 kB/s |  35 kB     00:00    
(17/17): libnl3-3.5.0-1.fc31.x86_64.rpm         636 kB/s | 331 kB     00:00    
--------------------------------------------------------------------------------
Total                                           2.5 MB/s |  12 MB     00:05     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : fuse3-libs-3.6.2-1.fc31.x86_64                        1/17 
  Installing       : yajl-2.1.0-13.fc31.x86_64                             2/17 
  Installing       : crun-0.15-5.fc31.x86_64                               3/17 
  Installing       : protobuf-c-1.3.1-3.fc31.x86_64                        4/17 
  Installing       : libnl3-3.5.0-1.fc31.x86_64                            5/17 
  Installing       : libnet-1.1.6-18.fc31.x86_64                           6/17 
  Installing       : libbsd-0.9.1-4.fc31.x86_64                            7/17 
  Installing       : criu-3.14-1.fc31.x86_64                               8/17 
  Installing       : kmod-26-4.fc31.x86_64                                 9/17 
  Installing       : fuse-common-3.6.2-1.fc31.x86_64                      10/17 
  Installing       : fuse3-3.6.2-1.fc31.x86_64                            11/17 
  Installing       : fuse-overlayfs-1.2.0-1.fc31.x86_64                   12/17 
  Running scriptlet: fuse-overlayfs-1.2.0-1.fc31.x86_64                   12/17 
  Installing       : libslirp-4.1.0-2.fc31.x86_64                         13/17 
  Installing       : slirp4netns-1.1.4-1.fc31.x86_64                      14/17 
  Installing       : containers-common-1:1.2.0-1.fc31.x86_64              15/17 
  Installing       : buildah-1.16.4-1.fc31.x86_64                         16/17 
  Installing       : runc-2:1.0.0-102.dev.gitdc9208a.fc31.x86_64          17/17 
  Running scriptlet: runc-2:1.0.0-102.dev.gitdc9208a.fc31.x86_64          17/17 
  Verifying        : buildah-1.16.4-1.fc31.x86_64                          1/17 
  Verifying        : containers-common-1:1.2.0-1.fc31.x86_64               2/17 
  Verifying        : criu-3.14-1.fc31.x86_64                               3/17 
  Verifying        : crun-0.15-5.fc31.x86_64                               4/17 
  Verifying        : fuse-overlayfs-1.2.0-1.fc31.x86_64                    5/17 
  Verifying        : libslirp-4.1.0-2.fc31.x86_64                          6/17 
  Verifying        : runc-2:1.0.0-102.dev.gitdc9208a.fc31.x86_64           7/17 
  Verifying        : slirp4netns-1.1.4-1.fc31.x86_64                       8/17 
  Verifying        : fuse-common-3.6.2-1.fc31.x86_64                       9/17 
  Verifying        : fuse3-3.6.2-1.fc31.x86_64                            10/17 
  Verifying        : fuse3-libs-3.6.2-1.fc31.x86_64                       11/17 
  Verifying        : kmod-26-4.fc31.x86_64                                12/17 
  Verifying        : libbsd-0.9.1-4.fc31.x86_64                           13/17 
  Verifying        : libnet-1.1.6-18.fc31.x86_64                          14/17 
  Verifying        : libnl3-3.5.0-1.fc31.x86_64                           15/17 
  Verifying        : protobuf-c-1.3.1-3.fc31.x86_64                       16/17 
  Verifying        : yajl-2.1.0-13.fc31.x86_64                            17/17 

Installed:
  buildah-1.16.4-1.fc31.x86_64                                                  
  containers-common-1:1.2.0-1.fc31.x86_64                                       
  criu-3.14-1.fc31.x86_64                                                       
  crun-0.15-5.fc31.x86_64                                                       
  fuse-common-3.6.2-1.fc31.x86_64                                               
  fuse-overlayfs-1.2.0-1.fc31.x86_64                                            
  fuse3-3.6.2-1.fc31.x86_64                                                     
  fuse3-libs-3.6.2-1.fc31.x86_64                                                
  kmod-26-4.fc31.x86_64                                                         
  libbsd-0.9.1-4.fc31.x86_64                                                    
  libnet-1.1.6-18.fc31.x86_64                                                   
  libnl3-3.5.0-1.fc31.x86_64                                                    
  libslirp-4.1.0-2.fc31.x86_64                                                  
  protobuf-c-1.3.1-3.fc31.x86_64                                                
  runc-2:1.0.0-102.dev.gitdc9208a.fc31.x86_64                                   
  slirp4netns-1.1.4-1.fc31.x86_64                                               
  yajl-2.1.0-13.fc31.x86_64                                                     

Complete!
Removing intermediate container e42d2dc3ec79
 ---> 8522b1a3ff13
Step 6/10 : COPY containers/docker-packager/registries.conf      containers/docker-packager/storage.conf      /etc/containers/
 ---> a23f4b28d82c
Step 7/10 : COPY packagers/docker/requirements.txt "${WORK_DIR}/packagers/docker/requirements.txt"
 ---> f480a3c3bac7
Step 8/10 : RUN pip3 install -r "${WORK_DIR}/packagers/docker/requirements.txt"
 ---> Running in 1e6dda214bb2
WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.
Collecting odahu-flow-sdk==1.0.0rc35 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/73/fa/8ffa05026c2f3f26a2f46c6515eb3153a3d997883c8e05088d3bedb69ad0/odahu_flow_sdk-1.0.0rc35-py2.py3-none-any.whl (201kB)
Collecting click>=7.0 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 2))
  Downloading https://files.pythonhosted.org/packages/d2/3d/fa76db83bf75c4f8d338c2fd15c8d33fdd7ad23a9b5e57eb6c5de26b430e/click-7.1.2-py2.py3-none-any.whl (82kB)
Collecting urllib3>=1.24.3 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 3))
  Downloading https://files.pythonhosted.org/packages/56/aa/4ef5aa67a9a62505db124a5cb5262332d1d4153462eb8fd89c9fa41e5d92/urllib3-1.25.11-py2.py3-none-any.whl (127kB)
Collecting pyyaml>=3.1.2 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 4))
  Downloading https://files.pythonhosted.org/packages/64/c2/b80047c7ac2478f9501676c988a5411ed5572f35d1beff9cae07d321512c/PyYAML-5.3.1.tar.gz (269kB)
Collecting pydantic>=1.2 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 5))
  Downloading https://files.pythonhosted.org/packages/25/69/4be0f2caa2ae3424cd34c0f934b460a02f01aa6897b1d58fc056664b15b7/pydantic-1.6.1-py36.py37.py38-none-any.whl (99kB)
Collecting docker (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 6))
  Downloading https://files.pythonhosted.org/packages/9e/8c/8d42dbd83679483db207535f4fb02dc84325fa78b290f057694b057fcd21/docker-4.3.1-py2.py3-none-any.whl (145kB)
Collecting botocore>=1.12.75 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 7))
  Downloading https://files.pythonhosted.org/packages/2b/55/9347e51769db0fe3487ed2ae5f438b3cc6aa2916e5e9d05e60a04855373e/botocore-1.19.4-py2.py3-none-any.whl (6.7MB)
Collecting boto3>=1.9.75 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 8))
  Downloading https://files.pythonhosted.org/packages/cc/a8/b5037dc144e458b3574c085d891b85ab2035b63ab946b5c91c23f2dfc1c6/boto3-1.16.4-py2.py3-none-any.whl (129kB)
Collecting jinja2>=2.7.3 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 9))
  Downloading https://files.pythonhosted.org/packages/30/9e/f663a2aa66a09d838042ae1a2c5659828bb9b41ea3a6efa20a20fd92b121/Jinja2-2.11.2-py2.py3-none-any.whl (125kB)
Collecting jsonschema>=3.2 (from -r /opt/odahu-flow/packagers/docker/requirements.txt (line 10))
  Downloading https://files.pythonhosted.org/packages/c5/8f/51e89ce52a085483359217bc72cdbf6e75ee595d5b1d4b5ade40c7e018b8/jsonschema-3.2.0-py2.py3-none-any.whl (56kB)
Collecting aiohttp>=3.6.2 (from odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/4f/a4/4c8827bf59bfa85088518c3ddf5ca20ed9373b002d8039eca9541f7461b9/aiohttp-3.7.1.tar.gz (1.1MB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Collecting requests>=2.22.0 (from odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/45/1e/0c169c6a5381e241ba7404532c16a21d86ab872c9bed8bdcd4c423954103/requests-2.24.0-py2.py3-none-any.whl (61kB)
Collecting six>=1.4.0 (from docker->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 6))
  Downloading https://files.pythonhosted.org/packages/ee/ff/48bde5c0f013094d729fe4b0316ba2a24774b3ff1c52d924a8a4cb04078a/six-1.15.0-py2.py3-none-any.whl
Collecting websocket-client>=0.32.0 (from docker->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 6))
  Downloading https://files.pythonhosted.org/packages/4c/5f/f61b420143ed1c8dc69f9eaec5ff1ac36109d52c80de49d66e0c36c3dfdf/websocket_client-0.57.0-py2.py3-none-any.whl (200kB)
Collecting jmespath<1.0.0,>=0.7.1 (from botocore>=1.12.75->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 7))
  Downloading https://files.pythonhosted.org/packages/07/cb/5f001272b6faeb23c1c9e0acc04d48eaaf5c862c17709d20e3469c6e0139/jmespath-0.10.0-py2.py3-none-any.whl
Collecting python-dateutil<3.0.0,>=2.1 (from botocore>=1.12.75->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 7))
  Downloading https://files.pythonhosted.org/packages/d4/70/d60450c3dd48ef87586924207ae8907090de0b306af2bce5d134d78615cb/python_dateutil-2.8.1-py2.py3-none-any.whl (227kB)
Collecting s3transfer<0.4.0,>=0.3.0 (from boto3>=1.9.75->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 8))
  Downloading https://files.pythonhosted.org/packages/69/79/e6afb3d8b0b4e96cefbdc690f741d7dd24547ff1f94240c997a26fa908d3/s3transfer-0.3.3-py2.py3-none-any.whl (69kB)
Collecting MarkupSafe>=0.23 (from jinja2>=2.7.3->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 9))
  Downloading https://files.pythonhosted.org/packages/98/7b/ff284bd8c80654e471b769062a9b43cc5d03e7a615048d96f4619df8d420/MarkupSafe-1.1.1-cp37-cp37m-manylinux1_x86_64.whl
Collecting pyrsistent>=0.14.0 (from jsonschema>=3.2->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 10))
  Downloading https://files.pythonhosted.org/packages/4d/70/fd441df751ba8b620e03fd2d2d9ca902103119616f0f6cc42e6405035062/pyrsistent-0.17.3.tar.gz (106kB)
Collecting importlib-metadata; python_version < "3.8" (from jsonschema>=3.2->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 10))
  Downloading https://files.pythonhosted.org/packages/6d/6d/f4bb28424bc677bce1210bc19f69a43efe823e294325606ead595211f93e/importlib_metadata-2.0.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in /usr/lib/python3.7/site-packages (from jsonschema>=3.2->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 10)) (41.6.0)
Collecting attrs>=17.4.0 (from jsonschema>=3.2->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 10))
  Downloading https://files.pythonhosted.org/packages/14/df/479736ae1ef59842f512548bacefad1abed705e400212acba43f9b0fa556/attrs-20.2.0-py2.py3-none-any.whl (48kB)
Collecting typing-extensions>=3.6.5 (from aiohttp>=3.6.2->odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/60/7a/e881b5abb54db0e6e671ab088d079c57ce54e8a01a3ca443f561ccadb37e/typing_extensions-3.7.4.3-py3-none-any.whl
Collecting yarl<2.0,>=1.0 (from aiohttp>=3.6.2->odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/6d/0b/44006eb5b3b7898e54df4b7481839d22d15cf3fc4f0420394ad9e3bb214e/yarl-1.6.2.tar.gz (177kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Collecting chardet<4.0,>=2.0 (from aiohttp>=3.6.2->odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
Collecting async-timeout<4.0,>=3.0 (from aiohttp>=3.6.2->odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/e1/1e/5a4441be21b0726c4464f3f23c8b19628372f606755a9d2e46c187e65ec4/async_timeout-3.0.1-py3-none-any.whl
Collecting multidict<7.0,>=4.5 (from aiohttp>=3.6.2->odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/d2/5a/e95b0f9ebacd42e094e229a9a0a9e44d02876abf64969d0cb07dadcf3c4a/multidict-5.0.0.tar.gz (53kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Collecting certifi>=2017.4.17 (from requests>=2.22.0->odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/5e/c4/6c4fe722df5343c33226f0b4e0bb042e4dc13483228b4718baf286f86d87/certifi-2020.6.20-py2.py3-none-any.whl (156kB)
Collecting idna<3,>=2.5 (from requests>=2.22.0->odahu-flow-sdk==1.0.0rc35->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/a2/38/928ddce2273eaa564f6f50de919327bf3a00f091b5baba8dfa9460f3a8a8/idna-2.10-py2.py3-none-any.whl (58kB)
Collecting zipp>=0.5 (from importlib-metadata; python_version < "3.8"->jsonschema>=3.2->-r /opt/odahu-flow/packagers/docker/requirements.txt (line 10))
  Downloading https://files.pythonhosted.org/packages/92/01/d39a8a821b1f9fcd88e6f4981a06143914805525b4608fb9660e2c498f7d/zipp-3.3.2-py3-none-any.whl
Building wheels for collected packages: aiohttp, yarl, multidict
  Building wheel for aiohttp (PEP 517): started
  Building wheel for aiohttp (PEP 517): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/49/ba/12/4fc41e681a538175e3691af34e90f3bf37d2489154cd718282
  Building wheel for yarl (PEP 517): started
  Building wheel for yarl (PEP 517): finished with status 'error'
  ERROR: Complete output from command /usr/bin/python3 /usr/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /tmp/tmp0uyk1odp:
  ERROR: **********************
  * Accellerated build *
  **********************
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.7
  creating build/lib.linux-x86_64-3.7/yarl
  copying yarl/_quoting_py.py -> build/lib.linux-x86_64-3.7/yarl
  copying yarl/_quoting.py -> build/lib.linux-x86_64-3.7/yarl
  copying yarl/__init__.py -> build/lib.linux-x86_64-3.7/yarl
  copying yarl/_url.py -> build/lib.linux-x86_64-3.7/yarl
  running egg_info
  writing yarl.egg-info/PKG-INFO
  writing dependency_links to yarl.egg-info/dependency_links.txt
  writing requirements to yarl.egg-info/requires.txt
  writing top-level names to yarl.egg-info/top_level.txt
  reading manifest file 'yarl.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no previously-included files matching '*.pyc' found anywhere in distribution
  warning: no previously-included files matching '*.cache' found anywhere in distribution
  warning: no previously-included files found matching 'yarl/*.html'
  warning: no previously-included files found matching 'yarl/*.so'
  warning: no previously-included files found matching 'yarl/*.pyd'
  no previously-included directories found matching 'docs/_build'
  writing manifest file 'yarl.egg-info/SOURCES.txt'
  copying yarl/__init__.pyi -> build/lib.linux-x86_64-3.7/yarl
  copying yarl/_quoting_c.c -> build/lib.linux-x86_64-3.7/yarl
  copying yarl/_quoting_c.pyi -> build/lib.linux-x86_64-3.7/yarl
  copying yarl/_quoting_c.pyx -> build/lib.linux-x86_64-3.7/yarl
  copying yarl/py.typed -> build/lib.linux-x86_64-3.7/yarl
  running build_ext
  building 'yarl._quoting_c' extension
  creating build/temp.linux-x86_64-3.7
  creating build/temp.linux-x86_64-3.7/yarl
  gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/python3.7m -c yarl/_quoting_c.c -o build/temp.linux-x86_64-3.7/yarl/_quoting_c.o
  error: command 'gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for yarl
  Running setup.py clean for yarl
  Building wheel for multidict (PEP 517): started
  Building wheel for multidict (PEP 517): finished with status 'error'
  ERROR: Complete output from command /usr/bin/python3 /usr/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /tmp/tmpemqt26_q:
  ERROR: **********************
  * Accellerated build *
  **********************
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.7
  creating build/lib.linux-x86_64-3.7/multidict
  copying multidict/_abc.py -> build/lib.linux-x86_64-3.7/multidict
  copying multidict/_multidict_base.py -> build/lib.linux-x86_64-3.7/multidict
  copying multidict/_multidict_py.py -> build/lib.linux-x86_64-3.7/multidict
  copying multidict/_compat.py -> build/lib.linux-x86_64-3.7/multidict
  copying multidict/__init__.py -> build/lib.linux-x86_64-3.7/multidict
  running egg_info
  writing multidict.egg-info/PKG-INFO
  writing dependency_links to multidict.egg-info/dependency_links.txt
  writing top-level names to multidict.egg-info/top_level.txt
  reading manifest file 'multidict.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no previously-included files matching '*.pyc' found anywhere in distribution
  warning: no previously-included files found matching 'multidict/_multidict.html'
  warning: no previously-included files found matching 'multidict/*.so'
  warning: no previously-included files found matching 'multidict/*.pyd'
  warning: no previously-included files found matching 'multidict/*.pyd'
  no previously-included directories found matching 'docs/_build'
  writing manifest file 'multidict.egg-info/SOURCES.txt'
  copying multidict/__init__.pyi -> build/lib.linux-x86_64-3.7/multidict
  copying multidict/_multidict.c -> build/lib.linux-x86_64-3.7/multidict
  copying multidict/py.typed -> build/lib.linux-x86_64-3.7/multidict
  creating build/lib.linux-x86_64-3.7/multidict/_multilib
  copying multidict/_multilib/defs.h -> build/lib.linux-x86_64-3.7/multidict/_multilib
  copying multidict/_multilib/dict.h -> build/lib.linux-x86_64-3.7/multidict/_multilib
  copying multidict/_multilib/istr.h -> build/lib.linux-x86_64-3.7/multidict/_multilib
  copying multidict/_multilib/iter.h -> build/lib.linux-x86_64-3.7/multidict/_multilib
  copying multidict/_multilib/pair_list.h -> build/lib.linux-x86_64-3.7/multidict/_multilib
  copying multidict/_multilib/views.h -> build/lib.linux-x86_64-3.7/multidict/_multilib
  running build_ext
  building 'multidict._multidict' extension
  creating build/temp.linux-x86_64-3.7
  creating build/temp.linux-x86_64-3.7/multidict
  gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/python3.7m -c multidict/_multidict.c -o build/temp.linux-x86_64-3.7/multidict/_multidict.o -O2 -std=c99 -Wall -Wsign-compare -Wconversion -fno-strict-aliasing -pedantic
  error: command 'gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for multidict
  Running setup.py clean for multidict
Successfully built aiohttp
Failed to build yarl multidict
ERROR: Could not build wheels for yarl, multidict which use PEP 517 and cannot be installed directly

Mlflow database

https://www.mlflow.org/docs/latest/tracking.html#storage

Tasks:

~~two variants of the MLFlow deployment (with\w.o database)~~ Database should be used for backend storage
MLFlow DB upgrade
supports in cluster PG deployment as database for MLFlow. Database in PG is already present
~~suppots object storage configuration for MLFlow artifact store~~ This subtask applies to #10

Use MLFlow 1.9 Model Signatures to generate swagger for deployed model

log_model and save_model APIs now support saving model signatures (the model's input and output schema)
https://github.com/mlflow/mlflow/releases/tag/v1.9.0

We should get rid from our custom way to generate schema and use mlflow signatures that appear in 1.9 (or make it optional)

Formalize and document Training Toolchain API

We must formalize API that end user must implement to provide new training toolchain for ODAHU. (See Training Main step in image below – this step is considered as pluggable in ODAHU ecosystem)
Currently this API is requirement to implement Docker container with entrypoint that consumes model training manifest and produce GPPI model artifact in output directory
Check example of how SageMaker specify API for their training containers
https://github.com/aws/sagemaker-training-toolkit

Docker container with dependency

Downloading dependencies can take an amount of time. We have to allow starting training in a custom docker image.

Technically, we already allow it. But It is useless because we always create a new Conda environment, and a user cannot use prebuilt dependencies.

Support MLFlow artifact storage

Initial Issue Description:

As A Data Scientist I want to see MLFlow logged artifacts in MLFlow UI Dashboard

EDITED description:

It was considered as a bug, but actually MlFlow artifacts feature was never enabled in ODAHU.
To enable it all pods in ODAHU that interact with MlFlow artifacts must have permissions to read/write to Mlflow artifact storage. These pods are:

Mlflow tracking server
training pods that are able to train and register new model

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

Jobs

Jooble