xilonz / trellis-backup-role Goto Github PK

vault_wordpress_sites:
  site.com:
    env:
      db_password: "password"
      # Generate your keys here: https://roots.io/salts.html
      auth_key: "xxx"
      secure_auth_key: "xxx"
      logged_in_key: "xxx"
      nonce_key: "xxx"
      auth_salt: "xxx"
      secure_auth_salt: "xxx"
      logged_in_salt: "xxx"
      nonce_salt: "xxx"
      backup_target_user: "XXXXXXXXXXXXX"
      backup_target_pass: "XXXXXXXXXXXXX"

 backup_target_user: user
 backup_target_pass: password

--- Start running command BKP at 19:45:03.879 ---
LFTP version is 4.8.4
Reading globbing filelist /etc/duply/marcinkujanek.pl_uploads/exclude
Attempt 1 failed. BackendException: Error running 'lftp -c "source /tmp/duplicity-etq94hg0-tempdir/mkstemp-umg8ffmk-1; ( cd uploads/ && ls ) || ( mkdir -p uploads/ && cd uploads/ && ls )"': returned 1, with output:

open: Not connected
cd: Not connected
mkdir: Not connected


Attempt 2 failed. BackendException: Error running 'lftp -c "source /tmp/duplicity-etq94hg0-tempdir/mkstemp-umg8ffmk-1; ( cd uploads/ && ls ) || ( mkdir -p uploads/ && cd uploads/ && ls )"': returned 1, with output:

open: Not connected
cd: Not connected
mkdir: Not connected


Attempt 3 failed. BackendException: Error running 'lftp -c "source /tmp/duplicity-etq94hg0-tempdir/mkstemp-umg8ffmk-1; ( cd uploads/ && ls ) || ( mkdir -p uploads/ && cd uploads/ && ls )"': returned 1, with output:

open: Not connected
cd: Not connected
mkdir: Not connected


Attempt 4 failed. BackendException: Error running 'lftp -c "source /tmp/duplicity-etq94hg0-tempdir/mkstemp-umg8ffmk-1; ( cd uploads/ && ls ) || ( mkdir -p uploads/ && cd uploads/ && ls )"': returned 1, with output:

open: Not connected
cd: Not connected
mkdir: Not connected


Giving up after 5 attempts. BackendException: Error running 'lftp -c "source /tmp/duplicity-etq94hg0-tempdir/mkstemp-umg8ffmk-1; ( cd uploads/ && ls ) || ( mkdir -p uploads/ && cd uploads/ && ls )"': returned 1, with output:

open: Not connected
cd: Not connected
mkdir: Not connected


19:47:05.072 Task 'BKP' failed with exit code '50'.
--- Finished state FAILED 'code 50' at 19:47:05.072 - Runtime 00:02:01.193 ---

vault_wordpress_sites:
  example.com:
    env:
      backup_target_user: <App key>
      backup_target_pass: <App secret>

wordpress_sites:
  example.com:
    env:
      backup:
        <insert other role variables from example in documentation>
        params:
        - 'export DPBX_ACCESS_TOKEN="<Generate Access Token from inside Dropbox App Settinngs>"'

the field 'args' has an invalid value, which appears to include a variable that is undefined. The error was: 'vault_mysql_backup_password' is undefined

The error appears to have been in '/<path to site>/trellis/vendor/roles/trellis-backup/tasks/main.yml': line 16, column 3, but may be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:


- name: Create backup mysql user
  ^ here

fatal: [default]: FAILED! => {"failed": true}

Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.

TASK [trellis-backup : Ensure paramiko is installed] ***************************
System info:
  Ansible 2.4.0.0; Vagrant 2.0.0; Linux
  Trellis at "Normalize `apt` tasks"
---------------------------------------------------
stdout: Collecting paramiko
  Using cached paramiko-2.3.1-py2.py3-none-any.whl
Collecting pynacl>=1.0.1 (from paramiko)
  Using cached PyNaCl-1.1.2-cp27-cp27mu-manylinux1_x86_64.whl
Collecting cryptography>=1.5 (from paramiko)
  Using cached cryptography-2.1-cp27-cp27mu-manylinux1_x86_64.whl

:stderr: Exception:
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 209, in
main
    status = self.run(options, args)
  File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 328,
in run
    wb.build(autobuilding=True)
  File "/usr/lib/python2.7/dist-packages/pip/wheel.py", line 748, in build
    self.requirement_set.prepare_files(self.finder)
  File "/usr/lib/python2.7/dist-packages/pip/req/req_set.py", line 360, in
prepare_files
    ignore_dependencies=self.ignore_dependencies))
  File "/usr/lib/python2.7/dist-packages/pip/req/req_set.py", line 647, in
_prepare_file
    set(req_to_install.extras) - set(dist.extras)
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line
2670, in extras
    return [dep for dep in self._dep_map if dep]
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line
2713, in _dep_map
    self.__dep_map = self._compute_dependencies()
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line
2723, in _compute_dependencies
    reqs.extend(parse_requirements(req))
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line
2781, in parse_requirements
    yield Requirement(line)
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line
2790, in __init__
    raise RequirementParseError(str(e))
RequirementParseError: Invalid requirement, parse error at "'; python'"
You are using pip version 8.1.1, however version 9.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

fatal: [default]: FAILED! => {"changed": false, "cmd": "/usr/bin/pip2 install paramiko", "failed": true}

RUNNING HANDLER [common : reload nginx] ****************************************
changed: [default]

RUNNING HANDLER [common : perform nginx reload] ********************************
changed: [default]
        to retry, use: --limit @/home/silumesii/example.com/trellis/dev.retry

PLAY RECAP *********************************************************************
default                    : ok=104  changed=7    unreachable=0    failed=1   

Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.

--- Start running command BKP at 12:15:09.047 ---
Traceback (innermost last):
  File "/usr/bin/duplicity", line 1581, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1567, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1406, in main
    action = commandline.ProcessCommandLine(sys.argv[1:])
  File "/usr/lib/python2.7/dist-packages/duplicity/commandline.py", line 1140, in ProcessCommandLine
    backup, local_pathname = set_backend(args[0], args[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/commandline.py", line 1015, in set_backend
    globals.backend = backend.get_backend(bend)
  File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 223, in get_backend
    obj = get_backend_object(url_string)
  File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 209, in get_backend_object
    return factory(pu)
  File "/usr/lib/python2.7/dist-packages/duplicity/backends/_boto_single.py", line 166, in __init__
    self.resetConnection()
  File "/usr/lib/python2.7/dist-packages/duplicity/backends/_boto_single.py", line 188, in resetConnection
    self.conn = get_connection(self.scheme, self.parsed_url, self.storage_uri)
  File "/usr/lib/python2.7/dist-packages/duplicity/backends/_boto_single.py", line 99, in get_connection
    is_secure=(not globals.s3_unencrypted_connection))
  File "/usr/lib/python2.7/dist-packages/boto/storage_uri.py", line 117, in connect
    **connection_args)
  File "/usr/lib/python2.7/dist-packages/boto/s3/connection.py", line 191, in __init__
    validate_certs=validate_certs, profile_name=profile_name)
  File "/usr/lib/python2.7/dist-packages/boto/connection.py", line 569, in __init__
    host, config, self.provider, self._required_auth_capability())
File "/usr/lib/python2.7/dist-packages/boto/auth.py", line 995, in get_auth_handler
    'Check your credentials' % (len(names), str(names)))
 NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were checked. ['S3HmacAuthV4Handler'] Check your credentials

    backup_target_user: user
    backup_target_pass: password

sudo duply website_name_database restore
sudo duply website_name_uploads restore

TASK [lafranceinsoumise.backup : Install dependencies] **************************************************************************************************************************************************************************
System info:
  Ansible 2.7.5; Linux
  Trellis version (per changelog): "Fix Vagrant trigger path"
---------------------------------------------------
'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options
::=--force-confold"     install 'python-boto' 's3cmd' 'duply'' failed: E:
Error, pkgProblemResolver::Resolve generated breaks, this may be caused by
held packages.

E: Error, pkgProblemResolver::Resolve generated breaks, this may be caused by
held packages.

fatal: [turquoise.pcsvps]: FAILED! => {"cache_update_time": 1545969942, "cache_updated": false, "changed": false, "rc": 100, "stderr_lines": ["E: Error, pkgProblemResolver::Resolve generated breaks, this may be caused by held packages."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSome packages could not be installed. This may mean that you have\nrequested an impossible situation or if you are using the unstable\ndistribution that some required packages have not yet been created\nor been moved out of Incoming.\nThe following information may help to resolve the situation:\n\nThe following packages have unmet dependencies:\n duply : Depends: duplicity (>= 0.4.11) but it is not going to be installed\n libssl1.1 : Breaks: python-boto (< 2.44.0-1.1) but 2.44.0-1ubuntu2 is to be installed\n python-boto : Depends: python-requests but it is not going to be installed\n               Depends: python:any (< 2.8)\n               Depends: python:any (>= 2.7.5-5~)\n               Depends: python-six but it is not going to be installed\n s3cmd : Depends: python3-dateutil but it is not going to be installed\n         Depends: python3-magic but it is not going to be installed\n         Depends: python3-distutils but it is not going to be installed\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Some packages could not be installed. This may mean that you have", "requested an impossible situation or if you are using the unstable", "distribution that some required packages have not yet been created", "or been moved out of Incoming.", "The following information may help to resolve the situation:", "", "The following packages have unmet dependencies:", " duply : Depends: duplicity (>= 0.4.11) but it is not going to be installed", " libssl1.1 : Breaks: python-boto (< 2.44.0-1.1) but 2.44.0-1ubuntu2 is to be installed", " python-boto : Depends: python-requests but it is not going to be installed", "               Depends: python:any (< 2.8)", "               Depends: python:any (>= 2.7.5-5~)", "               Depends: python-six but it is not going to be installed", " s3cmd : Depends: python3-dateutil but it is not going to be installed", "         Depends: python3-magic but it is not going to be installed", "         Depends: python3-distutils but it is not going to be installed"]}

TASK [lafranceinsoumise.backup : Install backup profile dependencies] **********
System info:
  Ansible 2.13.3; Darwin
  Trellis 1.16.0: July 18th, 2022
---------------------------------------------------
Invalid data passed to 'loop', it requires a list, got this instead:
[{'name': 'example.com_uploads', 'schedule': '0 4 * * *', 'source':
'/srv/www/example.com/shared/uploads', 'target':
's3://ams3.digitaloceanspaces.com/backups/example.com//uploads',
'target_user': False, 'target_pass': False, 'max_age': '3M', 'full_max_age':
'1M', 'max_full_backups': '3', 'params': ['export S3_USE_SIGV4="True"'],
'action': 'purge_backup --force'}] + [{'name': 'example.com_database',
'schedule': '0 4 * * *', 'source': 'mysql://example.com_production', 'target':
's3://ams3.digitaloceanspaces.com/backups/example.com//database',
'target_user': False, 'target_pass': False, 'max_age': '3M', 'full_max_age':
'1M', 'max_full_backups': '3', 'params': ['export S3_USE_SIGV4="True"'],
'action': 'purge_backup --force'}]. Hint: If you passed a list/dict of just
one element, try adding wantlist=True to your lookup invocation or use
q/query instead of lookup.
fatal: [159.223.217.50]: FAILED! => {}

TASK [trellis-backup : List backup jobs] ***************************************
 [WARNING]: when statements should not include jinja2 templating delimiters
such as {{ }} or {% %}. Found: {{ item.value.backup is defined and
item.value.backup.enabled | default(false) }}

System info:
  Ansible 2.3.2.0; Vagrant 1.9.7; Linux
  Trellis at "Option to install WP-CLI packages"
---------------------------------------------------
the field 'args' has an invalid value, which appears to include a variable
that is undefined. The error was: 'dict object' has no attribute
'backup_target_user'

The error appears to have been in '/home/silumesii/sites/example.com/trellis/vendor/roles/trellis-backup/tasks/main.yml': line
15, column 3, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:


- name: List backup jobs
  ^ here

fatal: [default]: FAILED! => {"failed": true}

TASK [lafranceinsoumise.backup : backup-configure | Ensure backup directories exist] *********
System info:
  Ansible 2.7.10; Linux
  Trellis 1.0.3: April 30th, 2019
---------------------------------------------------
'item' is undefined
fatal: [000.my.ip.000]: FAILED! => {}

    cache:
      enabled: false
    backup:
      enabled: true
      auto: true
      target: s3://my.bucket.url/
      schedule: '30 17 * * *'
      purge: false
      max_age: 1M
      full_max_age: 1M
      params:
       - 'export S3_USE_SIGV4="True"'

Start duply v2.2, time is 2020-12-13 17:09:08.
Using profile '/etc/duply/domain.com_database'.
Using installed duplicity version 0.8.12, python 3.8.5 (/usr/bin/python3), gpg 2.2.19 (Home: /root/.gnupg), awk 'GNU Awk 5.0.1, API: 2.0 (GNU MPFR 4.0.2, GNU MP 6.2.0)', grep 'grep (GNU grep) 3.4', bash '5.0.17(1)-release (x86_64-pc-linux-gnu)'.
Checking TEMP_DIR '/tmp' is a folder and writable (OK)
Test - En/Decryption skipped. (GPG disabled)

--- Start running command PRE at 17:09:08.691 ---
Running '/etc/duply/domain.com_database/pre' - OK
--- Finished state OK at 17:09:08.913 - Runtime 00:00:00.222 ---

--- Start running command BKP at 17:09:08.960 ---
Reading globbing filelist /etc/duply/domain.com_database/exclude
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: none
Last full backup is too old, forcing full backup
Attempt 1 failed. TypeError: list_file_names() takes from 4 to 6 positional arguments but 7 were given
Attempt 2 failed. TypeError: list_file_names() takes from 4 to 6 positional arguments but 7 were given
Attempt 3 failed. TypeError: list_file_names() takes from 4 to 6 positional arguments but 7 were given
Attempt 4 failed. TypeError: list_file_names() takes from 4 to 6 positional arguments but 7 were given
Attempt 5 failed. TypeError: list_file_names() takes from 4 to 6 positional arguments but 7 were given
--------------[ Backup Statistics ]--------------
StartTime 1607879351.00 (Sun Dec 13 17:09:10 2020)
EndTime 1607879351.21 (Sun Dec 13 17:09:11 2020)
ElapsedTime 0.22 (0.22 seconds)
SourceFiles 1
SourceFileSize 6301933 (6.01 MB)
NewFiles 1
NewFileSize 6301933 (6.01 MB)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 1
RawDeltaSize 6301933 (6.01 MB)
TotalDestinationSizeChange 1231613 (1.17 MB)
Errors 0
-------------------------------------------------

--- Finished state OK at 17:11:18.453 - Runtime 00:02:09.493 ---

--- Start running command POST at 17:11:18.515 ---
Running '/etc/duply/domain.com_database/post' - OK
--- Finished state OK at 17:11:18.544 - Runtime 00:00:00.029 ---