Comments (6)
I had tried to use pbzip2 and other methods previously. The script uses dd with pv to monitor the data stream. When I did my testing using pbzip2 and others, I found them to be too slow when implemented this way. If you want to have a look at the code and let me know exactly how you'd suggest implementing pbzip2, I will do some testing and reassess.
from ovirt_simple_backup.
I'm doing a lot of testing right now using attached storage for backup (not NFS as you suggest on your manual), I have changed some code (backup_imaging.php) regarding pv and dd, I don't know why yet, but my storage it's about to handle about 20 Gbit (nvme) but the backup/imaging using pv and dd it's taking ages to do the backup (about 200Mbit only)... this is very slow for production environments, once i'm done on speed, I will check for this.
from ovirt_simple_backup.
I have a large SAN and I have tried everything for speed, NFS was the fastest in my tests. I use iSCSI on the SAN for all VM storage. I did try a ramdisk on the BackupVM using 10GBe and that was crazy fast, but not practical.
I am also looking at this for a possible addon as well: https://ovirt.org/develop/release-management/features/storage/incremental-backup/
from ovirt_simple_backup.
If I use fio tool to benchmark /mnt/backups I get 20Gbit, indeed pv+dd in the code can't go for more then 200Mbit, same machine, same disk!
from ovirt_simple_backup.
You probably did not find pbzip2 useful because your backup storage does not go faster then one of your CPU, so you don't take any performance gain from doing parallel bzip2.
Meaning, one cpu doing ZIP was enough to fulfill your storage, if that's the case, pbzip2 was only doing overhead and getting the process worst/slow.
from ovirt_simple_backup.
In testing, pbzip2 seems to fail almost all of the time. I have done some recoding to get the other features into the project, but pbzip2 will fail on local storage in almost every test I run. The disk ends up partially corrupt and I have to fsck at best. Using LZO there is no issue at all and every test passes. I am pushing out the code with warnings on the pbzip2 and bzip2 settings, feel free to test and let me know what you find.
from ovirt_simple_backup.
Related Issues (20)
- exclude "lost+found" from restore HOT 1
- Wrong Drive Letter when backup HOT 10
- Log file is on Centos is not parsing \n =, each event in this same line HOT 1
- Option `First Backup Disk` doesn't work correctly HOT 1
- NFS on Fibre Channel LUN HOT 4
- Backup complited with 0% HOT 13
- backup stop if we change focus HOT 3
- scsi remove when detach HOT 21
- vms list fails to display when too many vms HOT 8
- Snapshot only backups HOT 2
- [RFE] add disk selection HOT 3
- Backup Failed Disk not attached. ovirt 4.3 HOT 7
- Strange behavior when backing up. Backup fails. HOT 10
- Post-installation Issues HOT 5
- Possible commit this HOT 9
- Documentation for migrating Windows machines from XenServer to oVirt HOT 1
- Typo in the code HOT 3
- The backup VM has too many disks attached. Please remove all but the OS disk in order to preform a backup. HOT 4
- Restore steps destory OvirtSimpleBackupVm image disks HOT 18
- Need assistance
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ovirt_simple_backup.