Welcome Guest. Please Login or Register  
Client Area  |  Softaculous Cloud  |  Calendar  |  Quick Links  |  
   


You are here: Index > Virtualizor - Virtual Server Control Panel > Suggestions > Topic : Way Faster VPS backups



Normal Mode | Print  

 Way Faster VPS backups (31 Replies, Read 643037 times)
domainscoza
November 8, 2018, 9:20 am
Group: NOC
Post Group: Newbie
Posts: 17
Status:
I've already logged a ticket for this, but if anyone is interested there is a much faster way to do VPS backups by switching out gzip for lzop compression.

Here is a the what the current virtualizor backup does:

Code
# lvcreate -L12G -s -n backup-v1001 /dev/kvmvg/vsv1001-dbbiylg3awl9iyka-ynfcfcgknopy4drs


# time /bin/dd if=/dev/kvmvg/backup-v1001 bs=24M iflag=direct | /bin/gzip -c > /backup/backup_v1001.img.gz

512+0 records in
512+0 records out
12884901888 bytes (13 GB) copied, 509.413 s, 25.3 MB/s

real    8m29.488s
user    8m15.028s
sys    0m18.228s



When switching the compression method to lzop:

Code

#  time /bin/dd if=/dev/kvmvg/backup-v1001 bs=24M iflag=direct | /bin/lzop -2 > /backup/backup_v1001.img.lzo
512+0 records in
512+0 records out
12884901888 bytes (13 GB) copied, 34.5307 s, 373 MB/s

real    0m39.789s
user    0m17.098s
sys      0m17.185s



Using gzip : 25.3MB/s and 8min 29 seconds for the backup to complete.
Using lzop : 373MB/s and 38 seconds for the backup to complete.

That is a 1300% increase in backup speed and in reduction in backup time.

Note:
1) During these tests, gzip caused higher server load than lzop (lzop was marginally better).
2) The lzop backup was slightly larger than the gzip (300MB on a 12GB disk), but storage is cheap.
3) The /backup directory is an NFS share from our NAS server, so this also writing is across the network.


We have requested Virtualizor to add this as a backup option, it would greatly help with backing / restoring VM's where hours turn into minutes.
IP: --   


Threads
 domainscoza   Way Faster VPS backups (31 Replies, Read 643037 times)
    |--  wolke   impressive. Will check...   on November 8, 2018, 10:41 am
    |--  kaushal   Hi, Sorry for...   on November 28, 2018, 7:45 am
    |--  wolke   Would´nt it be...   on November 28, 2018, 11:58 am
    |--  domainscoza   pigz is good...   on November 28, 2018, 12:45 pm
    |--  wolke   hmm I did...   on November 28, 2018, 1:00 pm
    |--  domainscoza   hmm I did...   on November 28, 2018, 2:56 pm
    |--  wolke   I would bet...   on November 28, 2018, 3:00 pm
    |--  domainscoza   I would bet...   on November 29, 2018, 8:23 am
    |--  kaushal   Hi, Thanks @wolke...   on November 29, 2018, 9:48 am
    |--  happym3   nice information shared,...   on May 20, 2019, 9:32 pm
    |--  happym3   Softaculous are doing...   on May 20, 2019, 9:34 pm
    |--  domainscoza   Just an update...   on May 21, 2019, 3:51 am
    |--  wolke   Thanks for sharing...   on May 21, 2019, 9:20 am
    |--  domainscoza   Thanks for sharing...   on May 21, 2019, 10:50 am
    |--  wolke   replacing the symlink...   on July 18, 2019, 8:14 am
    |--  domainscoza   Hi, Thanks for...   on July 18, 2019, 8:46 am
    |--  wolke   There might be...   on July 18, 2019, 10:11 am
    |--  domainscoza   There might be...   on July 22, 2019, 5:09 am
    |--  wolke   Great results! @softacoulus:...   on July 22, 2019, 9:26 am
    |--  factoriadigital   Great results! @softacoulus:...   on December 31, 2019, 8:52 pm
    |--  Automata   I've already logged...   on January 12, 2020, 6:47 am
    |--  mkools   Great topic, will...   on January 13, 2020, 2:26 pm
    |--  factoriadigital   For @softaculous or...   on March 18, 2020, 4:02 pm
    |--  wolke   Unfortunately Virtualizor still...   on March 26, 2020, 8:11 am
    |--  domainscoza   Unfortunately Virtualizor still...   on March 26, 2020, 10:04 am
    |--  wolke   We been using...   on March 26, 2020, 1:04 pm
    |--  jasavps   Unfortunately Virtualizor still...   on April 13, 2020, 11:03 pm
    |--  domainscoza   @chirag @softaculous When...   on January 22, 2021, 7:44 am
    |--  ServerAstra   1 year later...   on February 5, 2022, 7:40 pm
    |--  chirag   Hi, We have...   on February 10, 2022, 6:11 am
    |--  wolke   Big THUMBS UP...   on February 10, 2022, 12:53 pm

« Previous    Next »

Normal Mode | Print  



Users viewing this topic
1 guests, 0 users.


All times are GMT. The time now is November 4, 2025, 1:24 am.

  Powered By AEF 1.0.8 © 2007-2008 Electron Inc.Queries: 10  |  Page Created In:0.013