Welcome Guest. Please Login or Register  


You are here: Index > Virtualizor - Virtual Server Control Panel > Suggestions > Topic : Way Faster VPS backups



Normal Mode | Print  

Way Faster VPS backups
domainscoza
Group: NOC
Post Group: Newbie
Posts: 17
Status:
Quote From : wolke July 18, 2019, 10:11 am
There might be an even better alternative than lzop, specially when it comes to cpu time. I´am not into academic overoptimization but it seems that´s worth testing under reallife conditions.

Source: https://hannuhartikainen.fi/blog/everyday-compression-tool/

Abstract:
tool    filesize      time  CPU time
pigz      35125348    1.46    8.82
lbzip2  20301117      5.33  32.16
pixz    19333820      34.90  211.77
pzstd  39684543      0.45  2.51



Great find, this is really impressive:

Using Lzop:

Code
[root@node02]# time /bin/dd if=/dev/kvmvg/backup-v1002 bs=24M iflag=direct | /bin/lzop -2 > /backup/backup-v1002-lzop.tar.gz
512+0 records in
512+0 records out
12884901888 bytes (13 GB) copied, 53.2806 s, 242 MB/s

real    0m53.527s
user    0m21.149s
sys    0m28.381s


Using pzstd:

Code
[root@node02]# whereis pzstd
pzstd: /usr/bin/pzstd /usr/share/man/man1/pzstd.1.gz
[root@node02 tmp]# time /bin/dd if=/dev/kvmvg/backup-v1002 bs=24M iflag=direct | /usr/bin/pzstd -2 > /backup/backup-v1002.tar.gz
512+0 records in
512+0 records out
12884901888 bytes (13 GB) copied, 20.8995 s, 617 MB/s

real    0m23.406s
user    0m51.984s
sys    0m25.450s


Whats interesting is that the filesize with lzop is 5.1GB and with pzstd it's 3.8GB

Edited by domainscoza : July 22, 2019, 5:11 am
IP: --   


Threads
 domainscoza   Way Faster VPS backups (31 Replies, Read 576497 times)
    |--  wolke   impressive. Will check...   on November 8, 2018, 10:41 am
    |--  kaushal   Hi, Sorry for...   on November 28, 2018, 7:45 am
    |--  wolke   Would´nt it be...   on November 28, 2018, 11:58 am
    |--  domainscoza   pigz is good...   on November 28, 2018, 12:45 pm
    |--  wolke   hmm I did...   on November 28, 2018, 1:00 pm
    |--  domainscoza   hmm I did...   on November 28, 2018, 2:56 pm
    |--  wolke   I would bet...   on November 28, 2018, 3:00 pm
    |--  domainscoza   I would bet...   on November 29, 2018, 8:23 am
    |--  kaushal   Hi, Thanks @wolke...   on November 29, 2018, 9:48 am
    |--  happym3   nice information shared,...   on May 20, 2019, 9:32 pm
    |--  happym3   Softaculous are doing...   on May 20, 2019, 9:34 pm
    |--  domainscoza   Just an update...   on May 21, 2019, 3:51 am
    |--  wolke   Thanks for sharing...   on May 21, 2019, 9:20 am
    |--  domainscoza   Thanks for sharing...   on May 21, 2019, 10:50 am
    |--  wolke   replacing the symlink...   on July 18, 2019, 8:14 am
    |--  domainscoza   Hi, Thanks for...   on July 18, 2019, 8:46 am
    |--  wolke   There might be...   on July 18, 2019, 10:11 am
    |--  domainscoza   There might be...   on July 22, 2019, 5:09 am
    |--  wolke   Great results! @softacoulus:...   on July 22, 2019, 9:26 am
    |--  factoriadigital   Great results! @softacoulus:...   on December 31, 2019, 8:52 pm
    |--  Automata   I've already logged...   on January 12, 2020, 6:47 am
    |--  mkools   Great topic, will...   on January 13, 2020, 2:26 pm
    |--  factoriadigital   For @softaculous or...   on March 18, 2020, 4:02 pm
    |--  wolke   Unfortunately Virtualizor still...   on March 26, 2020, 8:11 am
    |--  domainscoza   Unfortunately Virtualizor still...   on March 26, 2020, 10:04 am
    |--  wolke   We been using...   on March 26, 2020, 1:04 pm
    |--  jasavps   Unfortunately Virtualizor still...   on April 13, 2020, 11:03 pm
    |--  domainscoza   @chirag @softaculous When...   on January 22, 2021, 7:44 am
    |--  ServerAstra   1 year later...   on February 5, 2022, 7:40 pm
    |--  chirag   Hi, We have...   on February 10, 2022, 6:11 am
    |--  wolke   Big THUMBS UP...   on February 10, 2022, 12:53 pm

« Previous    Next »

Normal Mode | Print  



Users viewing this topic
11 guests, 0 users.


All times are GMT. The time now is April 30, 2025, 11:16 am.

  Powered By AEF 1.0.8 © 2007-2008 Electron Inc.Queries: 10  |  Page Created In:1.486