What is you backup strategy?

by Zerker

Zerker
Junior Member
Kohai
Posts: 6
Threads: 2
Joined: Apr 2017
Reputation: 0
09-29-2017, 11:10 AM
#73167 (1)
I mean private files backup.
Sooner or later you probably gather some documents which require backup and maybe even encryption. I'm about to create some script to automate my backup process including synchronizing LUKS containers, but I wonder if you can recommend some open source software or good practices for private backups?
malmon
I ♥ ϗ
Neko
Posts: 2,919
Threads: 38
Joined: Nov 2015
Reputation: 21
09-29-2017, 11:23 AM
#73169 (2)
I personally use Duplicati 2 with a Google Drive backend. Not sure I would recommend it as of right now, as the software is still pretty unstable.

[Image: 68747470733a2f2f63646e2e706272642e636f2f...612e676966]
„こころゆらゆらゆれてる”
RX14
Senko-san
Optimist
Posts: 985
Threads: 9
Joined: Nov 2015
Reputation: 7
09-29-2017, 03:34 PM
#73172 (3)
For my laptop, i simply use syncthing to back it up to my home server. It's very good at traversing NAT. For my servers, I use backblaze b2, which is cheap enough to be competitive with cold storage yet is fairly instant, like s3.

[Image: 68747470733a2f2f6177772e6d6f652f683731666e372e706e67]
English animemester
Zerker
Junior Member
Kohai
Posts: 6
Threads: 2
Joined: Apr 2017
Reputation: 0
09-29-2017, 06:15 PM
#73174 (4)
(09-29-2017, 11:23 AM)malmon Wrote: I personally use Duplicati 2 with a Google Drive backend. Not sure I would recommend it as of right now, as the software is still pretty unstable.
Idea of uploading backups incrementally seems nice to me.
(09-29-2017, 11:28 AM)Yuu Wrote: I learned to start with backups the hardway. My external hdd failed me recently... damn seagate strikes again.

I plan to build my own NAS device with a NAS Drive and maybe some sorta RAID. Maybe backup stuff there into encrypted containers and stuff. Depending on the content, I am thinking of doing extra cold storage backups online for stuff I won't touch for a long time. Recently saw Online.net new storage service, C14. Looks really cool: https://www.online.net/en/c14

But I honestly I have no real solid solution right now. Saving up money. But I plan to at least replace and get some more secondary disks just as maintaince. Also for most important stuff I keep it on different external hdds, devices and others. But maybe best is to memorize it :p
Do you have some specific setup for NAS on mind? I wonder how reliable would be Raspberry Pi with software RAID 1 from disks connected via USB hub. Throughput probably wouldn't be the best, but it's the cheapest home disk array with redundancy I can think of. I've also seen setups with Raspberry Pi and cheap hardware RAID controllers, but I have bad experience with this things - at least in server environment.
(09-29-2017, 03:34 PM)RX14 Wrote: For my laptop, i simply use syncthing to back it up to my home server. It's very good at traversing NAT. For my servers, I use backblaze b2, which is cheap enough to be competitive with cold storage yet is fairly instant, like s3.
I see that Syncthing has even protocol designed especially for synchronization. Concept of setting up your own distributed storage cluster caught my attention. It seems to be quite sophisticated under user interface - I will have to research it.
Hexd
.
Thighdeology
Posts: 236
Threads: 16
Joined: May 2016
Reputation: 3
09-30-2017, 11:10 AM (This post was last modified: 09-30-2017, 11:16 AM by Hexd.)
#73185 (5)
(09-29-2017, 11:10 AM)Zerker Wrote: I mean private files backup.
Sooner or later you probably gather some documents which require backup and maybe even encryption. I'm about to create some script to automate my backup process including synchronizing LUKS containers, but I wonder if you can recommend some open source software or good practices for private backups?

For encryption I recommend VeraCrypt which is a maintained fork of TrueCrypt.



(09-29-2017, 06:15 PM)Zerker Wrote:
(09-29-2017, 11:23 AM)malmon Wrote: I personally use Duplicati 2 with a Google Drive backend. Not sure I would recommend it as of right now, as the software is still pretty unstable.
Idea of uploading backups incrementally seems nice to me.
(09-29-2017, 11:28 AM)Yuu Wrote: I learned to start with backups the hardway. My external hdd failed me recently... damn seagate strikes again.

I plan to build my own NAS device with a NAS Drive and maybe some sorta RAID. Maybe backup stuff there into encrypted containers and stuff. Depending on the content, I am thinking of doing extra cold storage backups online for stuff I won't touch for a long time. Recently saw Online.net new storage service, C14. Looks really cool: https://www.online.net/en/c14

But I honestly I have no real solid solution right now. Saving up money. But I plan to at least replace and get some more secondary disks just as maintaince. Also for most important stuff I keep it on different external hdds, devices and others. But maybe best is to memorize it :p
Do you have some specific setup for NAS on mind? I wonder how reliable would be Raspberry Pi with software RAID 1 from disks connected via USB hub. Throughput probably wouldn't be the best, but it's the cheapest home disk array with redundancy I can think of. I've also seen setups with Raspberry Pi and cheap hardware RAID controllers, but I have bad experience with this things - at least in server environment.
(09-29-2017, 03:34 PM)RX14 Wrote: For my laptop, i simply use syncthing to back it up to my home server. It's very good at traversing NAT. For my servers, I use backblaze b2, which is cheap enough to be competitive with cold storage yet is fairly instant, like s3.
I see that Syncthing has even protocol designed especially for synchronization. Concept of setting up your own distributed storage cluster caught my attention. It seems to be quite sophisticated under user interface - I will have to research it.

I used to use syncthing but got really turned off by it when it messed up my workflow since it would be syncing while I was editing a photoshop file and it almost ruined my .psd backups and current file I was working on. It saves multiple copies so i got to recover it but it was a hassle since all the copies were named randomnumber.tmp

Currently I have 2 1 TB hard drives, for all my stuff. a couple usb's for my important stuff (kept encrypted) and a server for off site backup of the important stuff

(09-29-2017, 11:23 AM)malmon Wrote: I personally use Duplicati 2 with a Google Drive backend. Not sure I would recommend it as of right now, as the software is still pretty unstable.



What's the benefit of Duplicati 2 over something like Syncthing?
malmon
I ♥ ϗ
Neko
Posts: 2,919
Threads: 38
Joined: Nov 2015
Reputation: 21
09-30-2017, 11:40 AM
#73186 (6)
(09-30-2017, 11:10 AM)Hexd Wrote:
(09-29-2017, 11:10 AM)Zerker Wrote: I mean private files backup.
Sooner or later you probably gather some documents which require backup and maybe even encryption. I'm about to create some script to automate my backup process including synchronizing LUKS containers, but I wonder if you can recommend some open source software or good practices for private backups?

For encryption I recommend VeraCrypt which is a maintained fork of TrueCrypt.



(09-29-2017, 06:15 PM)Zerker Wrote:
(09-29-2017, 11:23 AM)malmon Wrote: I personally use Duplicati 2 with a Google Drive backend. Not sure I would recommend it as of right now, as the software is still pretty unstable.
Idea of uploading backups incrementally seems nice to me.
(09-29-2017, 11:28 AM)Yuu Wrote: I learned to start with backups the hardway. My external hdd failed me recently... damn seagate strikes again.

I plan to build my own NAS device with a NAS Drive and maybe some sorta RAID. Maybe backup stuff there into encrypted containers and stuff. Depending on the content, I am thinking of doing extra cold storage backups online for stuff I won't touch for a long time. Recently saw Online.net new storage service, C14. Looks really cool: https://www.online.net/en/c14

But I honestly I have no real solid solution right now. Saving up money. But I plan to at least replace and get some more secondary disks just as maintaince. Also for most important stuff I keep it on different external hdds, devices and others. But maybe best is to memorize it :p
Do you have some specific setup for NAS on mind? I wonder how reliable would be Raspberry Pi with software RAID 1 from disks connected via USB hub. Throughput probably wouldn't be the best, but it's the cheapest home disk array with redundancy I can think of. I've also seen setups with Raspberry Pi and cheap hardware RAID controllers, but I have bad experience with this things - at least in server environment.
(09-29-2017, 03:34 PM)RX14 Wrote: For my laptop, i simply use syncthing to back it up to my home server. It's very good at traversing NAT. For my servers, I use backblaze b2, which is cheap enough to be competitive with cold storage yet is fairly instant, like s3.
I see that Syncthing has even protocol designed especially for synchronization. Concept of setting up your own distributed storage cluster caught my attention. It seems to be quite sophisticated under user interface - I will have to research it.

I used to use syncthing but got really turned off by it when it messed up my workflow since it would be syncing while I was editing a photoshop file and it almost ruined my .psd backups and current file I was working on. It saves multiple copies so i got to recover it but it was a hassle since all the copies were named randomnumber.tmp

Currently I have 2 1 TB hard drives, for all my stuff. a couple usb's for my important stuff (kept encrypted) and a server for off site backup of the important stuff

(09-29-2017, 11:23 AM)malmon Wrote: I personally use Duplicati 2 with a Google Drive backend. Not sure I would recommend it as of right now, as the software is still pretty unstable.



What's the benefit of Duplicati 2 over something like Syncthing?

Duplicati works with cloud providers. I don't personally have the storage necessary to backup all my stuff.

[Image: 68747470733a2f2f63646e2e706272642e636f2f...612e676966]
„こころゆらゆらゆれてる”
RX14
Senko-san
Optimist
Posts: 985
Threads: 9
Joined: Nov 2015
Reputation: 7
10-01-2017, 06:28 AM
#73194 (7)
(09-30-2017, 11:10 AM)Hexd Wrote:
(09-29-2017, 06:15 PM)Zerker Wrote:
(09-29-2017, 11:23 AM)malmon Wrote: I personally use Duplicati 2 with a Google Drive backend. Not sure I would recommend it as of right now, as the software is still pretty unstable.
Idea of uploading backups incrementally seems nice to me.
(09-29-2017, 11:28 AM)Yuu Wrote: I learned to start with backups the hardway. My external hdd failed me recently... damn seagate strikes again.

I plan to build my own NAS device with a NAS Drive and maybe some sorta RAID. Maybe backup stuff there into encrypted containers and stuff. Depending on the content, I am thinking of doing extra cold storage backups online for stuff I won't touch for a long time. Recently saw Online.net new storage service, C14. Looks really cool: https://www.online.net/en/c14

But I honestly I have no real solid solution right now. Saving up money. But I plan to at least replace and get some more secondary disks just as maintaince. Also for most important stuff I keep it on different external hdds, devices and others. But maybe best is to memorize it :p
Do you have some specific setup for NAS on mind? I wonder how reliable would be Raspberry Pi with software RAID 1 from disks connected via USB hub. Throughput probably wouldn't be the best, but it's the cheapest home disk array with redundancy I can think of. I've also seen setups with Raspberry Pi and cheap hardware RAID controllers, but I have bad experience with this things - at least in server environment.
(09-29-2017, 03:34 PM)RX14 Wrote: For my laptop, i simply use syncthing to back it up to my home server. It's very good at traversing NAT. For my servers, I use backblaze b2, which is cheap enough to be competitive with cold storage yet is fairly instant, like s3.
I see that Syncthing has even protocol designed especially for synchronization. Concept of setting up your own distributed storage cluster caught my attention. It seems to be quite sophisticated under user interface - I will have to research it.

I used to use syncthing but got really turned off by it when it messed up my workflow since it would be syncing while I was editing a photoshop file and it almost ruined my .psd backups and current file I was working on. It saves multiple copies so i got to recover it but it was a hassle since all the copies were named randomnumber.tmp

Currently I have 2 1 TB hard drives, for all my stuff. a couple usb's for my important stuff (kept encrypted) and a server for off site backup of the important stuff

I don't use syncthing for synchronisation. There's a "send-only mode" which means it'll never touch any files on your end, just send the changes to the remote. If the remote files change, then synchronisation stops. I don't like true synchronisation for the reasons you mentioned (no file locking means your files can be synced out from under you) but using syncthing just for backup is fine.

[Image: 68747470733a2f2f6177772e6d6f652f683731666e372e706e67]
English animemester
soulchild
Member
Kohai
Posts: 69
Threads: 3
Joined: Jun 2016
Reputation: 3
10-01-2017, 09:46 PM
#73210 (8)
I use BackBlaze and S3 for important files, granted I have not much important files (less than 100MB), the cost is pretty low.

ayyyLmaoNekos
Junior Member
Kohai
Posts: 5
Threads: 1
Joined: May 2018
Reputation: 1
05-19-2018, 12:40 PM
#77788 (9)
Bash + rysnc + external hard drive = profit

Forums are cool
malmon
I ♥ ϗ
Neko
Posts: 2,919
Threads: 38
Joined: Nov 2015
Reputation: 21
05-19-2018, 03:34 PM
#77796 (10)
Currently using Python + Rclone + GSuite

[Image: 68747470733a2f2f63646e2e706272642e636f2f...612e676966]
„こころゆらゆらゆれてる”
RX14
Senko-san
Optimist
Posts: 985
Threads: 9
Joined: Nov 2015
Reputation: 7
05-20-2018, 07:27 AM
#77810 (11)
Currently it's rsync every 5 mins from my laptop to my nas, then daily whole-filesystem incremental backups of my nas to two cloud providers (backblaze b2 and wasabi) using duplicacy. It's a bit overkill but I'd prefer to be that way with backups.

[Image: 68747470733a2f2f6177772e6d6f652f683731666e372e706e67]
English animemester