LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 09-01-2015, 02:58 AM   #1
Dinithion
Member
 
Registered: Oct 2007
Location: Norway
Distribution: Slackware 14.1
Posts: 446

Rep: Reputation: 59
Synology Diskstation, NFS backup


Hi,

I'm having serious problems with my NAS. I've bought it to serve several purposes. One of the major being a centralized backup. I've got a Synology diskstation DS512j and two 4 TB harddisks. The idea was that one harddrive, /volume1/ should contain "stuff". Photos, music, movies, git, calendar, contacts, notes, documents I need access to when I'm out, etc. The other drive, /volume2 (ext4), was going to be backup.

I cannot get the backup system to work reliably. I've already got backup set up on my computer using rsnapshot. I expected I could simply rsync the content of my existing backup to my diskstation and then, using NFS, mount the diskstation to where I take my backup today.

That does not work, however, and it behaves very strangely.

OK. First things first, diskstation does not allow you to change the UID of the users (For whatever cleaver reason. Somebody made a mistake when designing the UI, and assumed everybody wanted the same UIDs they preferred, and now the UI doesn't work if one change the UIDs). Anyway, I'm not going to adapt my four computers to the liking of Synology. For that I'm to stubborn. So I use bindfs to map my UIDs to the diskstation UIDs. I doubt this is why it fails, but I guess I could try without and see what happens.

After rsyncing my backup, which takes around 20 hours with my 100Mb/s connection, I tried running rsnapshot. What happened was very strange. For some reason daily.6 had the most recent date, and it contained only a few folders and no files. The backup was now 30 GB bigger than my local backup. (I think it was actually bigger than the local backup right after rsync)

I thought something strange happened, so I deleted the folder. The size of my backup was now 1/8th less than before, and more comparable to my local backup. Since I didn't want to start all over again, I wanted to rsync (rsync -a -H --delete /backup/ /mnt/backup/) to make sure the NAS backup was up to speed with my local backup. Now the backup on my NAS is 25 (and increasing) bigger than my local backup, so it's totally failing in that respect.

Also, while I'm taking backup, periodically my diskstation stalls because nfsd is hogging the CPU driving the transfer rate down by over 95.

What's going on?

Edit:
Ok, I was working on this yesterday, around midnight, after a couple beers. After rsyncing the diskstation I took two backups. One to /backup and one to /mnt/backup. At least that's what I thought. Apparently I took the backup to /etc/backup. Before actually migrating to diskstation I want to confirm that rsnapshot works, and also do a md5sum check of both trees. That's why I for now take two backups.

So rsnapshot can, for now, be disregarded. I still don't understand why rsync fails so misserably though.

Last edited by Dinithion; 09-01-2015 at 04:10 AM.
 
Old 09-03-2015, 04:22 AM   #2
Dinithion
Member
 
Registered: Oct 2007
Location: Norway
Distribution: Slackware 14.1
Posts: 446

Original Poster
Rep: Reputation: 59
An update to this issue.

I disabled bindfs, but no increase in performance was observed. I have to experiment more with rsync to see why it will not sync correctly. I supposed it has something to do with hardlinks being lost and rsync will produce actual copies which drives the space requirements up.

rsnapshot also has a strange behavior. It only works when I haven't had any beers.. :P

Seriously though. It seems to work, though nfs is still _extremely_ slow. For comparison, it took 2 minutes to do do a backup to an internal HD. The same backup took over 2 hours through NFS.
The network link was not the problem, as it only utilized ~10Kb/s. The problem is the nfsd hogging the CPU.

NFS reportedly have 2-3 times higher performance when mounted async compared to sync. I will try this tomorrow and see if it has any influence.
I might try sshfs also and see how it perform the day after tomorrow.

AFter that I'm out of ideas.
 
  


Reply

Tags
diskstation, nfs, rsnapshot, rsync, synology



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
rsnapshot fails backup to nfs share drhood Linux - Software 3 11-10-2013 01:20 PM
backup question - NFS share in Ubuntu 9.04 backup to READYNAS NV+ newellrp1 Linux - Newbie 3 05-19-2009 03:57 PM
Tar backup to NFS share problem Liane Linux - Newbie 4 05-04-2009 04:57 AM
NFS best options for backup HellSpawn SUSE / openSUSE 1 08-21-2006 12:31 PM
HDD, NFS Backup olex Linux - General 6 02-06-2002 10:08 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 05:18 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration