LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Other *NIX Forums > *BSD
User Name
Password
*BSD This forum is for the discussion of all BSD variants.
FreeBSD, OpenBSD, NetBSD, etc.

Notices

Reply
 
Search this Thread
Old 05-02-2011, 09:29 PM   #1
thund3rstruck
Member
 
Registered: Nov 2005
Location: East Coast, USA
Distribution: Fedora 18, Slackware64 13.37, Windows 7/8
Posts: 346

Rep: Reputation: 38
Question UFS Filesystem Errors? Insane Silliness!


All kinds of wackyness is ensuing on my primary family FreeNAS file server. Right clicking on the samba share and selecting properties in Windows (samba share) goes nuts and reports 59PB file size for a 4TB share!

Doing the above generates errors in the system.log:
Code:
ufs_access(): Error retrieving ACL on object (27).
g_vfs_done():ad4p1[READ(offset=-605499289743265792, length=16384)]error = 5
Even stranger, running du on the file system reports a negative total!

Code:
# du -h . | tail -n 1
-524
Code:
# dh -h .
du: ../2010-06 Skydiving!/IMG_9156.JPG: Bad file descriptor
 59P	../2010-06 Skydiving!/IMG_9157.JPG
du: ../2010-06 Skydiving!/IMG_9158.JPG: Bad file descriptor
du: ../2010-06 Skydiving!/IMG_9160.JPG: Bad file descriptor
du: ../2010-06 Skydiving!/IMG_9161.JPG: Value too large to be stored in data type
du: ../2010-06 Skydiving!/IMG_9163.JPG: Bad file descriptor
du: ../2010-06 Skydiving!/IMG_9164.JPG: Bad file descriptor
du: ../2010-06 Skydiving!/IMG_9165.JPG: Bad file descriptor
du: ../2010-06 Skydiving!/IMG_9166.JPG: Value too large to be stored in data type
du: ../2010-06 Skydiving!/IMG_9167.JPG: Value too large to be stored in data type
-524	../2010-06 Skydiving!/
...
I haven't tried running fsck yet because I'm sure that's gonna take eons to complete. Has anyone seen this kind of data corruption? Any other options besides restoring from backup?
 
Old 05-03-2011, 06:55 AM   #2
AlucardZero
Senior Member
 
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,598

Rep: Reputation: 516Reputation: 516Reputation: 516Reputation: 516Reputation: 516Reputation: 516
Um. fsck it now.
 
Old 05-03-2011, 08:07 AM   #3
thund3rstruck
Member
 
Registered: Nov 2005
Location: East Coast, USA
Distribution: Fedora 18, Slackware64 13.37, Windows 7/8
Posts: 346

Original Poster
Rep: Reputation: 38
Quote:
Originally Posted by AlucardZero View Post
Um. fsck it now.
Yea, I dropped to single user mode, umounted the array, and ran fsck -y /dev/ad4p1. FSCK reported the UNREF FILE I=n error. The second time fsck was run it no longer reports the UNREF FILE error (or any errors) but du is still returning bad file descriptors and negative file size totals.

Code:
baileyfs01:~# du -h /mnt/FileServer/Files/Digital\ Photos/Events/2010-06\ Skydiving! | tail -n 1
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9156.JPG: Bad file descriptor
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9158.JPG: Bad file descriptor
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9160.JPG: Bad file descriptor
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9161.JPG: Value too large to be stored in data type
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9163.JPG: Bad file descriptor
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9164.JPG: Bad file descriptor
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9165.JPG: Bad file descriptor
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9166.JPG: Value too large to be stored in data type
du: /mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!/IMG_9167.JPG: Value too large to be stored in data type
-524	/mnt/FileServer/Files/Digital Photos/Events/2010-06 Skydiving!
Is there another thing I can try to clean this junk up?
 
Old 05-03-2011, 08:13 AM   #4
AlucardZero
Senior Member
 
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,598

Rep: Reputation: 516Reputation: 516Reputation: 516Reputation: 516Reputation: 516Reputation: 516
Looks like it's time for a new disk and to restore from backup.
 
Old 05-04-2011, 07:28 PM   #5
thund3rstruck
Member
 
Registered: Nov 2005
Location: East Coast, USA
Distribution: Fedora 18, Slackware64 13.37, Windows 7/8
Posts: 346

Original Poster
Rep: Reputation: 38
I'm hoping I can destroy and rebuild the array back into a healthy state by swapping around the disks.

--UPDATE--

Ok, so I have some final results from the last week or so of troubleshooting. I appears that enabling ACLs on my RAID volume in FreeBSD is the source of all the trouble. The ACL read/write errors only appear (in a year's worth of system logs) on the day I enabled and created my ACLs.

Code:
# Example:
[~]# setfacl -d -m u::rwx,g::r-x::o:r-x,mask::rwx Music/
[~]# setfacl -m g:Managers:rwx Music/
[~]# setfacl -m g:MusicManagers:rwx Music/
Just to make absolutely sure this was the case I created a new array from 3x 500GB disks and copied over 50GB+ w/o ACLs applied. No issues at all, everything works great. Then I enabled and applied my ACLs, started another 50GB+ copy operation & tailed the systemlog. Immediately, this shows ACL & superblock errors and, if there are enough read/write operations occurring, this causes the array to collapse and the machine to automatically restart (BIOS reports on restart 'partial array' or 'recovery state').

Not a lot of options here. I have outgrown the primitive *Nix access controls and need the sophistication ACLs provide so, as much as it pains me to do so, I had to retire this server and move the array (4x 2TB RAID5) to my other server (Windows 2008 Server).

For anyone wondering, I was running FreeNAS v0.7.2 (which I absolutely love and hope some day to have the opportunity to leverage again)

Last edited by thund3rstruck; 05-07-2011 at 12:52 PM. Reason: Final Report
 
  


Reply

Tags
freenas


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Filesystem errors, how do I tell which volume its on from log errors? rjo98 Linux - Newbie 5 03-09-2011 02:20 PM
I can't mount UFS filesystem from Linux malcarada Linux - General 3 03-09-2008 12:27 PM
USB/SCSI Errors Driving Me Insane LinuxGeek Linux - Hardware 2 01-04-2006 08:04 AM
silliness salparadise General 4 10-23-2003 05:36 PM


All times are GMT -5. The time now is 11:46 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration