LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 04-21-2009, 10:15 AM   #1
digr
LQ Newbie
 
Registered: Apr 2009
Distribution: RHEL CENTOS
Posts: 2

Rep: Reputation: 0
File corruption during IOZONE tests with 8GB or larger test files


I am having a problem running the IOZONE disk test program on a new storage setup. I think I maybe getting corrupted files from the storage system but I need to confirm it is not a problem with IOZONE itself. There is not much info on IOZONE other than the main web page and man pages.

I need to run rather large test files as the server host in used for the test has 16 GB of RAM.

An example run was to start the program in the working directory of the filesystem I wanted to test:

/opt/iozone/bin/iozone -Ra -g 20G -b /root/iz_20G.txt

Program starts up as normal:

Iozone: Performance Test of File I/O
Version $Revision: 3.291 $
Compiled for 64 bit mode.
Build: linux
(extra details removed)
Run began: Sat Apr 18 07:12:16 2009

Excel chart generation enabled
Auto Mode
Using maximum file size of 20971520 kilobytes.
Command line used: /opt/iozone/bin/iozone -Ra -g 20G -b /root/iz_20G.txt
Output is in Kbytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 Kbytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.


The tests runs fine until it gets into the 8 GB file range.
and then it abruptly ends:

Error in file: Found ?0? Expecting ?2020202020202020? addr 2aaaaab20000
Error in file: Position 2531393536
Record # 9656 Record size 256 kb
where 2aaaaab20000 loop 131072


I have tried this three times and got the failure when the test file reached 8GB twice and once when I started with a 4 GB files that stopped at a 16 GB test file. I am only running one test at a time, so I do not have multiple iozone instances trying to use the same file.
I have also used the "-f" switch to name a file for use vs. filename generated by the iozone program itself and had the same problem.

I am about to send of details to the vendor of the storage solution.
However, I want to rule out that this is not a problem with the IOZONE program. I have ran similiar tests using IOZONE on local filesystems, and have not seen this problem. I have also tried two versions of IOZONE (iozone-3-291 and iozone-3-318 both 64bit).

If anyone can confirm that the above errors indicate a corrupted test file that would be most helpful.

If anyone has seen this before and can confirm it is a possible bug in iozone that would be great also.

I have not tried the latest version, I will do that soon.

Thanks in advance if anyone has any thoughts on this problem.

Cheers,
 
Old 04-21-2009, 11:14 AM   #2
kentyler
Member
 
Registered: Dec 2008
Location: Newark Ohio
Distribution: Fedora Core
Posts: 270

Rep: Reputation: 37
Try to run it on another partition that's not on that storage system.
 
Old 04-22-2009, 05:55 PM   #3
digr
LQ Newbie
 
Registered: Apr 2009
Distribution: RHEL CENTOS
Posts: 2

Original Poster
Rep: Reputation: 0
This problem has been isolated to the Storage subsystem and not IOZONE.
All tests on local partitions have succeeded.

Thanks,
 
  


Reply

Tags
benchmark, corruption, file, filesystems, iozone


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Test if two files are on the same file-system PatrickNew Linux - General 7 09-12-2007 10:24 PM
Can't resume file transfer on files larger than 1 gig dalesan Linux - Newbie 2 10-11-2005 11:50 AM
File Test to make sure files aren't corrupt/damaged bluedevlx Programming 2 11-04-2004 11:50 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 01:16 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration