LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices

Reply
 
Search this Thread
Old 02-13-2008, 06:48 AM   #1
houmb17
LQ Newbie
 
Registered: Aug 2007
Posts: 3

Rep: Reputation: 0
Red Hat - VSFTP Server - release of large files to the file store


Running Red Hat Enterprise Linux AS version 4.
XML files are supplied to the application on a regular basis via FTP - using VSFTP server.
These files are processed using a hibernate daemon that runs every 10 mins - this uploads the files to a database.
Normally everything is fine.
However, one client has very large XML files - and the daemon upload process accesses the files before the transfer has completed - and of course the process complains that the XML is corrupt.
Normally everything is fine - so I think there is a size at which the file is flushed to the File store and becomes visible to the operating system. Perhaps there are buffers involved which need to be resized here?
This view is underlined since the 'smaller' files never have a problem - so there must be times when the uploader is running when they are being transfered, but they are not accessed prior to the transfer finishing.
Hope this is clear enough?
 
Old 02-13-2008, 09:00 AM   #2
Agrouf
Senior Member
 
Registered: Sep 2005
Location: France
Distribution: LFS
Posts: 1,591

Rep: Reputation: 79
It's not clear to me at least.
I didn't get everything. Could you please post a timeline of what is happening and what you expect to happen or what is the problem or what is the question?
 
Old 02-13-2008, 09:38 AM   #3
houmb17
LQ Newbie
 
Registered: Aug 2007
Posts: 3

Original Poster
Rep: Reputation: 0
Timeline

I receive data updates - both XML and CSV files everyday - and these update and add data to my database. Normally I receive 5 to 20 files per day.
All of these are fine.
But one sender sends a large file each week - the size is 57,089KB - and every day he sends it the failure happens.
This is why I think it maybe a configuration issue - with a buffer size, or something similar.
 
Old 02-13-2008, 04:18 PM   #4
Agrouf
Senior Member
 
Registered: Sep 2005
Location: France
Distribution: LFS
Posts: 1,591

Rep: Reputation: 79
Maybe you are accessing it before the transfer completes?
Is the size of the file correct?
 
Old 02-29-2008, 06:02 AM   #5
houmb17
LQ Newbie
 
Registered: Aug 2007
Posts: 3

Original Poster
Rep: Reputation: 0
Yes - that is the problem. The files are being accessed before the transfer has completed. I need to try and stop that happening - for the files not to be seen by other processes until the transfer has completed.
 
  


Reply

Tags
ftp, transfer


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Server running Red Hat - Release 6 (Hedwig) Need Help! jhmblvd Linux - Server 5 08-31-2007 09:11 AM
downloading large files- Red Hat 9 bobmoin Red Hat 2 05-24-2004 08:02 AM
ftp large file - lose net connect red hat 6 steve2k Linux - Networking 0 03-10-2004 11:28 AM
vsftp large file download problem kmrob72 Linux - Networking 4 02-17-2004 06:46 PM
Red Hat does not plan to release another product in the red hat linux line... Whitehat General 5 11-03-2003 07:33 PM


All times are GMT -5. The time now is 05:32 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration