-   Linux - General (
-   -   Red Hat - VSFTP Server - release of large files to the file store (

houmb17 02-13-2008 05:48 AM

Red Hat - VSFTP Server - release of large files to the file store
Running Red Hat Enterprise Linux AS version 4.
XML files are supplied to the application on a regular basis via FTP - using VSFTP server.
These files are processed using a hibernate daemon that runs every 10 mins - this uploads the files to a database.
Normally everything is fine.
However, one client has very large XML files - and the daemon upload process accesses the files before the transfer has completed - and of course the process complains that the XML is corrupt.
Normally everything is fine - so I think there is a size at which the file is flushed to the File store and becomes visible to the operating system. Perhaps there are buffers involved which need to be resized here?
This view is underlined since the 'smaller' files never have a problem - so there must be times when the uploader is running when they are being transfered, but they are not accessed prior to the transfer finishing.
Hope this is clear enough?

Agrouf 02-13-2008 08:00 AM

It's not clear to me at least.
I didn't get everything. Could you please post a timeline of what is happening and what you expect to happen or what is the problem or what is the question?

houmb17 02-13-2008 08:38 AM

I receive data updates - both XML and CSV files everyday - and these update and add data to my database. Normally I receive 5 to 20 files per day.
All of these are fine.
But one sender sends a large file each week - the size is 57,089KB - and every day he sends it the failure happens.
This is why I think it maybe a configuration issue - with a buffer size, or something similar.

Agrouf 02-13-2008 03:18 PM

Maybe you are accessing it before the transfer completes?
Is the size of the file correct?

houmb17 02-29-2008 05:02 AM

Yes - that is the problem. The files are being accessed before the transfer has completed. I need to try and stop that happening - for the files not to be seen by other processes until the transfer has completed.

All times are GMT -5. The time now is 07:22 PM.