LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 08-14-2012, 09:23 PM   #1
x{3}
LQ Newbie
 
Registered: Aug 2012
Posts: 1

Rep: Reputation: Disabled
Bidirectional chunk


Hi.

I recently handled a case in which I had to use large files transactions (>=20GB) & I tested various combinations of HTTP-related parameters:
- Chunked
- POST/GET
- small/large files
- HTTP 1.0/1.1

Before I describe the special scenario in which I had difficulties, let me list what worked:
- POST with 20GB content (POST content).
- GET with 20GB content (in response).
- Both above using chunked-encoding.

The above led me to test a special scenario: POST with large content (1MB) & as response from the server, I expected to get 1MB body (using a simple CGI script which simply echoed a 1MB file that resides on the server).

I noticed at first, that there were many packets with Zero TCP Window Size & after I increased it (on both client & server & both send & receive buffers), I noticed that all the POST is sent to the server & ACKed, but nothing is received in response & all I see are TCP Keepalive packets between the client & the server.
I reduced the POST content to 60K & it also occurred consistently.
When using ~50K POST content size, I noticed that not all 100% of the transaction attempts fail.
With a very small POST content size (46 bytes), it always worked.

After trying to tune httpd.conf, linux internal parameters under /proc, I have no clue how to solve it & I have not tried an alternative for Apache, since I think it is related to the kernel (but then again, maybe my assumption is incorrect).

Any help/ideas will be very much appreciated.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Bidirectional Pipes Felipe Reigosa Linux - Newbie 4 04-05-2010 05:40 PM
Bidirectional data transfer ssg14j Linux - Networking 1 10-24-2005 07:59 AM
where do i get a bidirectional popen pipe? Thinking Programming 9 10-21-2005 07:42 AM
unsymetric bidirectional transfer Soulstealer Linux - General 3 10-21-2005 04:04 AM
bidirectional piping w/ gpg and php yocompia Programming 0 04-20-2004 08:19 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 03:23 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration