Curl POST files and Squid

Tuesday, December 2nd 2008, 14:33 CET

Skien, Norway

For releases we also package a PEAR package for each component. We have a channel server at http://components.ez.no that can be integrated to download each component separately, but with dependency checking. As server back-end we use Chiara_PEAR_Server, which allows us to upload each component's release with a web-form. Now that we're having more and more available components uploading them one by one is no fun anymore—even more because the Firefox developers thought to be smart and force you to use the dialog instead of pasting in the filename.

So I wrote a script not too long ago to upload all the .tgz PEAR packages through curl . That was working great for quite a few releases. Unfortunately, when I rolled our latest 2008.2beta1 release this script refused to work. I investigated a bit and saw that curl posted only the header of the request, and not the POST body. Being annoyed by that I tried older curl versions to see if those were working, but no luck. I even tried PECL 's HTTP package only in order to find out that it actually uses curl in order to do requests.

So because all of that failed, I looked a tad more at the headers that curl was posting, and found this " Expect: 100-continue " header, which can be used to test whether a web server will accept a certain request based on headers. Turns out that Squid doesn't quite support that and simply rejects the request. As we use Squid to accelerate our site, we now have to create an SSH tunnel to the web server so that we can run curl against localhost with a port forward to the web server. Not fun, but it works.

Shortlink

This article has a short URL available: https://drck.me/cpfas-6jw

Comments

Michael Gauthier

Tuesday, December 2nd 2008, 14:22 UTC

You can turn this feature off using curl_setopt($curl, CURLOPT_HTTPHEADER, array('Expect:'));

Patick Allaert

Friday, December 5th 2008, 11:24 UTC

"Expect: 100-continue" only exists since HTTP/1.1. Forcing the use of HTTP/1.0 should work too. For instance: curl_setopt($curl, CURLOPT_HTTP_VERSION, CURL_HTTP_VERSION_1_0);

nico

Tuesday, February 3rd 2009, 08:07 UTC

I'm curious to see your little script. Is it opensource ? Would you publish it ? Thanks

Add Comment

Name:
Email:	Will not be posted. Please leave empty instead of filling in garbage though!
Comment:	Please follow the reStructured Text format. Do not use the comment form to report issues in software, use the relevant issue tracker. I will not answer them here.
	All comments are moderated