Would love to see compression on the file level more than the http transfer level in order to extend the quota.
Would also love to see CSVs not contain the word null for null values between commas:
HTTP compression (gzip) is supported by bulk extract leads and activities. When calling either Get Export Lead File, or Get Export Activity File endpoints, simply add the HTTP header "Accept-Ecoding: gzip" and the response body will be gzipped.
curl -H 'Accept-Encoding: gzip' 'https://123-XYZ-456.mktorest.com/bulk/v1/activities/export/<exportId>/file.json'
thanks, the accept header wasn't working for us at launch, I will try again. Appreciate all your responses over the last few days.
I tried adding HTTP header "Accept-Ecoding: gzip" but in response header we are not receiving Content-Encoding: gzip and response is coming in plain text format.
Below is the sample request we tried:
Received response header:
date:Mon, 12 Feb 2018 05:09:34 GMT
Response body is coming as plain text.
Could you please help what am i missing?
I tried yesterday, and even though the Header Accept-Encoding: gzip gets accepted in the request, it still downloads a regular CSV, not a GZIP file...
What am I missing?
Encoding means the text in the payload is compressed and automatically decompressed by your client. It's not a gzip file (otherwise requesting gzip for JS files, like browsers do, could never work since ungzip isn't a native JS capability).
Oh OK, so that still means that the volume downloaded out of the Marketo instance will be compressed, consuming less of the 500MB a day quota?
No, HTTP compression doesn't need to have any relationship to the size of the data exported from a database. They're 2 different areas.
(Though if the data in the db were pre-gzipped, it wouldn't do any good -- only bad, due to resource overhead -- to compress it again before putting it on the wire.)
OK thanks for all the explanations Sanford, I am new to that topic.
So if I got that right, as a conclusion, requesting to compress the request only results in a faster transfer, no other benefits...
requesting to compress the request only results in a faster transfer, no other benefits...
Right, that would be the only guarantee (and while it is a definite improvement, downloading uncompressed 500MB doesn't take long anyway, considering you can only do it once per day).
Having the quota apply after compressing data may or may not happen in the future, I guess. Depends on what the 500 MB daily limit was really meant to address, e.g. saving Marketo's external network utilization or (implicitly) saving database server/client resources or both.