getMultipleLeads API - read timeout - large data

[Anonymous]

Hi,

I have large set of lead records.

I invoke getMultipleLeads() API with a time frame ( using latestupdatedAt and oldestUpdatedAt ).

I paginate the results.

If the window ( oldestUpdatedAt, latestUpdatedAt ) is high, I saw Internal Error from Marketo.
Some tests shows that, it is around 30 to 40 minutes.

When I broke the time to smaller chunks, I dont see the error.


The question is,

" Does Marketo have any timeout set?"

What is the best way to query the large result set? ( Around a billion )?

I did see the post, and our implementation is similar to that.

http://developers.marketo.com/blog/retrieving-customer-and-prospect-information-from-marketo-using-the-api/



Thanks,
Jilani

[Anonymous]

1 - There is no timeout that I am aware of. 

2 - The tips section in the blog post you linked to is what we recommend for best practices. I would also recommend using smaller date ranges, limiting attributes, and making concurrent requests to speed up such a big request. 

[Anonymous]

Just a thought here, is your authentication token expiring?