REST API - Bulk extract 31 days date filter limitation

[Anonymous]

Hi ,

We are extracting data from marketo through the REST API - Bulk extract but we find the limitation of 31 days data extraction , so therefore we can extract historical data.... Is there an alternative way to do so?

Thanks!

[SanfordWhiteman]

There's no alternative that does more than 1 month of data in a single file automatically.  You can use Bulk Export to get exactly the same data as Bulk Extract and cover whatever period you want. But Export is paginated JSON, so not actually file-based at all, and to the degree a single response == a single file it's only 300 records.

[Anonymous]

Thanks Sanford. So, if I understand correctly, your saying with Bulk Export there is no limitation of period of time? I have been looking for bulk export documentation but haven´t found anything , do you have any reference on that?(link)

[SanfordWhiteman]

Docs at http://developers.marketo.com/rest-api/endpoint-reference/lead-database-endpoint-reference/#/Activit...​ and http://developers.marketo.com/rest-api/endpoint-reference/lead-database-endpoint-reference/#/Leads.

But while there's no inherent limitation on the overall period of time -- other than your # of API calls per day, which must be taken into account -- it's totally different logic than the create/queue/poll/download with the real Bulk API.  I wouldn't think you'd want to (re)build for the older method.

[Anonymous]

Hi,

Thanks for the info Sanford.

Does all of this take into account the "activities" data extraction? Because for the data extraction of activities it says there is a 31 days date filter limitation but for the rest no... our concern is for the activities , thanks.

[SanfordWhiteman]

When you use the Get Lead Activities endpoint, you set the start and stop points yourself using Get Paging Token and the nextPageToken.

Don't really know what you mean by "for the rest no..." w/r/t the Bulk Extract endpoints. Those only do 2 things, Leads and Activities.