Export data from Marketo to a data lake using the minimal amount of API Calls

Tamir_Belzer_TB
Level 2

Export data from Marketo to a data lake using the minimal amount of API Calls

Hi, does anyone know if we extract data from Marketo to an external database using an API connection once or twice a day, will it reduce the number. of API calls used per day? Alternatively, we're not exporting all the tables and data from Marketo today but still use between 10 and 15K API calls per day. Is there a way we can reduce the daily usage, even if it means to send the data in bulk once or twice a day? 

 

Thank you. 

Tags (1)
1 REPLY 1
Darshil_Shah1
Level 10 - Community Advisor + Adobe Champion

Re: Export data from Marketo to a data lake using the minimal amount of API Calls

Yes, you can use the bulk extract API to extract data (Leads, Activities, Program Members, Custom Objects) from Marketo in bulk. Check out the documentation here: https://experienceleague.adobe.com/en/docs/marketo-developer/marketo/rest/bulk-extract/bulk-extract

 

Ideally, you should use bulk APIs (and not regular APIs) to import and export data in bulk for such high-performance data extraction, which is particularly useful when retrieving historical or large-scale data for analysis, reporting, or migration. Also, make sure you use the correct startAt and endAt timestamp watermarks while making these API calls so you don't end up extracting the same set of data again—unnecessarily consuming your export/import data limits.

 

Hope this helps. Please let us know if you have questions.