API limit exhaust

Jay00031987 · ‎06-16-2023

We are using bulk API to export the activity data from Marketo. However, the daily limit is getting exhausted i.e. 500 MB

Is there any workaround so that data export process do not stop but it get queued so that can be resumed once API limit reset?

What kind of tool or logic need to build in such case?

However, talking to Adobe support this limit are hard fix so can not be further increased.

Jay

Darshil_Shah1 · ‎06-16-2023

Well, you can always keep a log of the amount of data exported via the bulk APIs, and throttle the requests till the next day when the limits are reached. You can also use this API endpoint to retrieve the file size of the data extract requests facilitated through bulk APIs

View solution in original post

SanfordWhiteman · ‎06-16-2023

However, talking to Adobe support this limit are hard fix so can not be further increased.

It’s absolutely not fixed. You can increase your download quota up to a few GB relatively inexpensively. But you can’t increase it for free.

Darshil_Shah1 · ‎06-16-2023

Well, you can always keep a log of the amount of data exported via the bulk APIs, and throttle the requests till the next day when the limits are reached. You can also use this API endpoint to retrieve the file size of the data extract requests facilitated through bulk APIs