SOLVED

Bulk Import

Go to solution
Highlighted
Anonymous
Not applicable

Bulk Import

Hi:

We are going to use the API call to send the Leads to Marketo. I am trying to design the job and read thru this post:

http://developers.marketo.com/rest-api/bulk-import/

It says the following:

Limits

Max Concurrent Import Jobs: 2

Max Queued Import Jobs (inclusive of currently importing jobs): 10

Max Size of Import File: 10 MB-

Does that mean that I can send 10 concurrent request (with 10MB file each .) and only two API calls will be made each time and rest will automatically be in Queue.

OR

Should I only make 2 concurrent API calls with 10MB file each and once complete make the next two call  .

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Level 10 - Community Moderator

Re: Bulk Import

Should I only make 2 concurrent API calls with 10MB file each and once complete make the next two call .

It really depends.

If you have a clearly fixed number of imports, like you've already sliced one day's single file into 10MB slices and that's under 10 files, then I would upload them all at once. Again that's assuming you will not be uploading again for 24 hours.

But if you don't know how many files will come in and at what pace, you don't gain much by uploading in advance. Instead, poll for completion every minute and then upload when there's a slot available. 10MB files are so fast to upload that pre-queueing them has little advantage (if the limit were 100MB+ it would be another story).

View solution in original post

2 REPLIES 2
Highlighted
Level 10 - Champion Alumni

Re: Bulk Import

so it says you can run 2 imports at same time.

and 10 can be queued of up to 10mb each.

You can increase that size temporarily with support.

Highlighted
Level 10 - Community Moderator

Re: Bulk Import

Should I only make 2 concurrent API calls with 10MB file each and once complete make the next two call .

It really depends.

If you have a clearly fixed number of imports, like you've already sliced one day's single file into 10MB slices and that's under 10 files, then I would upload them all at once. Again that's assuming you will not be uploading again for 24 hours.

But if you don't know how many files will come in and at what pace, you don't gain much by uploading in advance. Instead, poll for completion every minute and then upload when there's a slot available. 10MB files are so fast to upload that pre-queueing them has little advantage (if the limit were 100MB+ it would be another story).

View solution in original post