2 Replies Latest reply on Aug 1, 2018 12:02 PM by Sanford Whiteman

    Bulk Import

    s.o deb

      Hi:

      We are going to use the API call to send the Leads to Marketo. I am trying to design the job and read thru this post:

      http://developers.marketo.com/rest-api/bulk-import/

      It says the following:

       

      Limits

      Max Concurrent Import Jobs: 2

      Max Queued Import Jobs (inclusive of currently importing jobs): 10

      Max Size of Import File: 10 MB-

       

      Does that mean that I can send 10 concurrent request (with 10MB file each .) and only two API calls will be made each time and rest will automatically be in Queue.

      OR

      Should I only make 2 concurrent API calls with 10MB file each and once complete make the next two call  .

        • Re: Bulk Import
          Josh Hill

          so it says you can run 2 imports at same time.

           

          and 10 can be queued of up to 10mb each.

           

          You can increase that size temporarily with support.

          • Re: Bulk Import
            Sanford Whiteman

            Should I only make 2 concurrent API calls with 10MB file each and once complete make the next two call .

            It really depends.

             

            If you have a clearly fixed number of imports, like you've already sliced one day's single file into 10MB slices and that's under 10 files, then I would upload them all at once. Again that's assuming you will not be uploading again for 24 hours.

             

            But if you don't know how many files will come in and at what pace, you don't gain much by uploading in advance. Instead, poll for completion every minute and then upload when there's a slot available. 10MB files are so fast to upload that pre-queueing them has little advantage (if the limit were 100MB+ it would be another story).