16 Replies Latest reply on Oct 5, 2016 12:38 AM by 4d7cf7abe72e56bc76302054848c6781b9e14c68

    Replicate Marketo Database

    Carlos Sousa

      Hi,

       

      I need to build an analytics application in top of the data available in Marketo.

       

      For that I want to replicate the Marketo data into a local database (Sql Server/Oracle, etc.) so I can use that info in a simpler way.

       

      Any suggestions on how to accomplish this.

       

      I was planning in using the REST API for getting all the new activities and activity attributes and I can't foreseen an issue there, however when getting the lead data, getting the updated leads will not do the job I think because I'll still keep delete/merged leads.

       

      Any suggestion on how to overcome this or on how to implement a different replication mechanism.

       

      Regards.

        • Re: Replicate Marketo Database
          Jamie Lewis

          There is an API call for get deleted leads as well.  Not sure why you would want to keep merged leads as by definition they are the same lead so I would think you would want the data to be merged from reporting purposes as well

          • Re: Replicate Marketo Database
            Grégoire Michel

            Hi Carlos,

             

            Mind the REST API limitations. If your database is big, you may exhaust them pretty quickly. From the doc:

            Latest API Version: v1

            Default Daily API Quota: 10,000 API calls (counter resets daily at 12:00 AM CST)

            For higher volume integration scenarios, please contact your account representative to increase your daily API quota.  The quota applies to SOAP and REST API calls only.

            Rate Limit: 100 API calls in a 20 second window

            -Greg

            • Re: Replicate Marketo Database

              Hi Carlos,

              We have bumped into the same issue as you had before while we are trying to replicate data to SQL server database to build some analytic reports, but it turned out to be hard to achieve with Marketo standard  API.

              Therefore, we have developed our own data retrieving tool called Data Loader for Marketo(DLM) which allows you to sync Marketo data to the database without any coding. We invite you to visit our website to have a free trial of DLM and see if this could solve your problem.

              Data Loader for Marketo:  https://dlm.trend.org

              Feel free to contact us for further information or any feedback are very welcome!

              Sincerely,

              Vivian

              1 of 1 people found this helpful
                • Re: Replicate Marketo Database
                  Sanford Whiteman

                  The product appears to require old Marketo SOAP credentials -- i.e. full create/read/update/delete access to Marketo -- in addition to REST API access. Is that correct?

                    • Re: Replicate Marketo Database

                      Hi Sanford,

                       

                      We use both SOAP and REST APIs in our product, but if you have any concern about SOAP credentials, welcome to contact us to try REST-only version.

                       

                      The reason why we use both SOAP and REST APIs is that there is some limitation in REST API Marketo provided.

                       

                      First, Marketo only supports Opportunity REST API for those who use Marketo without integration with CRM tool. Therefore, we won’t be able to include Opportunity REST in our product since we use Marketo and Salesforce. Second, although Program can be retrieved with REST API, it might easily exceed API limitation since it returns only 1 record in 1 API call.

                       

                      Per the limitation of REST API-only might have, we will still provide current version which has the full function (SOAP+REST). In the same time, REST API-only version will also be provided but with limited functions.

                       

                      Btw, although SOAP API has the delete function, we didn't use it at all. You're welcome to give it a test.

                      Thank you again for your suggestions, all the opinions are valuable for other people to have a better product to use.

                       

                      Best Regards,

                      Vivian

                        • Re: Replicate Marketo Database
                          Sanford Whiteman

                          I've since been in contact with your developer and outlined the security problems with the SOAP approach, which he was not aware of. Granting read, (over)write, and delete access to every object in a Marketo instance -- especially, but not only, when software is in beta -- isn't something a security-conscious organization should authorize. It's not a matter of your code mailiciously taking advantage of its root access to an instance, but the undeniable risk involved. One misstep in parsing the WSDL and everything is gone.

                           

                          I also noticed that the software does not enforce a cap on its daily API calls, so simply testing the software can break all other running integrations. And, as an experienced Marketo dev I feel you're not accurately describing the technical problems with the.REST API, though indded there are are many.

                           

                          Nevertheless, I'm looking forward to testing the REST-only version, which I downloaded the other day as soon as it was published!

                            • Re: Replicate Marketo Database

                              Thanks for your interest in our product and advice. We know you might concern for SOAP security, so we investigated this issue and released the REST-only version.

                               

                              Regarding to API calls, we will allow users to view current API usage in new version, which plans to release in late October. Besides, customized daily API call limitation is on our roadmap. We are working on many new features based on users feedback.

                               

                              Thank you again for downloading the free trial, any feedback is welcome!

                               

                              Best Regards,

                              Vivian