I need to build an analytics application in top of the data available in Marketo.
For that I want to replicate the Marketo data into a local database (Sql Server/Oracle, etc.) so I can use that info in a simpler way.
Any suggestions on how to accomplish this.
I was planning in using the REST API for getting all the new activities and activity attributes and I can't foreseen an issue there, however when getting the lead data, getting the updated leads will not do the job I think because I'll still keep delete/merged leads.
Any suggestion on how to overcome this or on how to implement a different replication mechanism.
Solved! Go to Solution.
There is an API call for get deleted leads as well. Not sure why you would want to keep merged leads as by definition they are the same lead so I would think you would want the data to be merged from reporting purposes as well
I don't want to keep them. That's why I need to get the delete leads so I can act accordingly in my local replica.
Thanks for the response. In that point that's exactly what I needed. Not quite sure how I missed that.
Mind the REST API limitations. If your database is big, you may exhaust them pretty quickly. From the doc:
Latest API Version: v1
Default Daily API Quota: 10,000 API calls (counter resets daily at 12:00 AM CST)
For higher volume integration scenarios, please contact your account representative to increase your daily API quota. The quota applies to SOAP and REST API calls only.
Rate Limit: 100 API calls in a 20 second window
Yes I know.
I've a 10.000 quota daily. I'dd say that for now, based on the data I have, those would be enough to cope with that.
I was wondering if there was a better way of doing this.
To me is kind of odd to find out that I have to go through all this trouble with REST API's to be able to extract analytics from Marketo.
First of all thank you for your responses.
Data export? That would create a manual process or are we talking about something that can be automated?
I want be able to update lead changes every day.
If I want an automatic system that each day it updates with the changed data, APIs are my only option?
That's really disappointing to be honest.
Yes. I do not understand why you feel it's disapointing. Any other system would do the same.
Now, if what bothers you is the development, you can use a data movement tool such as bedrock data (Bi-directional Marketo Integrations – Marketo LaunchPoint )