DJ_Erraballi

DJ_Erraballi · ‎06-18-2020

Sigh, so for anyone looking into this, i am still in the process of debugging/ working around. But the gist is that there was acontrol character present in the primary attribute value id. Python has as string command "splitlines" which is generally used w/ python csv readers to parse files. The splitlines commands willa ctually attempt to split on the ^k character as well, which is a fairly underdocumented feature of splitlines. This caused the parsing of the activity to likely fail in the way i have experienced. since this issue is client-side i will close this issue, (i am assuming there are no guarantees we won't get future files with control characters like this, and that recieving control characters is expected behaviour).

DJ_Erraballi · ‎06-18-2020

Ok so both those separate activities were actually the same row in the file, tracked this down to: where the record contains a control k character in the URL which breaks the csv parsing. 149877905,3173901,2020-06-05T23:08:07Z,1,null,31707,www.multicare.org/photos/ ^K Education/IntroductionToCorporateCompliance_NonLMS/story.html,"{""Client IP Address"":""REDACTED"",""Search Engine"":""Gmail"",""Query Parameters"":"""",""Referrer URL"":null,""User Agent"":""Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.97 Safari/537.36"",""Webpage URL"":""/photos/\u000BEducation/IntroductionToCorporateCompliance_NonLMS/story.html""}" 149878023,2928924,2020-06-05T23:09:25Z,10,1951,2598,Puget Sound-ES-202005-Essential and Financial Email.Email,"{""Choice Number"":""0"",""Campaign Run ID"":""670"",""Platform"":""Win7"",""Device"":""PC"",""Step ID"":""2530"",""User Agent"":""Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; WOW64; Trident/7.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E; BRI/1; BRI/2; Zoom 3.6.0; Microsoft Outlook 14.0.7248; ms-office; MSOffice 14)"",""Is Mobile Device"":false}"

DJ_Erraballi · ‎06-18-2020

Here is the raw activity we saw: 'marketoGUID' = {str} 'Education/IntroductionToCorporateCompliance_NonLMS/story.html' 'leadId' = {str} '{"Client IP Address":"REDACTED","Search Engine":"Gmail","Query Parameters":"","Referrer URL":null,"User Agent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.97 Safari/537.36","Webpage URL":"/ 'activityDate' = {NoneType} None 'activityTypeId' = {NoneType} None 'campaignId' = {NoneType} None 'primaryAttributeValueId' = {NoneType} None 'primaryAttributeValue' = {NoneType} None 'attributes' = {NoneType} None If looks almost as if the activity export generated a completely faulty row, all the fields are null, except marketo_guid, which appears to have the primary attribute value, and the leadId which appears to have the attributes.

DJ_Erraballi · ‎06-18-2020

Also looks like we have some data that is coming back from bulk activity export with null activityDates. This is alittle strange since not only had this never happened before june/5 we are only experiencing this data issue with one of out the 8 marketo instances we work with.

DJ_Erraballi · ‎06-17-2020

Yep understood, seems like there isn't gonna be an easy way to recapture missed ones regularly without hitting our export quota. One option is to query historic 28 day ranges on a once per day basis, but i'm too scared to hit export quotas for the clients. Do a best effort, and hope those late-add activities weren't form submissions :/.

DJ_Erraballi · ‎06-17-2020

Thanks for the quick reply. that does answer question #2. If data is added in an ongoing fashion it does create some challenges for ensuring that exported activities and the activities in Marketo match up, especially if reprocessing time ranges eats away out our daily export quotas. But it does make sense, so i think what i will do is increase the start_at buffer to an hour and hopefully that will suck up enough of a percentage of the difference, without having too large of an impact on the quota. Any ideas on question #1? Thanks for the help!

DJ_Erraballi · ‎06-17-2020

In regards to question #1, i actually think this behavioru did change with this release: https://docs.marketo.com/display/public/DOCS/Release+Notes%3A+June+%2720 either intentionaly or unintentionally.

DJ_Erraballi · ‎06-17-2020

Hi there, got a multiparter question: Question #1 I am currently debugging some issues with our Marketo activity feeds. Noticed recently that we obtained an activity from marketo that looked like this: result = {OrderedDict: 8} 'marketoGUID' = {str} '149877905' 'leadId' = {str} '3173901' 'activityDate' = {str} '2020-06-05T23:08:07Z' 'activityTypeId' = {str} '1' 'campaignId' = {NoneType} None 'primaryAttributeValueId' = {str} '31707' 'primaryAttributeValue' = {str} 'www.multicare.org/photos/' 'attributes' = {NoneType} None This landing page activity didn't have the attributes set entirely. (This is where i am usually obtaining the web page url, referral url if present, etc.). Is this expected to occur? Been ingesting landing page activities since 2019 for multiple clients and this is the first time we have come across the above so wondering if it somethign that is likely to occur again. Currently: not only do we depend on attributes to be set, we also depend on 'Webpage URL' to be set on the attributes field in order to properly report on data in marketo. Question #2 It appears that we are actually missing some data in our extract from marketo, and it is possible that we may need to tweak our strategy. Currently we execute a bulk extract with a start date a couple minutes before our most recent known stored activity. If we look at each extract as a slice, currently we are guaranteed to include every single time slice that is possible in our extracts. Where i am worried, if i query something like (dummy values): startAt: 3:00pm endAt: 4:00pm at 4:01pm. i would get a set of activities that is DIFFERENT than if made the same query at 4:16pm. (This is my current working theory for why it appears there are activities missing). Is it possible that marketo can add out of order activities (with activity dates in a past time range)? If so is there a recommended buffer to add to our start_at time period, to ensure we don't miss any activities? Also how long after a time range has elapsed could activities be added to that time range?

DJ_Erraballi · ‎03-05-2020

Hi, When performing bulk imports to static lists there are a couple issues that my team is running into: Issue #1 Background: On a bulk import to a static list using a lookupField (where the lookupField is the marketo lead id itself) Problem: if for some reason the marketo lead was deleted in marketo prior to the attempted import, the bulk import will get stuck in 'Importing' status fo an exceedingly long time (can take up to 10 minutes before inevitably finishing with 0 records imported) When this import finally completes i have no warnings or failures to recognize something was wrong with the input list, it simply returns that nothing is wrong. It would be nice to get the lead ids that were not found, so that i may "regenerate" those marketo lead records (import w/o the lookupField) Issue #2: Background: bulk import of static lists issue a batch id that is always the same as the static list itself. Problem: When polling the status of the batch id, in the rows for "message, numOfRowsFailed, numOfRowsWithWarning, numOfLeadsProcessed" i actually am seeing those columns returned for the previous import, completely unrelated to the import that is currently in progress. (Only the status is valid). Personal Background: I represent a healthcare CRM that mantains API integrations for several marketo instances and marketo clients (10). We need to mantain several list syncs from our clients databases, but be resilient when our client does something bad, like delete a lead.

DJ_Erraballi · ‎12-24-2019

It appears based on the documentation that: ``` Note: If an email is part of a program that is using Email Testing (A/B Test, or Champion/Challenger Test), then that email is not available for query using the following endpoints: Get Email by Id , Get Email by Name , Get Emails . The call will indicate success, but will contain the following warning: “No assets found for the given search criteria.” ``` The bulk extract returns this dummy id (which appears to be unusable) for the AB test email activities. Is there anyway to progromatically discover the program this id is a part of? I am currently using getEmailById to track down the programs at the moment, but since that api is unusable for this its a little difficult. We need this info for downstream reporting, so we can evaluate the A/B not just on opens/clicks but also the downstream behaviour.

DJ_Erraballi · ‎12-19-2019

{'batchId': 1035, 'importId': '1035', 'status': 'Importing', 'numOfLeadsProcessed': 14648, 'numOfRowsFailed': 0, 'numOfRowsWithWarning': 0, 'message': 'Import succeeded, 14648 records imported (14648 members)'} Have another one on the same instance that has been importing for over an hour? with a succeeded message.

DJ_Erraballi · ‎12-19-2019

Hi, I have been using the bulk import api regularly across multiple instances to import large lists of data. I am currently encountering an issue w/ one of the instances where the bulk import status is not updating correctly. Here is a response form the bulk import staatus api: {'batchId': 1037, 'importId': '1037', 'status': 'Importing', 'numOfLeadsProcessed': 10136, 'numOfRowsFailed': 0, 'numOfRowsWithWarning': 0, 'message': 'Import succeeded, 10136 records imported (10136 members)'} The message states that the import succeded but the status is still stuck at 'Importing'. Is the status supposed to say 'Complete' here or is the message incorrect? This # of leads being imported to a list is taking > 30 minutes (its not a lot of leads and there aren't other imports running). Based on this kind of performance, if i was trying to import a list of 100k contacts it would take over 3 hours. Is this normal and expected, or is it possible that the instance i am using is somehow hobbled?

DJ_Erraballi · ‎12-18-2019

Could i through the api setup this tombstone list, and trigger deltion on a different list? Or would some of this configuration have to be done in the api? If so its probably not a feasible solution for us as we are managing multiple clients worth of marketo instances programatically.

DJ_Erraballi · ‎12-18-2019

Hi, This is a bit of a multiparter, but the first is the most important: 1. is there a way to bulk delete leads from a static list. At the moment the rest api seems to limit me to 300 per request, which means if i need to delete 30k records i will have to call the api 100 times. The other parts are: 2. On bulk import if a specify a static list id to import to, the operation is additive, but the batchId is also tied to the static list Id. Because the static list id is the same as the batchId, this means i cannot import into the static list w/ more than one batch at a time. Is that a known limitation of bulk import? I am importing very large lists of 20k+, so even with the bulk i need to split it up due to import size limits. It would be nice to be able to create more than one batch at a time. (3 is sort of an off-shoot of 2) 3. while having unique batchIds for each static list import would definitely work, perhaps a cleaner solution would be to provide a batch static list insert api. That way i can bulk import leads, and then given those lead ids, attach them to a static list.

DJ_Erraballi · ‎10-30-2019

Is it possible to create custom fields via the API? This question has been asked before: https://nation.marketo.com/message/53090 but was answered in 2013 so i am wondering if there are any updates. It is difficult to transfer our CRM's data about leads to Marketo without an api (requires manual setup of several custom fields, that can be error prone, especially when we have several clients with separate marketo instances).

DJ_Erraballi · ‎10-24-2019

https://developers.marketo.com/rest-api/endpoint-reference/lead-database-endpoint-reference/#!/Leads/describeUsingGET_6 based on the documentation of this api i noticed that it returns a "moreResult" and "nextPagingToken" parameters. we were attempting to test paginating over this api but this api doesn't honor a "batchSize" parameter, and it appearsa that calling this api does not return the "moreResult" or "nextPagingToken" params. is this api guaranteed to return all the attributes? Or is pagination required, and if so why are the necessary pagination params not in the response.

DJ_Erraballi · ‎08-19-2019

So using the web page id there is no way to get the landing page ID, but from the activity i do have a web page url that is looks like: '/Thank-You.html'. The way i am supposed to determine which landing page was used is to query the assets api for all LPs, and correlate he 'URL' field with that 'Webpage URL' field from the activity? the 'URL' field often looks like this: 'https://<URL>/lp/<munchkin>/Thank-You.html', but i have seen some of the assets looking like this: 'https:// <URL> /lp/ <munchkin> /WBN-YYYY-MM-DDWebinarv3_LP-OnDemand.html' would i get that WBN-YYYY-MM? or that looks like a date template or something. Is there any way to determnistically go from web page id to landing page id?

DJ_Erraballi · ‎08-16-2019

https://nation.marketo.com/message/199923-connect-web-page-activity-to-landing-page-asset Someone else has asked for this with no response several months ago.

DJ_Erraballi · ‎08-16-2019

I am working on extracting data for a crm integration with marketo. The primaryAttributeValueId for web page visits appears to not map to the landing page asset ids. If so is there a way i can determine the landing page id given an activity from the bulk activity exctract API?

DJ_Erraballi · ‎08-15-2019

Noticed that if you enter "Null" as a last name, you register that a last name was entered but store the actual value as a Null type. Like the name : "John Null", cannot be saved in Marketo. I am trying to figure out how that would be possible and whether there is something exploitable here.

Online Status	Offline
Date Last Visited	‎10-16-2020 06:32 PM

Date Registered	‎08-15-2019 04:21 PM
Date Last Visited	‎10-16-2020 06:32 PM
Total Messages Posted	20
Likes Received	6

Top Badges Earned

Re: Marketo Activity Ingestion - Understanding Beh...

Re: Marketo Activity Ingestion - Understanding Beh...

Re: Marketo Activity Ingestion - Understanding Beh...

Re: Marketo Activity Ingestion - Understanding Beh...

Re: Marketo Activity Ingestion - Understanding Beh...

Re: Marketo Activity Ingestion - Understanding Beh...

Re: Marketo Activity Ingestion - Understanding Beh...

Marketo Activity Ingestion - Understanding Behavio...

Marketo Bulk Import to Static Lists - Issues / Bug...

Primary Attribute Value Id for AB Tests in Bulk Ex...

Re: Bulk Import Status Incorrect? Performance Issu...

Bulk Import Status Incorrect? Performance Issues..

Re: Static List Bulk (Deletion)

Static List Bulk (Deletion)

Custom Fields API

Lead Describe Attributes Pagination

Re: Webpage ID in bulk activity extract not a Land...

Re: Webpage ID in bulk activity extract not a Land...

Webpage ID in bulk activity extract not a Landing ...

Null as a Last Name