Marketo CO data access issue

[mlohot]

We are loading more than 100 records per lead in CO since it is a business requirement. 

Marketo application have a limitation, It only allows to access 100 records on UI and in velocity script. 

Therefore, we want to load data in specific order so top 100 records as per their order amount can be accessible in velocity script and also displayed on UI.

We are retrieving data in descending order from database and then load it in Marketo.

We have custom field "Sequence" as a dedupe field and it get incremented for every record.

This is how we load records in Marketo via api.

Sequence    Order Amount          

1                    130

2                    120

3                    110

4                    100

....

120                10

However, we can only able to access records from sequence no. 21 to 120 in velocity script but we can retrieve all records from CO (from sequence no. 1 to 120 records) via api.

Any ideas why we can't access records with sequence no. from 1 to 20.

[SanfordWhiteman]

---

Marketo application have a limitation, It only allows to access 100 records on UI and in velocity script. 

Therefore, we want to load data in specific order so top 100 records as per their order amount can be accessible in velocity script and also displayed on UI.

By “UI” you mean the Lead Detail » Custom Objects pane? Sounds like a nice-to-have but not sure why it would be hard requirement?

Anyway, can you tell us more about the actual shape of these objects? Their exact fields, datatypes, and example data. And how often new objects are created. This will help us think of alternate approaches, because trying to force which ones are the “last 100” over time is generally a doomed exercise.

[mlohot]

Hi Sanford,

Thanks for response.

Showing last 100 records in UI (Lead Detail » Custom Objects pane) is not a hard requirement.

However, We do have a requirement to access all 100 records that have higher order amount value in velocity script to populate dynamic content in email. We delete old data and load new data in CO every week. 
We tried loading data in CO by order amount value (In both ascending and descending order) but all 100 records with higher order amount value are not present in velocity script.
Here is the CO details:

Dedupe Fields	Sequence
Link Field	Global ID
Linked Object Name	Lead
Linked Field Name	Global ID

Field Name	Type
Sequence	integer
Global ID	string
Order Amount	float

Please let me know if you need more details

[Darshil_Shah1]

You're right about the hard limit of being able to retrieve a maximum of 100 parent-level CO records at a time in the velocity script, which seems fair given that use-cases that need more than 100 records to build content/logic for email are very rare. As a workaround, why don't you coalesce data into a single (or possible multiple, but <100) CO records' field(s) instead of creating 100 CO individual records? It's clear that you need data (and not trigger campaigns for each individual CO record that is inserted in Marketo), which you'd be able to access and trigger your flow with fewer CO records as well.

[Darshil_Shah1]

I completely agree with Sandy here. If you wish to see more CO data than permissible by UI in a single view, you can always export the CO data using API. Also, once imported, you should consider sorting the CO based on a particular field and picking the record(s) you need to personalize the email content. We can discuss more on this once you share the fields, their data types, and other CO-related info, as suggested by Sandy.