Bulk API: extracting activities job stuck in Queued status

[Anonymous]

I submitted a bulk API request for retrieving activities 2 days ago. However the status is stuck in "Queued". What should I expect in terms of the processing time, e.g. when it will move from "Queued" to "Processing" and how long the processing itself will take?

Here is a sample curl. You can see it has been 2 days since the job get queued:

$ curl -X GET $MKTO_URL/bulk/v1/activities/export.json -H "authorization: Bearer $MKTO_TOKEN"

{"requestId":"4448#15cc225567f","result":[{"exportId":"e0277059-d03e-4c1c-8546-941632cfce2b","format":"CSV","status":"Queued","createdAt":"2017-06-17T10:03:09Z","queuedAt":"2017-06-17T10:05:28Z"}],"success":true}

$ date -u

Mon Jun 19 21:00:45 UTC 2017

[Kenny_Elkington · Accepted solution]

We believe the queued->processing issue has been resolved.  Jobs which were stuck in queued should be getting picked up into processing now.  There's a few other failure types we're seeing and investigating though.

[Alec_Dibble]

We are also seeing the same issue. Enqueued 2 jobs yesterday afternoon and they are still in the "Queued" state.

[Kenny_Elkington]

We've got an engineering escalation open now and are looking into the issue.

[Anonymous]

I know that you're working on it now, so just an FYI, I'm now seeing jobs processing, but they've been ending in system errors:

{

"requestId": "...",

"result": [

 

{

"exportId": "...",

"format": "CSV",

"status": "Processing",

"createdAt": "2017-06-20T19:32:23Z",

"queuedAt": "2017-06-20T19:32:32Z",

"startedAt": "2017-06-20T19:34:08Z"

}

,

{

"exportId": "...",

"format": "CSV",

"status": "Failed",

"createdAt": "2017-06-20T18:43:00Z",

"queuedAt": "2017-06-20T18:43:13Z",

"startedAt": "2017-06-20T18:44:09Z",

"finishedAt": "2017-06-20T18:49:13Z",

"errorMsg": "System error"

}

,

{

"exportId": "...",

"format": "CSV",

"status": "Failed",

"createdAt": "2017-06-20T15:46:01Z",

"queuedAt": "2017-06-20T15:46:12Z",

"startedAt": "2017-06-20T18:34:16Z",

"finishedAt": "2017-06-20T18:39:08Z",

"errorMsg": "System error"

}

,

[Kenny_Elkington]

Could you share the export ids, and your subscription id with me privately?  Just follow me in my profile, and you can DM me.

[Kurt_Koller]

The lead export in the UI fails sometimes, we exported these by hand for a while and sometimes the first export would fail and return a partial file, then the second would do the same and fail at a different point, then the third would work. Just mentioning here in case this piggybacks on the same process.

It would be great if the limit could be 31 days instead of 30 days so we could grab a calendar month at a time vs 30 day arbitrary chunks. This seems like a small request so I thought I'd put it out there, I added this as a feature request in Product Ideas. Thanks.

[Anonymous]

Done...

[Anonymous]

I'm having the same issue here as well. Let me know if you happen to hear back from support

[Anonymous]

I'm also having the same issue.  Interested to hear what you find.

[Kenny_Elkington]

Can I assume that you don't also have a bunch of Bulk Leads Jobs queued as well?

[Kurt_Koller]

Hi Kenny,

We are seeing this on multiple Marketo instances. As a point of fact, we have not seen a single bulk lead request change to Processing on any instance we've tried it on.

Let me know if you need any additional information from us, I didn't include any because this appears to be systemic and not a bug around a specific request.

Thanks

[Anonymous]

No. This job is the only job that I queued.

$ curl -X GET $MKTO_URL/bulk/v1/leads/export.json -H "authorization: Bearer $MKTO_TOKEN"

{"requestId":"5be3#15cc26d63fd","result":[],"success":true}

$ curl -X GET $MKTO_URL/bulk/v1/activities/export.json -H "authorization: Bearer $MKTO_TOKEN"

{"requestId":"45f9#15cc26d3f5d","result":[{"exportId":"e0277059-d03e-4c1c-8546-941632cfce2b","format":"CSV","status":"Queued","createdAt":"2017-06-17T10:03:09Z","queuedAt":"2017-06-17T10:05:28Z"}],"success":true}

[Kenny_Elkington]

In that case, I would encourage you to file a support ticket with the details.  Can you get any new jobs to start processing?

[Anonymous]

Submitted another activity job with a different time range and a lead job, both are in "Queued" status after 6 hours. Gonna contact support tomorrow morning. Thank you for the help!