eoghanobrien | Stripe Developers | Page 1

jaunty pagodaBOT May 12, 2023, 9:07 PM

#

hazy reef May 12, 2023, 9:09 PM

#

another one

#

This looks bad, we're also getting a ton of bad webhooks sent to our production site - I don't think it's possible for us to have caused this, please advise @tidal mirage

tidal mirage May 12, 2023, 9:14 PM

#

Hi, yes you're right. We're currently investigating the issue. Thank you for raising it here

hazy reef May 12, 2023, 9:18 PM

#

Any idea if webhooks for these events will be sent out after the issue is resolved?

tidal mirage May 12, 2023, 9:19 PM

#

I'm unsure at this point as the team is investigating this currently.

hazy reef May 12, 2023, 9:22 PM

#

Where can I keep track of progress on this issue? here or in Twitter, Stripe Status page.

tidal mirage May 12, 2023, 9:23 PM

#

I can keep you update here. I'll keep this thread open

#

Does that work?

hazy reef May 12, 2023, 9:25 PM

#

Thank you! Best of luck!

hazy reef May 12, 2023, 9:43 PM

#

If it helps, we're getting all sorts of empty web-hook data sent to our servers like this one: https://dashboard.stripe.com/events/evt_3N6hARE3c9sWyeru1Dvg35oF

tidal mirage May 12, 2023, 9:44 PM

#

Than you for sharing this, I'll keep you posted as soon as I have more information on my end.

hazy reef May 12, 2023, 10:02 PM

#

What time do you finish for the evening?

tidal mirage May 12, 2023, 10:03 PM

#

I'm here for a couple of hours. I'll leave an update here if you need to step away.

hazy reef May 12, 2023, 10:05 PM

#

Okay, that's great, thank you!

ionic galleon May 12, 2023, 10:18 PM

#

ionic galleon May 12, 2023, 10:38 PM

#

@hazy reef The issue with events should be resolved now!

hazy reef May 12, 2023, 10:39 PM

#

We had 9 instances where customer.subscription.updated failed and 30 failed customer.subscription.updated failed - will those webhooks be re-run - the problem is we handled these on a queue so Stripe probably received a 200 response

ionic galleon May 12, 2023, 10:41 PM

#

I'd recommend writing into support to double check how/if they're going to handle this - you can always manually resend them through the Dashboard, but I'd be surprised if we resent those events to you (especially given that you responded with a 200)

hazy reef May 12, 2023, 10:43 PM

#

So I'd have to re-send all webhook events for the last 3 hours 😬

#

Is there a way to do that via the api?

ionic galleon May 12, 2023, 10:47 PM

#

The only way to resend events is through the CLI (https://stripe.com/docs/cli/events/resend) or the dashboard - but a slightly different alternative would be to use the List events API (https://stripe.com/docs/api/events/list) to retrieve all events from the past three hours and then process them (instead of relying on the events actually being resent to your endpoint)

Stripe CLI Reference

Stripe API reference – List all events – curl

Complete reference documentation for the Stripe API. Includes code snippets and examples for our Python, Java, PHP, Node.js, Go, Ruby, and .NET libraries.

hazy reef May 12, 2023, 10:49 PM

#

Sucks that we have to find a solution for this when it wasn't caused by us. What was the actual issue that caused the omission of data?

ionic galleon May 12, 2023, 10:50 PM

#

I don't know too much of the specifics - only that it was a bug on our end that we had to rollback

#

You can try checking in with support (https://support.stripe.com/contact) and ask if any additional remediations are going to be done, but that may take some time

Stripe: Help & Support

Find help and support for Stripe. Our support center provides answers on all types of situations, including account information, charges and refunds, and subscriptions information. Get your questions answered and find international support for Stripe.

hazy reef May 12, 2023, 10:53 PM

#

Okay, will do, thank you for your help and keeping us all informed. Have a good weekend!

#eoghanobrien