We’re having an email outage right now. Stand by (and we’re really sorry; we know how integral email is to Beeminder for many of you). DM me / @shanaqui here in the forum as emergency backup communication in the meantime and @shanaqui may be able to say more in a few hours as the sun rises in the UK.
(And huge thanks to @bee for frantically changing all our MailGun API keys, long story.)
I guess it’s not that long of a story: Our email service provider, MailGun, got a spoofed message from… maybe my email address, and it triggered a security alert where they’re assuming our account is compromised. We’re now jumping through an insane number of hoops and begging them to reenable us. (I personally suspect this is a totally false alarm. Email spoofing is not a security breach. We’ll see if they can show the spoofed message was actually signed in some way that indicates bad guys had access to our sending keys or something.)
Sorry again for the huge hassle we know this is for plenty of you!
(I guess it’s also a roundabout argument for using your Beeminder dashboard or the smartphone apps or SMS or the Slack bot or various third-party tools (most recently https://beemine.ai) as your primary method for knowing what beemergencies you have due.)
Good morning, folks! Sadly there is no sign of everything leaping back into action. I’m here and monitoring, but most of my superpowers rely on email.
We’re doing our best to ameliorate stuff on our side!
I believe we might be back! The support inbox received the first new email in hours, and I generated a reminder email for myself which arrived OK.
Obviously recovery is a ways away, in that emails that weren’t sent are lost and IIRC cannot be re-sent. We’re gonna have to see about getting in touch with people who derailed in the meantime, for example, and support’s going to have a busy time. But we’re (probably) back!
No errors in the last hour+, and some email coming in/going out apparently OK, so I think I was correct to say the email outage is over!
If you derailed on something – or think you did – and it wasn’t legit, then get in touch with all the details you can (at minimum, the name of the goal) and we’ll take a look.
A bunch of emails were re-sent, and we’ve been getting replies, so it looks like things are pretty good now!
Support may be a bit slower than our usual average 6 hours for a day or so, but we’ll do our best to get on top of it as fast as we can.