I took a poll in a beemail in January about how we should prioritize some projects in 2022 which I’m repeating and formatting as a new poll here:
- [AUTOD] Steadily adding integrations (Focusmate has been So Huge!); in particular the meta integration
- [UNCLE] The uncle button (as in crying uncle, like “yes yes, stop zeno’ing, I’m intentionally taking the derailment on this”)
- [SCHED] Revamping/optimizing the pledge schedule
- [BOARD] Just gradually making Beeminder better and clearer and onboarding better and emailing people more when they fall off the wagon, etc etc
- [GRAPH] Dynagraphs, aka merging graph.beeminder.com into Beeminder proper
- [STAIR] Bright Red Staircase? [hopeful-face-emoji]
0 voters
Feel free to cast votes again if you were part of the original poll. It’s approval voting this time – see side rant below – so vote for any that you approve of as being a top priority!
Better yet, here’s a prediction market:
Excerpts from the original replies to the beemail
- Ooooo bright red staircase, making the red line graphically consistent with time/derailment
- Upgrading the mobile apps (multiple people added this as a write-in)
- Just snoozing zenos for the rest of the day could be simpler version of UNCLE
- Various autodata integration suggestions which we’ve added to the list on consider.it
- Better goal stats (max datapoint, averages over different windows, streaks, etc)
- “Integrations are everything”
- Onboarding OMG it took me forever to really understand Beeminder
- “UNCLE should be easy, and be a nice quality-of-life improvement”
- UNCLE is a double-edged sword; not having it has kept me from derailing
And a million other opinions, often fully contradicting each other, like “yes, imperative that you do X before anything else” and “absolutely avoid X at all costs”.
Astute observers will note that we’re already 16% of the way through 2022. And we have in fact made progress. We eliminated the biggest chunk of onboarding confusion we knew of with UVI#4017, though that’s clearly only the tip of the iceberg. Also we slotted in No-Excuses Mode in case you missed that. Mostly we’re still boringly wrapping up some infrastructure upgrades (Ruby on Rails and Stripe Checkout, which also involves dropping support for PayPal).
Back to the poll results, we got 30 responses and the average rankings were like so:
GRAPH 2.82
UNCLE 3.18
AUTOD 3.32
STAIR 3.60
BOARD 3.77
SCHED 4.32
Side rant on voting mechanisms
This is a nice illustration of why I dislike Ranked Choice Voting and prefer Approval Voting. It’s pretty hard to get a real sense of the aggregate opinion from those average rankings. Other than that the top couple options are ranked significantly higher than the last couple. I tried looking at a smoothed histogram of the rankings but that doesn’t help much, other than to highlight how unliked SCHED is:
I even tried instant-runoff / iterative elimination on the rankings. That yielded this ordering:
- GRAPH
- AUTOD
- STAIR
- UNCLE
- SCHED
- BOARD
In conclusion, Approval Voting Wins. Yes, it’s dumb how I’d already concluded that and then did Ranked Choice anyway. It was an interesting experiment I guess!
I think in this case I was tempted by how Ranked Choice felt like it would demand less strategizing. And I imagine everyone did just truthfully give their rankings. Whereas with Approval Voting you need to understand the strategic choice you’re making. If you approve of everything, you’re wasting your vote. If there’s something you want to vote against, you can vote for everything but that, or if there’s one stand-out favorite you want to put all your weight behind, vote for just that. Or anything in between.
Slightly harder for the voters but I think the results would’ve been a lot clearer. (Also I don’t think Ranked Choice is actually better than Approval Voting even in terms of robustness to strategizing, if the stakes were high enough.)
Anyway, the conclusion is that dynagraphs (GRAPH) and the uncle button (UNCLE) are most important (the latter especially because it’s actually quite easy) and autodata integrations (AUTOD) clearly need to keep happening periodically whatever else does.
Probably y’all are wrong to have rated onboarding / goal creation stuff (BOARD) so low but that makes sense because I forgot to clarify whether you should answer from your own perspective or Beeminder’s. (And usually I do mean to poll your personal opinions!)