This might be redundant with @philip's explanation but I started typing it before I saw his so, in case it's helpful, here's what happens when the editor appears twice:
- Ping prompt appears
- You're afk so it just sits there for hours
- You hit enter which makes the prompt go away and the editor appear (this is handy any time you need to refer to previous pings to answer the current ping)
Ideally the editor would show you all the pings you missed starting with the prompt you dismissed
But it's not that smart and doesn't want to confuse you so it first pops up an editor with pings up to the one you dismissed, like always
When you finish with that it pops up the editor again with all the pings you missed since then
UPDATE: Sorry, I had overthought that. It actually does the smart thing. If you dismiss the prompt it pops up an editor for all pings you didn't answer, starting with the one you dismissed.
The only way I get the editor appearing twice is if there were more pings that happened while I had the editor open, which is exactly what you'd expect.
Basically, when a ping happens, the prompt appears. If the prompt can't appear because there's already an unanswered prompt open, or a previous incarnation of the editor, then an editor opens instead so you can catch up.
And you can always force the editor to pop up by dismissing a prompt without answering it, by hitting enter.
I fear I'm making it sound overcomplicated now. I actually think it's always doing the obvious intuitive thing so, @nslater, I think something must be wrong with your setup.