Skip to main content
4 of 18
added 22 characters in body
Dennis Mod
  • 210.6k
  • 5
  • 94
  • 168

Scope

As I see it, there are four types of invalid answers:

  1. Answers that produce incorrect results.

    This is the most common type, and usually an accident.

  2. Answers that produce correct results, but break a rule of the challenge, ignore parts of the spec or violate a loophole.

    For example, answers that make use of banned built-ins fall into this category.

  3. Answers that produce correct results, comply with the rules of the challenge, but aren't a serious contender for the winning criteria.

    For code golf, e.g., this is limited to answers that do not even attempt to golf the code. Answers that are simply poorly golfed are not invalid.

  4. Answers that aren't actually answers.

    This includes anything but code that is intended to solve the challenge.

Deletion

Answers of type 4 aren't actually answers. The policy across the entire network is that they should be deleted on sight, and there's no reason to make an exception here.

I think all other types should be removed as well, with varying levels of urgency. Even without an official policy, this is commonplace across the entire network. While these answers should not be flagged on other SE sites, high rep users delete them all the time.

If the answer is invalid without the poster's knowledge, it shouldn't be deleted without notifying the poster first and giving him some time to fix his mistake.

If the answer is deliberately invalid (most common for type 2), there really is no reason to wait or tell the poster something he already knows.

Self-deletion

If you figured out or have been told that your answer is valid, I think self-deletion is the best option.

  • Deleting the answer quickly will prevent it from accumulating downvotes, which may or may not get removed after the answer has been fixed.

  • Deleting the answer yourself means that you can undelete it just as easily.

    In contrast, undeletion will require moderator intervention if the answer has been deleted by others.

  • While deleting your answer will invalidate any rep your may have earned from it, you'll get it back if you fix the answer.

Flags

Not an answer flags were creates specifically for type 4 answers, and should be cast when they are encountered.

Very low quality flags sort of apply to all other types, but can only be cast on answers with a non-positive score.

This leaves flagging as in need of moderator intervention.

The policy across the entire network is that flags should not be used to indicate [...] an altogether wrong answer, but I think our site should be (once again) an exception.

First of all, we have a huge moderator : activity ratio. Stack Overflow moderators cannot be expected to complete the time-consuming task of deciding whether an answer is valid or not, but our flag volume is rather low and checking PPCG answers is usually easier. A flag that clearly explains why the answer is invalid (i.e, which rule it violates or which test case it fails) does not require an unreasonable amount of moderator time.

Also, unlike other sites, I don't think we need examples of what not to do. There is absolutely no merit in keeping an answer that violates a rule of the challenge; they don't teach anything. If an answer passes all test cases but still produces incorrect results, there is no benefit in keeping the answer after a new test case has been added to the question.

But it is important to wait until the moderator can actually take action. I think deleting an accidentally invalid answer on sight is an unnecessarily unpleasant experience for the poster, and undeleting it requires yet another moderator intervention.

TL;DR

  • If your own answer turns out to be invalid, delete it yourself.

  • Immediately leave a comment on all invalid answers that are not your own.

  • Immediately flag invalid answers of type 4 as not an answer.

  • Give the poster time to fix or self-delete his invalid answer of type 1 to 3.

  • If a sufficient amount of time has passed (say 48 hours), flag the answer as in need of moderator intervention, providing an explanation of why it is invalid.

  • If you fix your self-deleted answer, undelete it.

    If you fix your answer and cannot undelete it yourself, flag it as in need of moderator intervention, requesting its undeletion.

Dennis Mod
  • 210.6k
  • 5
  • 94
  • 168