EDIT: I simplified the challenge and posted it in the sandbox. Summary: python2/python3 compatible judge script that works on a solution's output (instead of fork/exec-ing the solution); users are trusted not to cheat; arbitrary large file for input instead of randomness; no time limit; totalScore = gameScore - codeSize
I'm thinking of designing a single-player game strategy challenge in which programs are fed lines on stdin, to which they respond on stdout. A program must respond to the current line before learning the next one. This is similar to how the popular Moby Dick challenge works. Ideally, I would provide a judge program that forks the solution as a separate process, supplies the input and computes the score.
What would be a good scoring scheme that discourages excessive use of resources? I was thinking some linear combination of code size, timing (self-measured? hard limit?), and challenge-specific "points". Would it be too rude to tweak a published formula and ask everyone to rejudge?