While I would not use as strong a language as tso - I wouldn't "disqualify" the others for not getting the toroidal as it was very hard and probably unfair for a 15 minute time limit - I certainly agree with his point that just "time" on a very hard sudoku is not a good criterion for a competition's final puzzle.
As an organizer at the WSC, I would have kept the 7-puzzle playoff round mostly as it was (while there were many variants of varying difficulties, all the puzzles until the end greatly encouraged logic and discouraged guessing) but done something like use a cumulative score to rate performance during the playoff. The person who was eliminated in the toroidal round, Tetsuya Nishio, had actually had the best playoffs of anyone competing if you just count completed puzzles. He actually completed 4 of the 6 puzzles he saw, earning full marks more times than anyone else. If you used cumulative score from the playoffs, he would have survived the toroidal round and another competitor who had not done as well throughout the playoff would have been eliminated - in fact, the whole elimination order would have been much different.
A playoff system that does not reward past success may work well in the realm of sport (who doesn't like an upset by their underrated football team over a more favored eleven), but seems unsettling in a mental competition.
I also doubt that a standard sudoku can be made very hard without it becoming a better or at least quite reasonable strategy to "guess" than to use logical steps. At the very least, the puzzle must be strongly playtested to ensure there are no good guesspoints but I have not encountered any sudoku writer who really bothers to consider this possibility.
The impossible to implement way to judge the top solver is to make the puzzle solution be presented more as a logical proof than as just a filled grid. If you had to write out/describe your steps and your reasonings behind each placement, it would be harder to win by guessing as no judge would accept "well, it had to be a 1 or a 6, and I tried the 6, and that worked" as a logical step. As this seems too unwieldy, the only way I can see to make a playoff work well is for it to be over several puzzles, and particularly over puzzles where either guessing is not possible, or where using logic is not a penalty based on a time constraint.
My teammate Wei-Hwa's point, which seems in line with tso's, is that something like a couple (say three) moderate difficulty puzzles is a better playoff than a super hard sudoku that allows guessing. A great sudoku solver can run through a medium sudoku faster than someone who guesses. As you make the sudoku harder and harder, there more often than not arise "guessing" routes that reward luck and not skill. Imagine any great logical sudoku solver against 5-10 other people who all may resort to guessing after making the "easy" initial placements. Do you think, with enough other people, guessing won't win on just a single hard sudoku? Would you rate the best poker player based on how a single hand played out where the luck of cards could be far more important than any skill at reading people?
My ideal playoff in this kind of format would be a sudoku relay. Imagine 5-7 medium sudoku all set up so that solving the first one reveals the given numbers for the second and so on forward. The audience would still have the fun of seeing who is getting farther fastest, but the winner would be the person who could solve lots of puzzles well - maybe not the fastest on an individual puzzle, but the fastest over a fairly large number. Overall skill, not luck, would become more favored. Consistently being the best solver of each puzzle would be the only way to win.
Anyway, I've rambled on enough. These are points to think about and discuss as competitive Sudoku events continue. On an aside, I finished writing up my WSC trip report and for those who have enjoyed my writing so far on the event, you can find it on my blog
here. While not all of it is relevant to sudoku and some is intended more for my friends, it does gives a sense of my experiences as a competitor in this event and may prove interesting for some of you to read and hopefully interest you in trying to qualify for your country's WSC team next year.
Thomas Snyder