DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Everything about Sudoku that doesn't fit in one of the other sections

DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby MADDY_KAPUR » Thu Jul 02, 2020 4:57 am

Actually since a few months...I got interested in Sudoku, and I want to solve difficult puzzles, but wanna do them on a basis of difficulty..... I have tries gsf's method and Sudoku Explainer, they are not correct. :D
MADDY_KAPUR
 
Posts: 1
Joined: 02 July 2020

Re: DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby JasonLion-Admin » Thu Jul 02, 2020 8:53 pm

There is no good difficulty ranker for Sudoku since there is no good definition of what "difficulty" is. Many of use believe that no such definition is even possible. gsf's method and Sudoku Explainer are both "correct" for their specific definitions of "difficulty", but as you noticed those definitions are not good approximations to human solver difficulty.
User avatar
JasonLion-Admin
Site Admin
Site Admin
 
Posts: 85
Joined: 17 April 2010
Location: Silver Spring, MD, USA

Re: DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby JPF » Thu Jul 02, 2020 10:15 pm

The best way to define a rating system for the difficulty of sudoku puzzles close to the difficulty felt by humans is to set-up an ad-hoc committee of human solvers. The committee would solve all the puzzles submitted to them. The average time taken by the committee to solve the puzzle would by definition be the rating of the puzzle, measured in seconds.
To avoid that the growing competence of the members of the committee leads to a bias compared to amateurs, it would be advisable to renew each year a part, say 50%, of the committee...

JPF
JPF
2017 Supporter
 
Posts: 4155
Joined: 06 December 2005
Location: Paris, France

Re: DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby enxio27 » Thu Jul 02, 2020 11:02 pm

Not "correct", or merely not what you're looking for?? Perhaps you should first list the techniques that are in your own solving repertoire and look for puzzles with only those techniques, possibly with one or two additional techniques to provide more challenge.

I know my own limitations with respect to solving techniques. For many years I have used Ruud van der Werf's (Sudocue) rankings for difficulty of techniques. As I recall, he ranked the techniques specifically for human solvers. If a puzzle requires a technique not in my repertoire, I set the puzzle aside. At this point, I have trouble mustering up the interest to learn additional techniques, so puzzles that require them may or may not ever be attempted by me. I have access to plenty of puzzles that are "enxio27-solvable" but still challenging enough for me to find them enjoyable.
User avatar
enxio27
 
Posts: 511
Joined: 13 November 2007

Re: DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby SpAce » Fri Jul 03, 2020 1:54 am

Hi JPF,

JPF wrote:The best way to define a rating system for the difficulty of sudoku puzzles close to the difficulty felt by humans is to set-up an ad-hoc committee of human solvers. The committee would solve all the puzzles submitted to them. The average time taken by the committee to solve the puzzle would by definition be the rating of the puzzle, measured in seconds.

Wouldn't that process give similar ratings to both hard and tedious puzzles? Even if a puzzle took a long time to solve because of many required steps, I wouldn't call it difficult if it could be progressed relatively constantly. A puzzle could also take a long time just because it has a narrow and non-obvious solve path, even if relatively few and easy techniques are actually required. (The latter case is a bit more related to actual difficulty.) Personally I think the most interesting rating is simply based on the hardest step required (like SER but with updated techniques and ratings), though it's obviously not the whole story. No single rating can be perfect even in theory, because there are many forces at play.

To avoid that the growing competence of the members of the committee leads to a bias compared to amateurs, it would be advisable to renew each year a part, say 50%, of the committee...

Why would that bias be bad? Why would anyone (including the amateurs themselves) even care about the opinion of amateurs? I'd rather fill the committee with the best experts in various manual solving methods. I think that would give a much more accurate picture of the real difficulty of a puzzle. If something is difficult for experts, it certainly is (much more) difficult for amateurs too, but not vice versa. The only time that isn't necessarily true is if the puzzle is hard or tedious to solve with methods preferred by experts but succumbs easily to amateur methods (guessing, T&E). Then again, I think most experts would probably find those kinds of solutions pretty quickly too (an example and some comments).
-SpAce-: Show
Code: Select all
   *             |    |               |    |    *
        *        |=()=|    /  _  \    |=()=|               *
            *    |    |   |-=( )=-|   |    |      *
     *                     \  ¯  /                   *   

"If one is to understand the great mystery, one must study all its aspects, not just the dogmatic narrow view of the Jedi."
User avatar
SpAce
 
Posts: 2354
Joined: 22 May 2017

Re: DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby enxio27 » Fri Jul 03, 2020 2:41 am

SpAce wrote:Even if a puzzle took a long time to solve because of many required steps, I wouldn't call it difficult if it could be progressed relatively constantly. A puzzle could also take a long time just because it has a narrow and non-obvious solve path, even if relatively few and easy techniques are actually required. (The latter case is a bit more related to actual difficulty.) Personally I think the most interesting rating is simply based on the hardest step required (like SER but with updated techniques and ratings), though it's obviously not the whole story.

One of the strengths, IMO, of Ruud's rating system is that it takes into account not only the most difficult technique required, but also how many steps of each technique are required. Unfortunately, as I recall, his rating tool works only on single-grid vanilla puzzles.
User avatar
enxio27
 
Posts: 511
Joined: 13 November 2007

Re: DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby Hajime » Fri Jul 03, 2020 8:02 am

Where can I find info about 'Ruud's rating system'?
I could not find it at Sudocue.net .
My wish is to expand an honest rating system for human solvable puzzles, especially for all kinds of Gattai.
User avatar
Hajime
 
Posts: 167
Joined: 20 April 2018
Location: Netherlands

Re: DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby SudoKai » Fri Jul 03, 2020 9:31 am

Hajime wrote:Where can I find info about 'Ruud's rating system'?...


Hope the following is what you seek.

Difficulty with Ratings
https://www.sudocue.net/guide.php#Ratings

Difficulty rating (Under: The Status Bar)
This number is calculated by adding the base scores for all solving steps, with some charges and discounts for special situations in the solving path. Details for this rating can be found in the Analysis Dialog. The tooltip will show the rating name that corresponds to this number.
https://www.sudocue.net/sudocueguide.php

Collection file analysis (.scl)
https://www.sudocue.net/fileformats.php
SudoKai
 
Posts: 44
Joined: 07 June 2014
Location: South-Africa

Re: DOES ANYONE KNOW WHAT'S THE BEST WAY TO RATE A SUDOKU?

Postby tarek » Fri Jul 03, 2020 11:38 am

All of these rating systems unfortunately will depend on the resolution rules & the order they are applied. So there will be bias. You also mentioned the number of steps of similar difficulty. These can be accounted for with area under the curve but again it is biased to the order/configuration of the puzzle. The shortest solution path (closely similar to what the players are doing for the daily puzzles is another way of looking on how difficult a sudoku puzzle is but even that is biased towards the single step solution.

There are no winners here ... You just need to choose what suits you

tarek
User avatar
tarek
 
Posts: 3726
Joined: 05 January 2006


Return to General