The hardest sudokus (new thread)

Everything about Sudoku that doesn't fit in one of the other sections

Re: The hardest sudokus (new thread)

Postby mith » Sun Feb 27, 2022 11:30 pm

Speaking of correlation between SER and clues...

Meet 11.9 #10 (and friends):

Code: Select all
........1.....2.......3..45..6.......71.8....23..67..8.827..1..6...23...7.381.6..  ED=11.9/1.2/1.2
........1.......2......3..4..2..56...37.682...5.27.8...2673....3.58.6...78..5....  ED=11.8/1.2/1.2
........1.......2......3..4..2..56...37.682...5.27.8...2673.....8..5....3.58.6.7.  ED=11.8/1.2/1.2
........1.......2......3..4..2.356.7.3.6.82...5.72.8...26.7....3.5.86...78.5.....  ED=11.8/1.2/1.2
........1.......2......3..4..2.356...376.82...5.72.8...26.7....3.5.86...78.5.....  ED=11.8/1.2/1.2
........1.......2......3..4..2.356...376.82...5.72.8...26.7.....8.5.....3.5.86.7.  ED=11.8/1.2/1.2
........1.....2.......3..45..1.23....267.81..73.61.8...17.6.....8.......2.3.87..6  ED=11.8/1.2/1.2
........1.......2......3..4..2..56.7.3..682...5.27.8...2673....3.58.6...78..5....  ED=11.8/1.2/1.2
........1.......2......3..4..3.5.2....627.8...8...65.7.78.6....5.273....63.8.5...  ED=11.8/1.2/1.2
........1.......2......3..4..5..67...6.28.5..83..7.2...58.6....6.35.7...72.83....  ED=11.8/1.2/1.2
........1.......2......3..4..5..67...6.28.5..83..7.2...5..6....6.35.7.8.72.83....  ED=11.8/1.2/1.2
........1.......2......3..4..3.5.2....627.8...8.3.65.7.78.6....5.27.....63.8.5...  ED=11.8/1.2/1.2
........1.......2......3..4..5.367...6.82.5..83.7..2...586.....6.3.57...72..8....  ED=11.8/1.2/1.2
........1.......2......3..4..5.367...6.82.5..83.7..2...5.6.....6.3.57.8.72..8....  ED=11.8/1.2/1.2

11.7s and 11.6s below:
Hidden Text: Show
Code: Select all
.......12......345.....3..6..768.....69.31...83.7.9.6..16..7...39...81..7.89.....  ED=11.7/1.2/1.2
.......12......345.....3..6..768.....69.31...83.7.9....16..7...39...81..7.89..6..  ED=11.7/1.2/1.2
........1...234.....2.15.....6....78.28...1.979..8.26..198..7.62.7....9.68.......  ED=11.7/1.2/1.2
.......12......345....13.....6.78....3719....89.3.6.7..1986.7..3.8..9...67.......  ED=11.7/1.2/1.2
........1......234.....2.56..7.8.5...29.51....8.9.7....9872..1.2.5.18...71...9...  ED=11.7/1.2/1.2
........1......234.....2.56..7.8.5...29.51....8.9.71...9872....2.5.18...71...9...  ED=11.7/1.2/1.2
...............123.....1.45..6.78....714.9...98.6..4...6718..9.14.9.6...8.9..7...  ED=11.7/1.2/1.2
...............123.....1.45..6.7.4...18.49....7.8.69...8761..9.1.4.97...69...8...  ED=11.7/1.2/1.2
........1....23.....1.45.....6...78..79....1481..7.6.9.47.....619.4...786.8...9..  ED=11.7/1.2/1.2
........1....23.....1.45.....6...78..79....1481..7.6.9.47.....619.4....86.87..9..  ED=11.7/1.2/1.2
........1....23.45..214.63.....513.4...2.4.1....36.52..2.6.....67.....5.895......  ED=11.7/1.2/1.2
........1....23.45..214.63.....513.4...2.4.1....36.52..2.6.5...67.......895......  ED=11.7/1.2/1.2
........1....23......145.....6...78..79....1281..7.6.9.27.....619.2...786.8...9..  ED=11.7/1.2/1.2
........1....23......145.....6...78..79....1281..7.6.9.27.....619.2....86.87..9..  ED=11.7/1.2/1.2
........1....23......145.....6...78..79.....281..7.6.9.27...1.619.2...786.8...9..  ED=11.7/1.2/1.2
........1....23......145.....6...78..79.....281..7.6.9.27...1.619.2....86.87..9..  ED=11.7/1.2/1.2
........1.......23.....45....467...8.86..5...79.4......579.68..64..879..8..54....  ED=11.7/1.2/1.2
........1.......23.....45....467...8.86..5...79.4.......954.....579.68..64..879..  ED=11.7/1.2/1.2
........1.......23.....45....467...8..6..5...79.4.8....579.68..64..879..8..54....  ED=11.7/1.2/1.2
.......12......3.4.....256...478.....273.9...98........3849...724.......7.92.8..3  ED=11.7/1.2/1.2
.......12......3.4.....256...478.....273.9...98..2.....3849...724.......7.9..8..3  ED=11.7/1.2/1.2
........1....23.45..214.63......4.1....36.52..2..513.4...6.....76.....5.895......  ED=11.7/1.2/1.2
........1....23.45..214.63......4.1....36.52..2..513.4...6.5...76.......895......  ED=11.7/1.2/1.2
........1....23.....1.45.....6...78..79.....481..7.6.9.47...1.6.9.4...786.8...9..  ED=11.7/1.2/1.2
........1....23.....1.45.....6...78..79.....481..7.6.9.47...1.6.9.4....86.87..9..  ED=11.7/1.2/1.2
........1.....2.34..2...56...578.....276.9...98..2.....68.9.7..25.......7.95.86..  ED=11.7/1.2/1.2
........1......234....25.....678..9..98.52...75...6....69..87..52..6....8.729....  ED=11.7/1.2/1.2
........1....23......145.....6..7.89.79...1.383....6...678..93.31......69.8.....7  ED=11.7/1.2/1.2
........1....23.....4.56.....78..59..5......419.5..8.7.41...7.95.9...18.87.....4.  ED=11.7/1.2/1.2
........1....12......345.....67...89.79...1.383....6...67.8.93.31......79.8.....6  ED=11.7/1.2/1.2
.......12......3.4.....256...478.....273.9...98..2.....38.9...724.......7.94.8..3  ED=11.7/1.2/1.2
........1....12.34...4.567....2.485...41...9..82.59....519.....42...8...8.9......  ED=11.7/1.2/1.2
........1....12.34...4.567....2.485...2.59.....418..9..519.....42...8...8.9......  ED=11.7/1.2/1.2
.......12.....34......567.8...63...1..35.26.9.5..192...69....2.3.2......51.9.....  ED=11.7/1.2/1.2
.......12.....34......567.8...6....1..35.26.9.5..192...693...2.3.2......51.9.....  ED=11.7/1.2/1.2
........1...234.....2.15.....67...89.79...1..82....6...1......7.67.8.92.9.8.....6  ED=11.7/1.2/1.2
........1....23.....2145.....6.7..89.79...1..82....6...1......6.678..92.9.8.....7  ED=11.7/1.2/1.2
........1.....2345.23........6.3......78.9...28..679...3..78....6.92....9.8..6.7.  ED=11.7/1.2/1.2
........1......234....25.....678..9..98..2...75...6....695.87..52..6....8.7.9....  ED=11.7/1.2/1.2
........1....23.....4.56.....7.....4..87..59.19.5....8.41.7.8.9.8.....4.5.9...17.  ED=11.7/1.2/1.2
........1....23.....4.56.....7.....4..87..59.19.5....8.41...8.95.9...17.78.....4.  ED=11.7/1.2/1.2
........1....23.....4.15.....67...89.79...1.484....6...1......7.67.8.94.9.8.....6  ED=11.7/1.2/1.2
........1.....2.34.23...56......1....5478....1.6.95....1..4..2..653.....4.2...3.6  ED=11.7/1.2/1.2
........1.....2.34.23...56......1....5478....1.6.95....1..4..2..6532....4.....3.6  ED=11.7/1.2/1.2
........1.....2.34....4.56...14.5..2.4612...3.5..63.....73......89..6...51.....2.  ED=11.7/1.2/1.2
........1.....2.34....4.56...14.5..2.461....3.5..63.....73......892.6...51.....2.  ED=11.7/1.2/1.2
........1....23......145.....1....6..278...1996.2..8.7.89.7.1.66.....9..7.......2  ED=11.7/1.2/1.2
........1....23.....1.45.....6.....4..7....8.89..6..17.784...961.....7..64.9..1.8  ED=11.7/1.2/1.2
...............123.....1.45..4..6....1789..6..8...7....96.784..1.864.9..7..1.....  ED=11.7/1.2/1.2
........1.....2.3..45........2..6....5.78....76.2.4..8..764.....86...5..42.5.87..  ED=11.7/1.2/1.2
........1.....2.3..45........2..6....5.78....76...4..8..764.....86.2.5..42.5.87..  ED=11.7/1.2/1.2
........1.......23....45.....4..6....57.849..86.97.5...98.6..7.6..8.....74..5....  ED=11.7/1.2/1.2
........1.......23....45.....4..6....57.849..86.97.5...7..5.....9846..7.6..8.....  ED=11.7/1.2/1.2
........1.......23....45.....4..6....57.849..86.97.5...4..5.....98.6..7.6..8.7...  ED=11.7/1.2/1.2
........1.....2.......3..45..6.......3781.6..28...71...1862....3.2.78..67..3.....  ED=11.7/1.2/1.2
........1.......23....45.....4..6....57.849..86.97.5...98.6..7.47..5....6..8.....  ED=11.7/1.2/1.2
........1.......23....45.....4..6....57.849..86.97.5...98.6..7.4...5....6..8.7...  ED=11.7/1.2/1.2

Hidden Text: Show
Code: Select all
.......12......345....13.....6.3.....7.6.8.918.197.....6.3.7....8319.6..9.7.8....  ED=11.6/1.2/1.2
........1...234.....2.15.....6...27..286..1.997......8..7.9168..6......281....9.7  ED=11.6/1.2/1.2
........1..2.34.....3.56.....7.8..19.9....2..13....7.8..98...7..21....8387.3..9.2  ED=11.6/1.2/1.2
........1....23.45.2541.36......4.23...36.1..1...524.6...6.5....57......689......  ED=11.6/1.2/1.2
........1....23.45.2541.36......4.23...36.1..1...524.......5....57...6..689......  ED=11.6/1.2/1.2
........1....23.45.2541.36......4.23...36.1..1...524.....6.5....57...6...89......  ED=11.6/1.2/1.2
................12.....1345..3.67.....891....79.3.8.6..17.869..6..73....83...9...  ED=11.6/1.2/1.2
........1.....2.......3..45..1.......62.781..83.61.7...783.....2.3.86..761.72....  ED=11.6/1.2/1.2
........1.....2.......3..45..1..3....62.781..83.61.7...78......2.3.86..761.72....  ED=11.6/1.2/1.2
........1.....2.34.23........523.....6..57.8.3.76.8....32.76..8.5..2....8.6..57..  ED=11.6/1.2/1.2
........1.......23....45.....4.56.....789....69...7.8..56.798..7..68.5..9.8..4...  ED=11.6/1.2/1.2
........1....23.......45.....1..6.78.7....9..83....16...7.....9.987..63.61.3..8..  ED=11.6/1.2/1.2
........1.....2.34.23........5.3......67.8...27..56.8..3..67..8.5..2....8.7..56..  ED=11.6/1.2/1.2
........1.....2.......3..45..6.......23.67..817.82.....8...3...36.71.8..7.2..61..  ED=11.6/1.2/1.2


The new 11.9 is 26c, goes up to 29c with singles, and is pretty much obliterated by "Thor's Hammer".
mith
 
Posts: 950
Joined: 14 July 2020

Re: The hardest sudokus (new thread)

Postby mith » Sun Feb 27, 2022 11:36 pm

Actually, there's another single before the 11.9 steps, so it goes up to 30c.
mith
 
Posts: 950
Joined: 14 July 2020

Re: The hardest sudokus (new thread)

Postby jovi_al01 » Sun Feb 27, 2022 11:40 pm

congrats on finding #10! :]
User avatar
jovi_al01
 
Posts: 102
Joined: 26 July 2021

Re: The hardest sudokus (new thread)

Postby mith » Sun Feb 27, 2022 11:47 pm

Thanks; I think this one may be somewhat fragile in terms of morph. The three other minimals of the 30c are 11.8 after being minlexed. I'll have to try maxlex at some point.
mith
 
Posts: 950
Joined: 14 July 2020

Re: The hardest sudokus (new thread)

Postby mith » Mon Feb 28, 2022 1:57 am

I just ran SE on a random morph of one of the 27c minimals:

Code: Select all
........1.....2.34..2.3156.....5......4...6...78..6.......65.4.1..2.43..4..31..25  ED=11.8/1.2/1.2
8..2.3.........1.2.....4.........8.61.8..927.6...7..91.12.....79.6....287..9..6..  ED=11.9/1.2/1.2


It may be that all of them have some 11.9s and some 11.8s, depending on order of eliminations.

Small update as I was typing this - it finished two more morphs, here are three consecutive steps in each morph:

puzzle above: 11.6, 11.9, 11.8
second puzzle: 11.5, 11.9, 11.9
third puzzle: 11.6, 11.8, 11.8
mith
 
Posts: 950
Joined: 14 July 2020

Re: The hardest sudokus (new thread)

Postby denis_berthier » Mon Feb 28, 2022 2:46 am

Hi Mith,
Great results.
Great examples also of the SER problem with morphs.

mith wrote:Speaking of correlation between SER and clues...

I can't see anything related to this correlation. 26 or 27 clues = 64.7% of all the minimal puzzles in unbiased stats.

My Macs are busy on other calculations, but I'll rate (wrt BpB) all these new 11.9 or 11.8 puzzles later.
denis_berthier
2010 Supporter
 
Posts: 3970
Joined: 19 June 2007
Location: Paris

Re: The hardest sudokus (new thread)

Postby denis_berthier » Mon Feb 28, 2022 3:07 am

.
BTW, the new 11.9 has "only" 209 candidates after Singles and whips[1].
Any search strategy for finding the highest SER that relies on additional pre-filters may fail to find some of the highest.
The recent findings showed this has been the case with adding some criterion related to the q1 or q2 ratings.
But it'd also be the case if one keeps only puzzles with too high numbers of candidates as starting points for proximity search.
Last edited by denis_berthier on Mon Feb 28, 2022 10:44 am, edited 2 times in total.
denis_berthier
2010 Supporter
 
Posts: 3970
Joined: 19 June 2007
Location: Paris

Re: The hardest sudokus (new thread)

Postby champagne » Mon Feb 28, 2022 7:52 am

mith wrote:Speaking of correlation between SER and clues...
.....

The new 11.9 is 26c, goes up to 29c with singles, and is pretty much obliterated by "Thor's Hammer".


Hi mith,

Great job. My last update of my own data base is now 2 years old.
From what I know of Sudoku Explainer, to produce such high ratings with more clues, you must have a highly interleaved system. This is usually linked to an exotic pattern.

With so any fresh stuff, I intend to mark a pause in what I am doing an to scan your (an others) new findings.
Do you have a summary of all 11.x up to date somewhere?

BTW, I have also to update my list of exotic patterns with the last published

And surely, we have no correlation between the number of candidates and the rating.
No need to refer to statistics, all of us know that the 17 clues and the 18 clues have no very high ratings, although they have big number of candidates.

EDIT I checked my last data base of potential hardest I can add that no 19 had been found at that time with a rating >=11.0
and as far as I know, the main criteria for fresh seeds for a vicinity search has been when I worked on this topic the SER of old grids.
Last edited by champagne on Mon Feb 28, 2022 3:29 pm, edited 2 times in total.
champagne
2017 Supporter
 
Posts: 7350
Joined: 02 August 2007
Location: France Brittany

Re: The hardest sudokus (new thread)

Postby denis_berthier » Mon Feb 28, 2022 9:03 am

champagne wrote:And surely, we have no correlation between the number of candidates and the rating.
No need to refer to statistics, all of us know that the 17 clues and the 18 clues have no very high ratings, although they have big number of candidates.

That's where some basic knowledge of statistics could help you avoid such false claims.
The mean number of candidates for the 17s (even after eliminating those that are solved by whips[1]) is much lower than those presented above.
Open the most elementary book of stats to learn what "mean" means.

To be more precise, one has (not taking into account the 17s that are in W1, for which nb-cands is 0)):
Code: Select all
mean-nb-cands= 118.30        sd-nb-cands= 66.30
denis_berthier
2010 Supporter
 
Posts: 3970
Joined: 19 June 2007
Location: Paris

Re: The hardest sudokus (new thread)

Postby hendrik_monard » Mon Feb 28, 2022 1:35 pm

mith wrote:Speaking of correlation between SER and clues...

Meet 11.9 #10 (and friends):

Hi mith,

Fantastic finding. Congratulations.
So my forecast of September 30th (see http://forum.enjoysudoku.com/post310478.html#p310478 ) was not so unrealistic after all.
hendrik_monard
 
Posts: 83
Joined: 19 April 2021
Location: Leuven (Louvain) Belgium

Re: The hardest sudokus (new thread)

Postby hendrik_monard » Mon Feb 28, 2022 4:22 pm

mith wrote:Thanks; I think this one may be somewhat fragile in terms of morph. The three other minimals of the 30c are 11.8 after being minlexed. I'll have to try maxlex at some point.


Hi mith,
I calculated the SER of the canonical isomorph of your new 11.9, and got the following result:
........1.....2.......3..45..6.......71.8....23..67..8.827..1..6...23...7.381.6.. ED=11.9/1.2/1.2
98.76.5..7.4.5......6......5.8..7.4..79.45.6..6.98.......8.........9.3.2......4.. ED=11.8/1.2/1.2
hendrik_monard
 
Posts: 83
Joined: 19 April 2021
Location: Leuven (Louvain) Belgium

Re: The hardest sudokus (new thread)

Postby mith » Mon Feb 28, 2022 4:41 pm

denis_berthier wrote:.
BTW, the new 11.9 has "only" 209 candidates after Singles and whips[1].
Any search strategy for finding the highest SER that relies on additional pre-filters may fail to find some of the highest.
The recent findings showed this has been the case with adding some criterion related to the q1 or q2 ratings.
But it'd also be the case if one keeps only puzzles with too high numbers of candidates as starting points for proximity search.


Indeed, my previous q2 filters would have easily missed this one (49386 q2, 46752 q1).

(The correlation comment was just that the new 11.9 is 26c, expandable to 30c, vs. the 21c-23c previously known ones. The higher clue counts were just not well explored previously.)

champagne wrote:Great job. My last update of my own data base is now 2 years old.
From what I know of Sudoku Explainer, to produce such high ratings with more clues, you must have a highly interleaved system. This is usually linked to an exotic pattern.


Yes, the initial breakthrough on the high clue front was finding the trivalue oddagon pattern ("Thor's Hammer"), pointed out by marek previously in this thread. Essentially all of the high clue puzzles found have shown some variant of the pattern, and there have been a huge number of them from that initial seed.

In all cases I've looked at, there is a pattern of 6 digits in three boxes (after basics), one of which sees the other two, such that the empty cells span all three rows and columns, along with a fourth box (completing the rectangle of boxes) with 4 or 5 digits, such that some completions of the fourth box are impossible due to the parity of the permutations of missing digits. It shouldn't be all that hard to search for in existing puzzles, I just haven't written code to do it yet. It may also be possible to use the pattern as a starting point for generating puzzles, vs. neighborhood searching on existing puzzles.

Aside from the trivalue oddagon "exotic" pattern, there have been some other more specific non-3-colorable patterns discovered (shye's Patto Patto pattern being the one that comes to mind), so a generalized search for patterns with chromatic number 4 could be fruitful.

With so any fresh stuff, I intend to mark a pause in what I am doing an to scan your (an others) new findings.
Do you have a summary of all 11.x up to date somewhere?


I have been planning to get an update posted soon anyway. I still need to find some time to process jovi_al's two puzzle batches (a bunch of 19c puzzles, including some new 10.X, and a large collection of DJE puzzles as yet unchecked), as well as the pattern game. I think it may also be wise to let the neighborhood search iterate a bit longer with the new finds - I woke up this morning to a new batch of 139 11.8s (!), which more than doubles what was in the database. (I'll post those shortly.)

EDIT I checked my last data base of potential hardest I can add that no 19 had been found at that time with a rating >=11.0
and as far as I know, the main criteria for fresh seeds for a vicinity search has been when I worked on this topic the SER of old grids.


The high for 19c remains at 10.5 (three puzzles using gsf minlex, though I am aware of at least one coloin puzzle which is a 10.5 with the right morph). When I publish an update, I will include any 10.2+ from 19c and 35c-36c, since no 11s have been found there. (Edit while typing - I hadn't checked in a while, but I did finally generate some minimal 37c, two of which are skfr 10+. I'll have to rate those as well.)
mith
 
Posts: 950
Joined: 14 July 2020

Re: The hardest sudokus (new thread)

Postby mith » Mon Feb 28, 2022 4:43 pm

hendrik_monard wrote:
mith wrote:Thanks; I think this one may be somewhat fragile in terms of morph. The three other minimals of the 30c are 11.8 after being minlexed. I'll have to try maxlex at some point.


Hi mith,
I calculated the SER of the canonical isomorph of your new 11.9, and got the following result:
........1.....2.......3..45..6.......71.8....23..67..8.827..1..6...23...7.381.6.. ED=11.9/1.2/1.2
98.76.5..7.4.5......6......5.8..7.4..79.45.6..6.98.......8.........9.3.2......4.. ED=11.8/1.2/1.2


This doesn't surprise me; I ran a few more morphs, and it was essentially 50-50 on whether it rated 11.9 or 11.8. I'm going to take a close look at these puzzles to see what exactly is going on with the rating.
mith
 
Posts: 950
Joined: 14 July 2020

Re: The hardest sudokus (new thread)

Postby mith » Mon Feb 28, 2022 4:46 pm

Both 37c puzzles rate at 10.2 SER:

Code: Select all
...........1.23.45.24.5.6.3....75.8....38.7.6.8.6.435...6.47.38.7853.46.4..8..5.7  ED=10.2/1.2/1.2
...........1..2.34..5.3162.....2786..6.3.8..77.864.2.3..6.7438..4.8...728.72.34..  ED=10.2/1.2/1.2
mith
 
Posts: 950
Joined: 14 July 2020

Re: The hardest sudokus (new thread)

Postby mith » Mon Feb 28, 2022 4:49 pm

This is the state of the max SER by clue count (for minimals), with the new 11.8s filling in at 25c and 28c:
Code: Select all
19c - 10.5
20c - 11.8
21c-23c - 11.9
24c-25c - 11.8
26c - 11.9 (morph dependent)
27c-30c - 11.8
31c - 11.6
32c - 11.5
33c - 11.3
34c - 11.1
35c-36c - 10.6
37c - 10.2
mith
 
Posts: 950
Joined: 14 July 2020

PreviousNext

Return to General

cron