Low/Hi Clue Thresholds

Everything about Sudoku that doesn't fit in one of the other sections

Re: LCT Project Review

Postby Mathimagics » Fri Nov 22, 2019 5:58 am

Hi Serg,

Serg wrote:Do you mean that each line in the table above represents number of ED grids, for which minimal number of clues in valid puzzles is equal to 17C, 18C, etc?


Not exactly. Let's look at the current grid status table, adding column KM = "Known Min" (ie. there is no puzzle with less clues):

Code: Select all
               Grids   Known Min
     ---------------------------
     17C:      46301       46301 
     18C:  219375245
     19C: 5253040692       59242
     20C:     268296      268296
     21C:          4           4
          ----------------------
          5472730538      373843


The status for each category:

  • 17C: all are KM, since it is known that there are no 16C puzzles
  • 18C: we can't know for sure that any of these are KM until such time as we complete LCT-17 (blue's rigorous 17C search)
  • 19C: we know that 59242 are KM because they have been tested with blue's rigorous Find18C function. The number is small because this is an expensive test (~4s per grid). But for all other grids we don't yet know the KM status.
  • 20C: we know that every one of these grids has no 19C or less puzzle
  • 21C: we know that every one of these grids has no 20C or less puzzle

For 19C grids, we keep a KM status indicator, that gets set whenever we explicitly test that grid with Find18C and find no 18C. If we do find an 18C puzzle, the 19C catalog record is converted into an 18C entry.

We don't have a KM flag for 18C grids, because we don't have an explicit Find17C test. But LCT-17, on completion, will have identified any remaining 17C's. Then we can say that any catalog entry of type 18C is definitely KM.

The big "black hole" we are left with after LCT-17 completes will be the ~5 billion 19C grids for which we can't be sure are KM until such time as they are explicitly tested, OR we come up with an efficient way to identify ALL 18C grids.

Cheers,
Jim
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

LCT-18 Progress

Postby Mathimagics » Sun Nov 24, 2019 1:47 pm

Results for recent batches produced by LCT-18 workers:

Code: Select all
Date              Batches     ED grids     New grids   Yield     Total 18C
--------------------------------------------------------------------------
22 Nov 2019      81 -   96   15,674,304    5,359,776   34.19%
23 Nov 2019      97 -  112   15,563,744    5,379,546   34.56%
23 Nov 2019     113 -  128   15,740,306    5,202,150   33.05%   
24 Nov 2019     129 -  144   15,667,837    5,061,052   32.30%  236,494,782
25 Nov 2019         (Colin)   3,687,978    1,157,767   31.39%  237,652,549
25 Nov 2019     145 -  160   15,623,621    4,941,106   31.63%  242,593,655


[EDIT] this means we have found ~25% of the predicted 968 million (+/- 13 million) 18C grids.
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

LCt-18 Progres

Postby Mathimagics » Sat Dec 07, 2019 9:19 am

Results for recent batches produced by LCT-18 workers:

Code: Select all
Date              Batches     ED grids     New grids    Yield
-------------------------------------------------------------
25 Nov 2019     161 -  176   15,667,897    4,692,544   29.95%
26 Nov 2019     177 -  192   15,737,238    4,565,802   29.01%
28 Nov 2019     193 -  208   15,673,691    4,348,479   27.74%
28 Nov 2018     209 -  224   15,685,814    4,480,898   28.57%
29 Nov 2019     225 -  240   15,562,115    4,183,054   26.88%
30 Nov 2019     241 -  256   15,761,383    4,291,692   27.23%
01 Dec 2019     257 -  272   15,751,756    4,246,077   26.96%
02 Dec 2019     273 -  288   15,701,212    4,020,863   25.61%
02 Dec 2019     289 -  304   15,660,397    3,864,569   24.68%
03 Dec 2019     305 -  320   15,668,936    3,888,474   24.82%
04 Dec 2019     321 -  336   15,689,167    3,617,314   23.06%
05 Dec 2019     337 -  352   15,578,272    3,674,002   23.58%
05 Dec 2019     353 -  368   15,703,846    3,610,967   22.99%
06 Dec 2019     369 -  384   15,622,537    3,521,177   22.54%
07 Dec 2019     385 -  400   15,791,640    3,512,622   22.24% 


Total 18C grids found = 310,062,298
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

LCT-18 Progress

Postby Mathimagics » Tue Dec 31, 2019 7:31 am

Batches produced by Gen18H since the last post:

Hidden Text: Show
Code: Select all
Date              Batches     ED grids     New grids    Yield
-------------------------------------------------------------
08 Dec 2019     401 -  416   15,548,298    3,322,085   21.37%
09 Dec 2019     417 -  432   15,662,851    3,506,261   22.39%
10 Dec 2019     433 -  448   15,716,955    3,330,571   21.19%
11 Dec 2019     449 -  464   15,769,076    3,128,583   19.84%
11 Dec 2019     465 -  480   15,753,254    3,130,577   19.87%
12 Dec 2019     481 -  496   15,730,394    3,188,506   20.27%
13 Dec 2019     497 -  512   15,562,815    3,020,245   19.41%
14 Dec 2019     513 -  528   15,684,137    2,965,126   18.91%
15 Dec 2019     529 -  544   15,540,220    3,052,064   19.64%
15 Dec 2019     545 -  560   15,822,752    2,925,451   18.94%
16 Dec 2019     561 -  576   15,632,390    2,876,672   18.40%
17 Dec 2019     577 -  592   15,697,059    2,603,041   16.58%
18 Dec 3019     593 -  608   15,615,527    2,640,300   16.91%
19 Dec 2019     609 -  624   15,680,362    2,584,728   16.48%
20 Dec 2019     625 -  640   15,817,157    2,643,581   16.71%
23 Dec 2019     641 -  656   15,590,684    2,375,455   15.24%
23 Dec 2019     657 -  672   15,639,328    2,426,678   15.52%
24 Dec 2019     673 -  688   15,586,865    2,306,292   14.80%
26 Dec 2019     689 -  704   15,850,464    2,348,249   14.82%
26 Dec 2019     705 =  720   15,560,133    2,371,526   15.24%
27 Dec 2019     721 -  736   15,446,247    2,210,284   14.31%
28 Dec 2019     737 -  752   15,760,107    2,247,959   14.26%
29 Dec 2019     753 -  768   15,594,851    2,183,202   14.00%
30 Dec 2019     769 -  784   15,566,469    2,222,574   14.28%
31 Dec 2012     785 -  800   15,700,898    2,258,725   14.39%


Together with coloin's contributions for the same period (~25 million new grids), the total 18C grid count is now 402,552,192.
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

LCT-18 Progress

Postby Mathimagics » Sat Feb 01, 2020 7:30 am

Batches/yields for the past month:

Hidden Text: Show
[/code]
01 Jan 2020 801 - 816 15,654,671 2,175,172 13.89%
02 Jan 2020 817 - 832 15,599,456 2,010,565 12.89%
03 Jan 2020 833 - 848 15,581,950 2,014,135 12.93%
04 Jan 2020 849 - 864 15,633,450 2,110,141 13.50%
06 Jan 2020 865 - 880 15,635,523 1,944,318 12.44%
07 Jan 2020 881 - 896 15,604.645 1,946,872 12.48%
08 Jan 2020 897 - 912 15,576,636 1,921,768 12.34%
09 Jan 2020 913 - 928 15,738,552 1,974,022 12.54%
09 Jan 2020 929 - 944 15,658,147 1,880,430 12.01%
10 Jan 2020 945 - 960 15,626,962 1,933,528 12.37%
11 Jan 2020 961 - 976 15,610,712 1,890,443 12.11%
12 Jan 2020 977 - 992 15,560,565 1,841,618 11.84%
13 Jan 2020 993 - 1008 15,687,289 1,725,013 11.00%
14 Jan 2020 1009 - 1024 15,528,053 1,669,829 10.75%
15 Jan 2020 1025 - 1040 15,716,740 1,896,595 12.07%
16 Jan 2020 1041 - 1056 15,875,183 1,849,322 11.65%
17 Jan 2020 1057 - 1072 15,590,512 1,757,688 11.27%
18 Jan 2020 1073 - 1088 15,700,861 1,691,541 10.77%
19 Jan 2020 1089 - 1104 15,562,761 1,735,197 11.15%
20 Jan 2020 1105 - 1120 15,717,935 1,624,633 10.34%
21 Jan 2020 1121 - 1136 15,634,336 1,622,490 10.38%
22 Jan 2020 1137 - 1152 15,760,133 1,719,249 10.91%
23 Jan 2020 1153 - 1168 15,583,101 1,617,306 10.38%
24 Jan 2020 1169 - 1184 15,704,603 1,712,694 10.91%
25 Jan 2020 1185 - 1200 15,574,694 1,572,282 10.10%
26 Jan 2020 1201 - 1216 16,254,907 1,630,985 10.01%
26 Jan 2020 1217 - 1232 15,523,157 1,501,681 9.67%
27 Jan 2020 1233 - 1248 15,853,058 1,607,707 10.14%
28 Jan 2020 1249 - 1264 15,604,715 1,538,526 9.86%
29 Jan 2020 1265 - 1280 15,755,886 1,503,860 9.54%
30 Jan 2020 1281 - 1296 15,503,457 1,512,875 9.76%
31 Jan 2020 1297 - 1312 15,687,032 1,501,163 9.57%[/code]


Net yields are now down to ~9%. And I have had to cut down the number of worker processes from 22 to 16, due to the alarming power consumption revealed by our recent electricity bills!

The total grid count is now 466,504,364, so we have about 48% of blue's estimate of 968 million.

coloin has made a very interesting discovery, namely that, for an 18C puzzle, a fast way to run a limited search of the {-2, +2} vicinity is this:

  • choose the clue with the least # of 17C solutions (ie # of solutions with that clue removed)
  • search this 17C puzzle with {-1, +2}

This procedure will generally identify the clue with the highest {-2, +2} yield (or close), but is 15 times faster than the full {-2, +2} search.

Can this lead to a Gen18C process with a better yield? We are investigating this ...
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

LCT-18 Progress

Postby Mathimagics » Wed Feb 05, 2020 9:08 am

I have completed the initial round of tests of Gen18Z, which is a worker process that is based on coloin's "selective {-2, +2}" search method, as outlined above.

First a quick review of the existing process, Gen18H. This uses random morphing of 19C puzzles, "Harvesting" any puzzles with redundant clues which gives us 18C puzzles. This has been the main source of new 18C grids over the past few months.

16 worker processes are running on JACK (my 16-core PC), and currently their output is a steady 15.5 million ED grids every 22 hours on average. The percentage of these grids that are found to be new (ie: no 18C already found) is currently about 9%, and this %yield is slowly decreasing. We have found about half of the likely total of 18C grids so far.

Averaging by worker-hours, the current Gen18H workers thus produce about 44,000 ED grids/hour (GPH), of which ~4,000 are new grids (NPH). So absolute progress is measured by NPH, the number of new grids per worker-hour. But the %yield (NPH v GPH) is still of interest, since any method that provides higher %yields, even at lower production levels (NPH), is of interest when we consider the task ahead (the 50% of 18C grids that are not yet found).

An overview of Gen18Z:

  • Seed generation: select a random grid from the catalog, one for which 19-clues is the best known result. Use blue's Find18C function to test it for 18C. If this function fails, mark the grid as "No 18C" (so it doesn't get selected again) and try another grid.
  • List propagation: use the selective {-2,+2} method to enumerate new 18C puzzles. Collect any new puzzles for list propagation in a subsequent pass. Repeat this process until no new puzzles found (closure), or until some operational limit is reached.
  • List reduction: reduce the collection to one puzzle per ED grid, save this list as a new batch.

The cost of selective {-2,+2} enumeration is still relatively expensive - on average 2s per puzzle (full {-2,+2} enumeration costs 40-60s per puzzle). The main parameter used to limit the list propagation is a limit on the number of puzzles to be {-2,+2} tested (NTEST). Evidence suggests that, when the list propagation is self-sustaining, pursuing additional passes leads ultimately to diminishing new grid yields.

The first round of tests was done with NTEST = 2000, but this was applied within each propagation pass, so the batch times (where propagation was self-sustaining) vary from 1 to 3 hours. In future tests NTEST will specify the absolute total limit, and the batch times should then be fairly constant.

The first test results are shown below. Each batch corresponds to a single seed grid, and the entry lists the time (in minutes), the #of ED grids (ed), and the # of new grids (ng). For grids with sustained propagation, the %yield and approximate NPH value are shown.
Hidden Text: Show
Code: Select all
Batch    6:   72.17m, ed =  30505, ng =   2773   9.09%, nph = 2305
Batch    7:   72.58m, ed =  15688, ng =   2541  16.20%, nph = 2100
Batch    8:    0.95m, ed =      1, ng =      1
Batch    9:    3.43m, ed =      6, ng =      5
Batch   10:   88.02m, ed =  27553, ng =   5019  18.22%, nph = 3421
Batch   11:   72.48m, ed =  21985, ng =   4534  20.62%, nph = 3753
Batch   12:   81.02m, ed =  32247, ng =   1741   5.40%, nph = 1289
Batch   13:   89.85m, ed =  17804, ng =   3549  19.93%, nph = 2370
Batch   14:    0.52m, ed =      2, ng =      2
Batch   15:    1.62m, ed =      1, ng =      1
Batch   16:    4.23m, ed =      1, ng =      1
Batch   17:   62.02m, ed =  30106, ng =   1274   4.23%, nph = 1233
Batch   18:    0.40m, ed =      2, ng =      1
Batch   19:   87.97m, ed =  22280, ng =   4605  20.67%, nph = 3141
Batch   20:    0.53m, ed =      1, ng =      1
Batch   21:  149.50m, ed =  42468, ng =   5435  12.80%, nph = 2181
Batch   22:    0.28m, ed =      1, ng =      1
Batch   23:  150.08m, ed =  13952, ng =   3575  25.62%, nph = 1429
Batch   24:  102.67m, ed =  31270, ng =   4931  15.77%, nph = 2882
Batch   25:    0.53m, ed =      1, ng =      1
Batch   26:    1.45m, ed =      3, ng =      1
Batch   27:   26.53m, ed =   7738, ng =   1357  17.54%, nph = 3069
Batch   28:  111.70m, ed =  36821, ng =   4761  12.93%, nph = 2557
Batch   29:   88.75m, ed =  23078, ng =   3303  14.31%, nph = 2233
Batch   30:   90.95m, ed =  34722, ng =   2971   8.56%, nph = 1960
Batch   31:  109.37m, ed =  34143, ng =   4979  14.58%, nph = 2732
Batch   32:  138.78m, ed =  28961, ng =   4914  16.97%, nph = 2124
Batch   33:    0.45m, ed =      1, ng =      1
Batch   34:   67.65m, ed =  29880, ng =   2274   7.61%, nph = 2017
Batch   35:   74.35m, ed =  25248, ng =   2796  11.07%, nph = 2256
Batch   36:   18.23m, ed =   6068, ng =    852  14.04%, nph = 2804
Batch   37:    0.08m, ed =      1, ng =      1
Batch   38:   59.48m, ed =  21516, ng =   2459  11.43%, nph = 2480
Batch   39:    0.35m, ed =      1, ng =      1
Batch   40:   68.98m, ed =  16019, ng =   2444  15.26%, nph = 2126
Batch   41:  118.82m, ed =  24434, ng =   5900  24.15%, nph = 2979
Batch   42:   65.78m, ed =  38504, ng =   1962   5.10%, nph = 1790
Batch   43:    0.20m, ed =      1, ng =      1
Batch   44:    0.97m, ed =      1, ng =      1
Batch   45:    0.42m, ed =      1, ng =      1
Batch   46:    0.40m, ed =      1, ng =      1
Batch   47:    1.98m, ed =      1, ng =      1
Batch   48:   98.65m, ed =  26657, ng =   5507  20.66%, nph = 3349
Batch   49:  108.95m, ed =  27484, ng =   5900  21.47%, nph = 3249
Batch   50:    0.77m, ed =      1, ng =      1
Batch   51:   92.22m, ed =  28282, ng =   4257  15.05%, nph = 2770
Batch   52:   73.95m, ed =  15872, ng =   3704  23.34%, nph = 3005
Batch   53:   71.78m, ed =  21817, ng =   2483  11.38%, nph = 2075
Batch   54:   92.82m, ed =  28393, ng =   3639  12.82%, nph = 2352
Batch   55:   93.12m, ed =  14793, ng =   4232  28.61%, nph = 2727
------------------------------------------------------------------
    Total : 2718.78m, ed = 776316, ng = 110695  14.26%, nph = 2443


As you can see, 1 in every 3 grids "failed", ie didn't result in any sustained {-2,+2} propagation. The selective {-2,+2} enumeration tends to favour the most productive cases, but this is by no means guaranteed. In the next round of tests I will make a complete {-2,+2} enumeration of the initial seed puzzle, and we will see if that reduces the "failed" cases.

On the surface, it would appear that the NPH rates (average ~2200) are much less than the current Gen18H workers. But encouragement is found in the incidence of %yields that are often much higher. This (hopefully) suggests that this method will ultimately be more effective in finding "remote" 18C grids.
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

Re: LCT-18 Progress

Postby Mathimagics » Wed Feb 05, 2020 6:01 pm

Mathimagics wrote:As you can see, 1 in every 3 grids "failed", ie didn't result in any sustained {-2,+2} propagation. The selective {-2,+2} enumeration tends to favour the most productive cases, but this is by no means guaranteed. In the next round of tests I will make a complete {-2,+2} enumeration of the initial seed puzzle, and we will see if that reduces the "failed" cases.


There were 19 cases in the initial test set that failed to propagate. After re-running them with full {-2,+2} enumeration (for the seed puzzle) worked for 13 of them:

Code: Select all
Batch   56:    0.37m, ed =      3, ng =      2
Batch   57:   61.58m, ed =  27103, ng =   2342   8.64%, nph = 2282
Batch   58:   61.95m, ed =  16404, ng =    851   5.19%, nph =  824
Batch   59:   59.55m, ed =  13365, ng =   2777  20.78%, nph = 2798
Batch   60:   68.88m, ed =  15830, ng =   2577  16.28%, nph = 2245
Batch   61:    0.35m, ed =      1, ng =      1
Batch   62:    0.38m, ed =      4, ng =      4
Batch   63:    0.47m, ed =      3, ng =      1
Batch   64:    0.42m, ed =      2, ng =      2
Batch   65:   56.50m, ed =  30360, ng =   2180   7.18%, nph = 2315
Batch   66:   59.58m, ed =  33299, ng =    981   2.95%, nph =  988
Batch   67:   61.07m, ed =  22795, ng =   2821  12.38%, nph = 2772
Batch   68:   65.42m, ed =  21196, ng =   1581   7.46%, nph = 1450
Batch   69:   61.23m, ed =  31343, ng =   2054   6.55%, nph = 2013
Batch   70:   64.28m, ed =  15176, ng =   1986  13.09%, nph = 1854
Batch   71:   71.83m, ed =  30011, ng =   2652   8.84%, nph = 2215
Batch   72:    0.35m, ed =      1, ng =      1
Batch   73:   73.45m, ed =  11693, ng =   2516  21.52%, nph = 2055
Batch   74:   56.88m, ed =  26949, ng =   2033   7.54%, nph = 2144
------------------------------------------------------------------
    Total :  824.55m, ed = 295538, ng =  27362   9.26%, nph = 1991
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

Re: Low/Hi Clue Thresholds

Postby Mathimagics » Fri Feb 07, 2020 8:49 am

coloin wrote:Instead of trying to process every seed - if we are selective and only process those seeds which have a highish eg 100 sol - maybe this will tend to keep us out of the non-remote/already found territory.
There wont be so many puzzles made however ...

This might work, the trouble is that testing it is tricky and time-consuming. Perhaps an option to keep up our sleeve for when the search really gets difficult ...

Meanwhile, some good news, I think!

I have found a bug in blue's PM1 code. He only searched 1/2 of the possible puzzles. Even with this fixed, it is still 4x faster than my version.

For current workers (Gen18H) the impact will be slightly slower morph test times, but higher yields ultimately ... we will see in a few days time when the new version has generated a few batch sets.

For Gen18Z this could also be significant - if I can make a {-1,+2} version of blue's PM1 code, it should be much faster than the current version!
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

Gen18Z Testing

Postby Mathimagics » Fri Feb 07, 2020 12:30 pm

Results for a full days work for 4 workers running Gen18Z. Note in particular the results for batches #1010, #1046 and #1075.

Hidden Text: Show
Code: Select all
Batch 1001:   59.08m, ed =  16920, ng =   3259  19.26%, nph = 3310
Batch 1002:    0.67m, ed =      4, ng =      3
Batch 1003:   62.55m, ed =  30280, ng =   1733   5.72%, nph = 1662
Batch 1004:   63.67m, ed =  29866, ng =   1933   6.47%, nph = 1822
Batch 1005:   68.37m, ed =  10541, ng =   2890  27.42%, nph = 2536
Batch 1006:   61.43m, ed =  20340, ng =   2297  11.29%, nph = 2243
Batch 1007:   63.80m, ed =  20929, ng =   2979  14.23%, nph = 2802
Batch 1008:   62.40m, ed =  13572, ng =   2535  18.68%, nph = 2437
Batch 1009:   73.37m, ed =  11542, ng =   2768  23.98%, nph = 2264
Batch 1010:   65.45m, ed =  11528, ng =   3923  34.03%, nph = 3596  **
Batch 1011:   70.12m, ed =  15763, ng =   2799  17.76%, nph = 2395
Batch 1012:   63.97m, ed =  30717, ng =   1685   5.49%, nph = 1581
Batch 1013:   68.75m, ed =  14773, ng =   4078  27.60%, nph = 3559
Batch 1014:   61.05m, ed =  25847, ng =   2318   8.97%, nph = 2278
Batch 1015:   63.85m, ed =  26679, ng =   2114   7.92%, nph = 1987
Batch 1016:   64.90m, ed =  14304, ng =   2020  14.12%, nph = 1867
Batch 1017:   70.27m, ed =  20854, ng =   2209  10.59%, nph = 1886
Batch 1018:   72.07m, ed =  23015, ng =   1858   8.07%, nph = 1547
Batch 1019:   73.08m, ed =   7568, ng =   2630  34.75%, nph = 2159
Batch 1020:   84.33m, ed =  21352, ng =   3201  14.99%, nph = 2277
Batch 1021:   90.77m, ed =  23804, ng =   2870  12.06%, nph = 1897
Batch 1022:   64.30m, ed =  47674, ng =    993   2.08%, nph =  927
Batch 1023:   59.53m, ed =  13135, ng =   3350  25.50%, nph = 3376
Batch 1024:   70.25m, ed =  19441, ng =   3440  17.69%, nph = 2938
Batch 1025:    2.68m, ed =      1, ng =      1
Batch 1026:   74.27m, ed =  16160, ng =   2887  17.87%, nph = 2332
Batch 1027:   58.82m, ed =  19746, ng =   1751   8.87%, nph = 1786
Batch 1028:   56.75m, ed =  19654, ng =   2143  10.90%, nph = 2266
Batch 1029:    0.38m, ed =      2, ng =      2
Batch 1030:   61.58m, ed =  22378, ng =   2796  12.49%, nph = 2724
Batch 1031:   67.88m, ed =  15049, ng =   1895  12.59%, nph = 1675
Batch 1032:   60.55m, ed =  12082, ng =   2775  22.97%, nph = 2750
Batch 1033:   65.12m, ed =  15908, ng =   2930  18.42%, nph = 2700
Batch 1034:   67.50m, ed =  24119, ng =   2099   8.70%, nph = 1866
Batch 1035:   71.18m, ed =  18125, ng =   2010  11.09%, nph = 1694
Batch 1036:   61.35m, ed =  18588, ng =   1894  10.19%, nph = 1852
Batch 1037:   64.65m, ed =  13693, ng =   2027  14.80%, nph = 1881
Batch 1038:   60.50m, ed =  20083, ng =   2563  12.76%, nph = 2542
Batch 1039:    1.60m, ed =      1, ng =      1
Batch 1040:    0.70m, ed =      4, ng =      3
Batch 1041:   64.88m, ed =  14322, ng =   2139  14.94%, nph = 1978
Batch 1042:   59.75m, ed =  21896, ng =   1491   6.81%, nph = 1497
Batch 1043:   59.95m, ed =  26806, ng =   2277   8.49%, nph = 2279
Batch 1044:   62.00m, ed =  16952, ng =   2232  13.17%, nph = 2160
Batch 1045:   66.87m, ed =  28922, ng =   2395   8.28%, nph = 2149
Batch 1046:   65.85m, ed =  13883, ng =   4455  32.09%, nph = 4059  **
Batch 1047:   57.12m, ed =  28021, ng =   1737   6.20%, nph = 1825
Batch 1048:   62.85m, ed =  18968, ng =   2459  12.96%, nph = 2347
Batch 1049:   61.78m, ed =  18244, ng =   4362  23.91%, nph = 4236
Batch 1050:   67.02m, ed =  14123, ng =   3129  22.16%, nph = 2801
Batch 1051:   59.77m, ed =  19337, ng =   2549  13.18%, nph = 2559
Batch 1052:   59.30m, ed =  10634, ng =   3479  32.72%, nph = 3520
Batch 1053:   61.68m, ed =  30788, ng =   1334   4.33%, nph = 1298
Batch 1054:   64.32m, ed =  22325, ng =   1828   8.19%, nph = 1705
Batch 1055:   63.37m, ed =  23236, ng =   2100   9.04%, nph = 1988
Batch 1056:   57.90m, ed =  20702, ng =   1838   8.88%, nph = 1905
Batch 1057:   61.27m, ed =  18394, ng =   3496  19.01%, nph = 3424
Batch 1058:   63.65m, ed =  27558, ng =   1907   6.92%, nph = 1798
Batch 1059:   61.62m, ed =  15268, ng =   3512  23.00%, nph = 3420
Batch 1060:   60.45m, ed =  27807, ng =   2125   7.64%, nph = 2109
Batch 1061:   61.17m, ed =  17146, ng =   2530  14.76%, nph = 2482
Batch 1062:    1.47m, ed =      2, ng =      2
Batch 1063:   63.37m, ed =  18771, ng =   3108  16.56%, nph = 2943
Batch 1064:   58.15m, ed =  16950, ng =   3260  19.23%, nph = 3364
Batch 1065:   65.28m, ed =  15011, ng =   2336  15.56%, nph = 2147
Batch 1066:   71.33m, ed =  24450, ng =   2958  12.10%, nph = 2488
Batch 1067:   72.12m, ed =  16644, ng =   2719  16.34%, nph = 2262
Batch 1068:   66.08m, ed =  23515, ng =   2376  10.10%, nph = 2157
Batch 1069:   71.47m, ed =  20407, ng =   2442  11.97%, nph = 2050
Batch 1070:   59.93m, ed =  21242, ng =   2579  12.14%, nph = 2582
Batch 1071:   58.95m, ed =  16445, ng =   2988  18.17%, nph = 3041
Batch 1072:    0.43m, ed =      2, ng =      1
Batch 1073:   67.63m, ed =  23913, ng =   2379   9.95%, nph = 2110
Batch 1074:   65.97m, ed =   9443, ng =   2984  31.60%, nph = 2714   
Batch 1075:   57.95m, ed =  14226, ng =   4454  31.31%, nph = 4612   ***
Batch 1076:    1.03m, ed =      2, ng =      2
Batch 1077:   65.28m, ed =  13405, ng =   1975  14.73%, nph = 1815
Batch 1078:    0.75m, ed =      2, ng =      2
Batch 1079:   57.00m, ed =  16929, ng =   2411  14.24%, nph = 2538
Batch 1080:    2.10m, ed =      7, ng =      6
Batch 1081:   58.88m, ed =  14224, ng =   2280  16.03%, nph = 2323
Batch 1082:   58.22m, ed =  13671, ng =   3374  24.68%, nph = 3477
Batch 1083:   58.57m, ed =  17531, ng =   3227  18.41%, nph = 3306
Batch 1084:   73.47m, ed =  20985, ng =   1391   6.63%, nph = 1136
Batch 1085:   69.27m, ed =  13139, ng =   3038  23.12%, nph = 2632
Batch 1086:    0.80m, ed =      1, ng =      1
Batch 1087:   73.58m, ed =  24306, ng =   1344   5.53%, nph = 1096
Batch 1088:   71.98m, ed =  16619, ng =   2038  12.26%, nph = 1699
Batch 1089:   74.90m, ed =  26037, ng =   2135   8.20%, nph = 1710
Batch 1090:   74.48m, ed =  33400, ng =   1458   4.37%, nph = 1174
Batch 1091:   67.58m, ed =  21166, ng =   3014  14.24%, nph = 2676
Batch 1092:   71.38m, ed =  27184, ng =   2736  10.06%, nph = 2300
Batch 1093:   65.72m, ed =  19549, ng =   1887   9.65%, nph = 1723
------------------------------------------------------------------
    Total : 5361.22m, ed =1620551, ng = 207941  12.83%, nph = 2327

If we can reduce the cost of doing the {-1,+2} tests, this could be really prove to be a gun method!
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

Re: Low/Hi Clue Thresholds

Postby Mathimagics » Fri Feb 07, 2020 4:07 pm

Each batch begins with single 18C seed puzzle. This is always a new grid - I use Blue's Find18C function to get this puzzle, and only look at grids that aren't already known to have an 18C, or known NOT to have one.

For the seed puzzle I do a complete enumeration of {-2, +2}. As I explained above, although this takes 40-60 seconds, it is worth the effort because it picks up many cases where the selective ("best 17C subpuzzle") enumeration would not otherwise find anything to propagate.

All of the {-2, +2} tests except for this first one are done in selective mode (ie via the "best17C subpuzzle").

========================================
ListSPC.zip
(65.87 KiB) Downloaded 257 times

Sub-Puzzle Count tool: a sub-puzzle is a given puzzle with 1 clue removed. This tool takes a puzzle, and removes the clue with the lowest subpuzzle solution count.
Code: Select all
> ListSPC 1.3........6.....2.....254.......6....7..8........4..5.9..6.....7.....2.....1.3..
1.3........6.....2.....254.......6.......8........4..5.9..6.....7.....2.....1.3..

A file of puzzles can be used:
Code: Select all
> ListSPC Test18C.txt

The tool can also list all sub-puzzle solution counts for a given puzzle. Example:
Code: Select all
c:> ListSPC -x 1.3........6.....2.....254.......6....7..8........4..5.9..6.....7.....2.....1.3..
Puzzle has 18 clues
Clue 01 = 1:  solns =   22468
Clue 03 = 3:  solns =   52738
Clue 12 = 6:  solns =   92137
Clue 18 = 2:  solns =    1147
Clue 24 = 2:  solns =  187609
Clue 25 = 5:  solns =    5944
Clue 26 = 4:  solns =  158243
Clue 34 = 6:  solns =   35139
Clue 39 = 7:  solns =      45
Clue 42 = 8:  solns =   17870
Clue 51 = 4:  solns =   38394
Clue 54 = 5:  solns =     788
Clue 56 = 9:  solns =    1677
Clue 59 = 6:  solns =  110334
Clue 65 = 7:  solns =    5249
Clue 71 = 2:  solns =    5047
Clue 77 = 1:  solns =    7598
Clue 79 = 3:  solns =    3523
Last edited by Mathimagics on Sun Feb 09, 2020 5:27 pm, edited 1 time in total.
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

Gen18Z Tests

Postby Mathimagics » Sun Feb 09, 2020 9:33 am

Ok, one more day of batch testing for the new Gen18Z process.

I finally understand exactly what blue's {-1,+1} code does, and the principle is quite simple. For each subpuzzle ie {-1}, we test all the {+1} candidates, in the usual fashion. But we also keep a list of distinct solutions, and by using clever bitmasking, we can ask whether a value D has occurred in cell CN in some solution already found, and whether this has occurred twice.

So when we come to testing CN = D, we can skip this solver call if we know that CN = D has occurred twice in the solution list for this {-1} subpuzzle. This reduces the solver calls by roughly half.

When blue first gave me this code, the puzzle generation time was in fact reduced by a factor of ~4, not 2. It turns out he had a bug in the outer loop, he only added clue values to the right of the {-1} clue, and ignored the possibilities to the left. I only found this by comparing his code with mine on a per-puzzle basis, and noticed that I was finding more {-1,+1} puzzles.

And what about the impact of this on Gen18H yields? Fixing the bug certainly had the expected slowdown of the process, as it takes on average of 31 hours to produce a batch in "full-search mode", compared to just 22 hours previously. Sadly, however, this didn't translate to any noticable increased grid %yield, so the absolute yield (NPH) is greatly reduced! :(

The bottom line is that Gen18H, which is basically {-1,+1} processing throughout, runs best in "half-search mode"!

===============================================

Ok, we will return to this issue later on. For Gen18Z we take a 17-clue puzzle and do a {-1, +2} search. For each {-1} we need to add 2 clues at a time, and it is not a simple matter to translate blue's method into 2 clue mode. But we can use it in a simple outer loop as follows:

  • for each possible 18c puzzle corresponding to the 17-clue base puzzle plus 1 added clue, do a (blue) {-1, +1} search

Using this approach has the desired effect, reducing batch generation time by ~40%, and thus to improved NPH results. This set of batch results shows avg NPH = 3880 over a day's work. (A couple of batches, 1201 + 1202, show %yields of 50% !!)
Hidden Text: Show
Code: Select all
Batch 1102:   38.77m, ed =  27473, ng =   2626   9.56%, nph = 4064
Batch 1103:   43.67m, ed =  19627, ng =   1649   8.40%, nph = 2266
Batch 1104:   46.15m, ed =  19737, ng =   2981  15.10%, nph = 3876
Batch 1105:   46.53m, ed =  19737, ng =   2981  15.10%, nph = 3844
Batch 1106:    0.78m, ed =      3, ng =      2
Batch 1107:    0.65m, ed =      3, ng =      2
Batch 1108:   44.73m, ed =  14982, ng =   4845  32.34%, nph = 6499
Batch 1109:   42.68m, ed =  19845, ng =   2507  12.63%, nph = 3524
Batch 1110:   42.78m, ed =  19845, ng =   2507  12.63%, nph = 3516
Batch 1111:   46.63m, ed =  12294, ng =   3490  28.39%, nph = 4490
Batch 1112:   40.48m, ed =  49518, ng =   1136   2.29%, nph = 1684
Batch 1113:   40.02m, ed =  20755, ng =   1930   9.30%, nph = 2894
Batch 1114:    0.45m, ed =      2, ng =      1
Batch 1115:   42.27m, ed =  18436, ng =   3010  16.33%, nph = 4273
Batch 1116:   42.50m, ed =  18436, ng =   3010  16.33%, nph = 4249
Batch 1117:   42.30m, ed =  14262, ng =   4058  28.45%, nph = 5756
Batch 1118:   46.57m, ed =  49412, ng =   1930   3.91%, nph = 2487
Batch 1119:   54.63m, ed =  18118, ng =   3708  20.47%, nph = 4072
Batch 1120:   55.03m, ed =  18118, ng =   3708  20.47%, nph = 4043
Batch 1121:   50.13m, ed =  29112, ng =   4088  14.04%, nph = 4893
Batch 1122:   41.20m, ed =  14909, ng =   3545  23.78%, nph = 5163
Batch 1123:   42.53m, ed =  12517, ng =   2995  23.93%, nph = 4225
Batch 1124:   47.33m, ed =  22620, ng =   3443  15.22%, nph = 4364
Batch 1125:   99.18m, ed =  30828, ng =   2093   6.79%, nph = 1266
Batch 1126:   99.22m, ed =  30828, ng =   2093   6.79%, nph = 1266
Batch 1127:   37.73m, ed =  17562, ng =   2233  12.71%, nph = 3551
Batch 1128:   46.45m, ed =   9824, ng =   2301  23.42%, nph = 2972
Batch 1129:   43.05m, ed =  26903, ng =   2974  11.05%, nph = 4145
Batch 1130:   43.13m, ed =  26903, ng =   2974  11.05%, nph = 4137
Batch 1131:   43.57m, ed =  16413, ng =   3145  19.16%, nph = 4331
Batch 1132:   45.92m, ed =  10777, ng =   3965  36.79%, nph = 5181
Batch 1133:    0.53m, ed =      1, ng =      1
Batch 1134:   46.67m, ed =  16468, ng =   3810  23.14%, nph = 4899
Batch 1135:   46.60m, ed =  16468, ng =   3810  23.14%, nph = 4906
Batch 1136:    0.70m, ed =      3, ng =      3
Batch 1137:    0.72m, ed =      3, ng =      3
Batch 1138:   44.80m, ed =  17768, ng =   1674   9.42%, nph = 2242
Batch 1139:   50.90m, ed =  31882, ng =   2305   7.23%, nph = 2717
Batch 1140:    1.38m, ed =      1, ng =      1
Batch 1141:   49.12m, ed =  10235, ng =   3828  37.40%, nph = 4676
Batch 1142:   49.08m, ed =  10235, ng =   3828  37.40%, nph = 4679
Batch 1143:   44.15m, ed =  20928, ng =   4882  23.33%, nph = 6635
Batch 1144:   43.57m, ed =  36640, ng =   2552   6.97%, nph = 3515
Batch 1145:   43.80m, ed =  21311, ng =   2108   9.89%, nph = 2888
Batch 1146:   43.85m, ed =  21311, ng =   2108   9.89%, nph = 2884
Batch 1147:   40.03m, ed =  13503, ng =    776   5.75%, nph = 1163
Batch 1148:   48.37m, ed =  23461, ng =   2441  10.40%, nph = 3028
Batch 1149:   43.77m, ed =  40100, ng =   1672   4.17%, nph = 2292
Batch 1150:   43.88m, ed =  40100, ng =   1672   4.17%, nph = 2286
Batch 1151:   41.80m, ed =  15418, ng =   2968  19.25%, nph = 4260
Batch 1152:    0.58m, ed =      2, ng =      2
Batch 1153:   44.22m, ed =  28115, ng =   2414   8.59%, nph = 3276
Batch 1154:   43.98m, ed =  51994, ng =    854   1.64%, nph = 1165
Batch 1155:   44.10m, ed =  51994, ng =    854   1.64%, nph = 1162
Batch 1156:   37.55m, ed =  15035, ng =   3890  25.87%, nph = 6216
Batch 1157:   44.37m, ed =  14198, ng =   2933  20.66%, nph = 3966
Batch 1158:    0.95m, ed =      1, ng =      1
Batch 1159:   41.52m, ed =  25996, ng =   2733  10.51%, nph = 3950
Batch 1160:   41.48m, ed =  25996, ng =   2733  10.51%, nph = 3953
Batch 1161:   36.15m, ed =   4084, ng =   1958  47.94%, nph = 3250
Batch 1162:   49.20m, ed =  26194, ng =   1949   7.44%, nph = 2377
Batch 1163:   53.18m, ed =  12820, ng =   4490  35.02%, nph = 5065
Batch 1164:   53.17m, ed =  12820, ng =   4490  35.02%, nph = 5067
Batch 1165:   39.40m, ed =  11782, ng =   3742  31.76%, nph = 5698
Batch 1166:   49.52m, ed =  12097, ng =   3332  27.54%, nph = 4037
Batch 1167:   39.57m, ed =  21970, ng =   2315  10.54%, nph = 3511
Batch 1168:   39.75m, ed =  21970, ng =   2315  10.54%, nph = 3494
Batch 1169:   39.35m, ed =  18897, ng =   3616  19.14%, nph = 5514
Batch 1170:   40.75m, ed =  57824, ng =    584   1.01%, nph =  860
Batch 1171:    0.78m, ed =      2, ng =      1
Batch 1172:   35.93m, ed =  36391, ng =   1947   5.35%, nph = 3251
Batch 1173:   40.00m, ed =  18790, ng =   3798  20.21%, nph = 5697
Batch 1174:   40.22m, ed =  18790, ng =   3798  20.21%, nph = 5666
Batch 1175:    1.40m, ed =      1, ng =      1
Batch 1176:    1.43m, ed =      1, ng =      1
Batch 1177:   37.73m, ed =  10474, ng =   3409  32.55%, nph = 5421
Batch 1178:   44.93m, ed =  20623, ng =   2538  12.31%, nph = 3389
Batch 1179:   44.93m, ed =  20623, ng =   2538  12.31%, nph = 3389
Batch 1180:   40.85m, ed =  20913, ng =   3648  17.44%, nph = 5358
Batch 1181:    0.60m, ed =      2, ng =      2
Batch 1182:   56.45m, ed =  30904, ng =   2093   6.77%, nph = 2225
Batch 1183:   40.65m, ed =  36996, ng =   1583   4.28%, nph = 2337
Batch 1184:   40.75m, ed =  36996, ng =   1583   4.28%, nph = 2331
Batch 1185:   40.03m, ed =  17304, ng =   3195  18.46%, nph = 4789
Batch 1186:   38.60m, ed =  28927, ng =   2945  10.18%, nph = 4578
Batch 1187:   35.60m, ed =  34878, ng =   1310   3.76%, nph = 2208
Batch 1188:    0.70m, ed =      2, ng =      2
Batch 1189:   38.80m, ed =  22652, ng =   3577  15.79%, nph = 5531
Batch 1190:   38.87m, ed =  22652, ng =   3577  15.79%, nph = 5522
Batch 1191:   37.93m, ed =  19550, ng =   3617  18.50%, nph = 5721
Batch 1192:   39.45m, ed =  18764, ng =   3676  19.59%, nph = 5591
Batch 1193:   41.37m, ed =  20425, ng =   3065  15.01%, nph = 4446
Batch 1194:   41.50m, ed =  20425, ng =   3065  15.01%, nph = 4431
Batch 1195:   44.00m, ed =  24719, ng =   2734  11.06%, nph = 3728
Batch 1196:   42.35m, ed =  10612, ng =   3866  36.43%, nph = 5477
Batch 1197:   37.15m, ed =  40565, ng =   1100   2.71%, nph = 1777
Batch 1198:   49.13m, ed =  24069, ng =   3239  13.46%, nph = 3955
Batch 1199:   48.93m, ed =  24069, ng =   3239  13.46%, nph = 3972
Batch 1200:   36.10m, ed =  22853, ng =   2015   8.82%, nph = 3349
Batch 1201:   38.35m, ed =  20712, ng =   2805  13.54%, nph = 4389
Batch 1202:   39.95m, ed =   6884, ng =   3530  51.28%, nph = 5302
Batch 1203:   39.92m, ed =   6884, ng =   3530  51.28%, nph = 5306
Batch 1204:   41.25m, ed =  20915, ng =   3411  16.31%, nph = 4961
Batch 1205:   38.20m, ed =  15449, ng =   3139  20.32%, nph = 4930
Batch 1206:   41.63m, ed =  15600, ng =   3004  19.26%, nph = 4329
Batch 1207:   41.57m, ed =  15600, ng =   3004  19.26%, nph = 4336
Batch 1208:   42.45m, ed =  26396, ng =   2177   8.25%, nph = 3077
Batch 1209:   41.80m, ed =  19486, ng =   1833   9.41%, nph = 2631
Batch 1210:   41.18m, ed =  33083, ng =   2301   6.96%, nph = 3352
Batch 1211:   41.20m, ed =  33083, ng =   2301   6.96%, nph = 3351
Batch 1212:   41.32m, ed =  23680, ng =   2865  12.10%, nph = 4161
Batch 1213:   40.45m, ed =  23683, ng =   2670  11.27%, nph = 3960
Batch 1214:    0.37m, ed =      1, ng =      1
Batch 1215:    1.77m, ed =      3, ng =      2
Batch 1216:   50.53m, ed =  20133, ng =   3842  19.08%, nph = 4562
Batch 1217:   50.53m, ed =  20133, ng =   3842  19.08%, nph = 4562
Batch 1218:    0.63m, ed =      3, ng =      3
Batch 1219:    0.62m, ed =      3, ng =      3
Batch 1220:   39.75m, ed =  16861, ng =   2896  17.18%, nph = 4371
Batch 1221:   47.47m, ed =  20455, ng =   2178  10.65%, nph = 2753
Batch 1222:   43.68m, ed =  16100, ng =   2346  14.57%, nph = 3222
Batch 1223:   43.68m, ed =  16100, ng =   2346  14.57%, nph = 3222
Batch 1224:   41.05m, ed =  33109, ng =   1999   6.04%, nph = 2922
Batch 1225:   38.60m, ed =  20668, ng =   2515  12.17%, nph = 3909
Batch 1226:   43.00m, ed =  12315, ng =   4404  35.76%, nph = 6145
Batch 1227:   43.00m, ed =  12315, ng =   4404  35.76%, nph = 6145
Batch 1228:   46.95m, ed =  22639, ng =   1924   8.50%, nph = 2459
Batch 1229:   44.00m, ed =  14463, ng =   3579  24.75%, nph = 4880
Batch 1230:    0.62m, ed =      7, ng =      6
Batch 1231:    0.40m, ed =      1, ng =      1
Batch 1232:   42.50m, ed =  16701, ng =   3289  19.69%, nph = 4643
Batch 1233:   42.63m, ed =  16701, ng =   3289  19.69%, nph = 4629
Batch 1234:    0.58m, ed =      3, ng =      2
Batch 1235:    0.48m, ed =      3, ng =      2
Batch 1236:   41.70m, ed =  18410, ng =   2286  12.42%, nph = 3289
Batch 1237:   42.07m, ed =  25948, ng =   3571  13.76%, nph = 5093
Batch 1238:   44.75m, ed =  33487, ng =   2445   7.30%, nph = 3278
Batch 1239:   44.88m, ed =  33487, ng =   2445   7.30%, nph = 3268
Batch 1240:   45.97m, ed =  13315, ng =   3163  23.76%, nph = 4129
Batch 1241:   42.78m, ed =  21133, ng =   3973  18.80%, nph = 5572
Batch 1242:    0.42m, ed =      1, ng =      1
Batch 1243:   40.40m, ed =  16132, ng =   4251  26.35%, nph = 6313
Batch 1244:   40.27m, ed =  16132, ng =   4251  26.35%, nph = 6334
Batch 1245:   38.80m, ed =  24502, ng =   1869   7.63%, nph = 2890
Batch 1246:   38.12m, ed =  19783, ng =   2607  13.18%, nph = 4104
Batch 1247:   51.30m, ed =  27142, ng =   2026   7.46%, nph = 2370
Batch 1248:   51.40m, ed =  27142, ng =   2026   7.46%, nph = 2365
Batch 1249:   38.77m, ed =  16799, ng =   1476   8.79%, nph = 2284
Batch 1250:   37.23m, ed =  19808, ng =   3730  18.83%, nph = 6011
Batch 1251:   36.53m, ed =  15054, ng =   4091  27.18%, nph = 6719
Batch 1252:   37.42m, ed =  14904, ng =   3006  20.17%, nph = 4820
Batch 1253:   46.92m, ed =  47748, ng =   1584   3.32%, nph = 2026
Batch 1254:   47.02m, ed =  47748, ng =   1584   3.32%, nph = 2021
------------------------------------------------------------------
    Total : 5735.62m, ed =2942927, ng = 370870  12.60%, nph = 3880


So Gen18Z is now roughly on a par with Gen18H (in "half-search" mode), but is actually running in "full-search" mode, so maybe it can do even better. Another round of tests is scheduled!
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

Re: Low/Hi Clue Thresholds

Postby Mathimagics » Sun Feb 09, 2020 1:03 pm

More good news, it seems!

I tested the same 3 seed grids with some parameter changes. NTEST is the limit on number of {-2,+2} tests done for each seed, ie batch, and HS is an option to operate in "half-search mode" (see above).

a) with NTEST = 2000 (the current default)
Code: Select all
Batch 1239:   44.88m, ed =  33487, ng =   2445   7.30%, nph = 3268
Batch 1240:   45.97m, ed =  13315, ng =   3163  23.76%, nph = 4129
Batch 1241:   42.78m, ed =  21133, ng =   3973  18.80%, nph = 5572


b) with NTEST = 3000
Code: Select all
Batch 1239:   62.63m, ed =  54107, ng =   3808   7.04%, nph = 3648
Batch 1240:   63.32m, ed =  19023, ng =   4592  24.14%, nph = 4351
Batch 1241:   59.25m, ed =  31485, ng =   6051  19.22%, nph = 6128


c) with NTEST = 3000 + HS
Code: Select all
Batch 1239:   36.68m, ed =  41685, ng =   2991   7.18%, nph = 4892
Batch 1240:   36.35m, ed =  14593, ng =   3362  23.04%, nph = 5549
Batch 1241:   34.92m, ed =  27676, ng =   5133  18.55%, nph = 8820


d) with NTEST = 5000 + HS
Code: Select all
Batch 1239:   62.08m, ed =  64034, ng =   4529   7.07%, nph = 4377
Batch 1240:   60.45m, ed =  20068, ng =   4839  24.11%, nph = 4803
Batch 1241:   58.62m, ed =  41971, ng =   8050  19.18%, nph = 8240

Test (b) indicates that we can increase NTEST without yield loss, in fact in all cases the NPH was actually increased.

Test (c) suggests that "half-search mode" finds fewer grids, which you would expect, but is much faster and produces even higher NPH. That's really good news!

Test (d) hints at diminishing returns for increased NTEST settings, but these are still very good yields.
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

LCT-18 Progress

Postby Mathimagics » Tue Feb 11, 2020 7:28 am

As we have found what we think are roughly 50% of the grids with an 18C puzzle, it seems worthwhile to do some sampling, in order to get a good idea where we are, and whether any bias is evident in the known results.

blue estimated ~968 million 18C grids, based on 100,000 samples using his Find18C function.

I tested 255,000 grids, 1000 in each catalog band, as follows:

  • count K18 = known 18C grids (ie what we have found so far)
  • count P19 = the pool of known 19C grids (ie no 18C found so far)
  • test 1000 of the 19C pool with Find18C
  • calculate E18 = estimated 18C grids for this band, using K18 + (P19 * N18 / 1000), where N18 is the number of sampled grids testing positive

The LCT catalog has 255 band sections. These have 1-1 correspondence with Band Index for sections 1 - 249. Then we have 6 composite sections: 250, 260, 270, 280, 290 and 300. Section 250 corresponds to band indices 250 to 259, ditto for 260, 270, 280 and 290. Section 300 all band indices from 300 to 416.

The bottom line:
Code: Select all
Total K18 =  478,364,693  ( 8.7% of ED grids)
Estd. E18 =  961,772,175  (17.6% of ED grids)

The per-band report suggests that we have found ~50% in each band, and this is a good thing. What is most interesting perhaps is the variation in 18C grids per band, which can range from ~5% to 50%.

The band entries include the number of known 17C grids (K17), and the ratio K17 / E18. There is some evidence of a correlation here, but I haven't looked too deeply at this yet.

"GT time" is grid-test time - the average time taken for each Find18C call in the band. Interestingly, this seems to suggest that bands with high 18C% cost significantly more than bands with low 18C%.

Full band report: Show
Code: Select all
Band       NGB          Known 18          Pool 19           Estimated 18       GT time    K17  K17:E18
------------------------------------------------------------------------------------------------------
   1   1,007,170      102,362 (10.2%)      903,683          155,732  (15.5%)     1.90s     13  0.0083%
   2  25,502,082    3,290,317 (12.9%)   22,206,501        5,666,412  (22.2%)     3.40s    408  0.0072%
   3  16,538,087    2,407,915 (14.6%)   14,129,116        3,947,988  (23.9%)     4.59s    281  0.0071%
   4   8,417,906    1,090,274 (13.0%)    7,326,127        1,874,169  (22.3%)     3.52s    129  0.0069%
   5  48,737,791    8,310,898 (17.1%)   40,424,747       14,374,610  (29.5%)     5.02s   1039  0.0072%
   6  96,229,042   16,267,889 (16.9%)   79,957,318       27,142,084  (28.2%)     5.12s   2146  0.0079%
   7  15,765,443    3,243,183 (20.6%)   12,521,799        5,572,237  (35.3%)     6.39s    393  0.0071%
   8   5,306,280      778,008 (14.7%)    4,528,083        1,285,153  (24.2%)     4.93s     76  0.0059%
   9   8,136,013    1,502,490 (18.5%)    6,632,941        2,596,925  (31.9%)     4.03s    263  0.0101%
  10  47,174,193    8,337,540 (17.7%)   38,834,786       14,939,453  (31.7%)     5.24s   1112  0.0074%
  11  46,788,396    9,962,659 (21.3%)   36,823,885       16,627,782  (35.5%)     5.77s   1590  0.0096%
  12  46,177,270    8,852,664 (19.2%)   37,322,968       15,085,599  (32.7%)     5.83s   1284  0.0085%
  13  15,340,394    3,013,423 (19.6%)   12,326,447        4,997,981  (32.6%)     5.56s    433  0.0087%
  14  45,397,270    9,158,961 (20.2%)   36,236,826       16,768,694  (36.9%)     5.86s   1181  0.0070%
  15  45,600,758    9,164,004 (20.1%)   36,435,170       16,268,861  (35.7%)     5.66s   1368  0.0084%
  16   1,631,576      238,063 (14.6%)    1,393,413          461,009  (28.3%)     5.65s     18  0.0039%
  17  15,093,541    3,461,077 (22.9%)   11,631,896        6,008,462  (39.8%)     5.47s    541  0.0090%
  18  45,101,600    6,813,014 (15.1%)   38,286,495       11,751,972  (26.1%)     5.25s    761  0.0065%
  19  44,832,423    7,614,971 (17.0%)   37,215,817       12,936,833  (28.9%)     5.35s    909  0.0070%
  20  88,782,526   17,601,970 (19.8%)   71,177,703       30,698,668  (34.6%)     5.86s   2394  0.0078%
  21  44,036,568    6,617,852 (15.0%)   37,416,461       12,080,655  (27.4%)     4.91s    815  0.0067%
  22  85,627,559   16,621,394 (19.4%)   69,003,636       31,043,153  (36.3%)     6.20s   2080  0.0067%
  23  42,711,122    7,125,933 (16.7%)   35,583,913       12,997,278  (30.4%)     6.05s    819  0.0063%
  24  85,102,373   15,873,053 (18.7%)   69,226,893       28,680,029  (33.7%)     6.07s   1957  0.0068%
  25  41,847,039    8,244,467 (19.7%)   33,601,433       15,199,964  (36.3%)     6.09s   1040  0.0068%
  26  41,335,391    8,731,143 (21.1%)   32,603,064       15,512,580  (37.5%)     6.21s   1120  0.0072%
  27   4,455,504      728,265 (16.3%)    3,727,112        1,335,784  (30.0%)     6.76s     85  0.0064%
  28  41,102,914    7,436,228 (18.1%)   33,665,625       14,034,690  (34.1%)     6.61s    860  0.0061%
  29   4,591,391    1,000,708 (21.8%)    3,590,548        1,827,360  (39.8%)     6.89s    132  0.0072%
  30   4,664,261      753,741 (16.2%)    3,910,358        1,426,322  (30.6%)     5.73s     86  0.0060%
  31  13,606,209    2,929,494 (21.5%)   10,676,310        5,342,340  (39.3%)     7.02s    389  0.0073%
  32  40,697,707    1,283,160 ( 3.2%)   39,408,903        2,701,880  ( 6.6%)     2.96s     51  0.0019%
  33  80,468,663    1,867,043 ( 2.3%)   78,561,118        3,909,632  ( 4.9%)     1.97s     51  0.0013%
  34  79,175,610    4,163,781 ( 5.3%)   75,009,901        9,114,434  (11.5%)     3.95s    230  0.0025%
  35  77,979,783    3,471,663 ( 4.5%)   74,502,313        7,196,778  ( 9.2%)     3.26s    179  0.0025%
  36  38,536,298    1,690,729 ( 4.4%)   36,844,178        4,048,756  (10.5%)     3.40s     91  0.0022%
  37  76,146,967    3,884,785 ( 5.1%)   72,260,430        7,497,806  ( 9.8%)     4.06s    216  0.0029%
  38  74,505,665    4,086,801 ( 5.5%)   70,416,782        9,227,226  (12.4%)     4.04s    250  0.0027%
  39  74,154,564    3,060,677 ( 4.1%)   71,086,509        5,548,704  ( 7.5%)     3.14s    175  0.0032%
  40  72,171,447    5,459,725 ( 7.6%)   66,710,868       11,263,570  (15.6%)     4.91s    353  0.0031%
  41  36,053,455    2,446,778 ( 6.8%)   33,605,054        5,168,787  (14.3%)     4.01s    161  0.0031%
  42  70,552,290    2,899,282 ( 4.1%)   67,649,889        6,623,750  ( 9.4%)     3.50s    147  0.0022%
  43  69,437,575    3,780,923 ( 5.4%)   65,654,682        9,427,225  (13.6%)     4.15s    237  0.0025%
  44  67,978,951    2,979,974 ( 4.4%)   64,995,083        6,489,708  ( 9.5%)     3.88s    135  0.0021%
  45  33,904,021      920,656 ( 2.7%)   32,973,932        1,942,847  ( 5.7%)     2.34s     38  0.0020%
  46  66,337,407    2,598,410 ( 3.9%)   63,734,013        5,848,844  ( 8.8%)     3.36s    116  0.0020%
  47  65,880,161    2,975,959 ( 4.5%)   62,900,691        6,120,993  ( 9.3%)     3.57s    147  0.0024%
  48  64,996,381    1,520,203 ( 2.3%)   63,449,913        3,360,250  ( 5.2%)     1.96s     66  0.0020%
  49  63,898,062    2,774,967 ( 4.3%)   61,119,455        4,853,028  ( 7.6%)     3.40s    163  0.0034%
  50  62,192,220    5,163,880 ( 8.3%)   57,027,752       11,094,766  (17.8%)     5.44s    363  0.0033%
  51  61,691,475    3,218,501 ( 5.2%)   58,471,028        6,609,820  (10.7%)     3.82s    181  0.0027%
  52  60,192,385    3,540,871 ( 5.9%)   56,650,372        7,393,096  (12.3%)     4.21s    208  0.0028%
  53  29,966,384    2,254,231 ( 7.5%)   27,711,723        4,443,457  (14.8%)     4.80s    159  0.0036%
  54  29,734,495      777,785 ( 2.6%)   28,951,747        1,530,530  ( 5.1%)     2.46s     41  0.0027%
  55  58,731,513    3,515,130 ( 6.0%)   55,215,222        8,760,576  (14.9%)     4.22s    228  0.0026%
  56  57,263,818    4,502,398 ( 7.9%)   52,760,567        9,461,891  (16.5%)     5.10s    370  0.0039%
  57  57,033,275    2,922,722 ( 5.1%)   54,108,105        6,493,856  (11.4%)     3.66s    182  0.0028%
  58  55,394,556    2,795,054 ( 5.0%)   52,597,498        6,108,696  (11.0%)     4.01s    153  0.0025%
  59  55,022,930    2,469,941 ( 4.5%)   52,550,000        4,729,591  ( 8.6%)     3.59s    143  0.0030%
  60  54,018,514    3,754,963 ( 7.0%)   50,262,280        8,781,191  (16.3%)     4.21s    243  0.0028%
  61  52,964,870    4,185,083 ( 7.9%)   48,779,103        9,745,901  (18.4%)     4.89s    337  0.0035%
  62  52,242,492    2,633,309 ( 5.0%)   49,607,007        5,560,122  (10.6%)     3.65s    139  0.0025%
  63  51,245,000    2,977,640 ( 5.8%)   48,266,357        6,838,948  (13.3%)     4.42s    204  0.0030%
  64  50,540,742    3,001,591 ( 5.9%)   47,538,299        6,471,887  (12.8%)     4.30s    206  0.0032%
  65  49,644,127    4,313,629 ( 8.7%)   45,329,977        9,118,606  (18.4%)     5.22s    324  0.0036%
  66  49,190,978    2,514,578 ( 5.1%)   46,672,987        4,801,554  ( 9.8%)     3.99s    121  0.0025%
  67  24,077,300      720,444 ( 3.0%)   23,351,454        1,514,393  ( 6.3%)     2.52s     41  0.0027%
  68  47,978,806    3,605,114 ( 7.5%)   44,372,443        7,066,164  (14.7%)     5.21s    278  0.0039%
  69  47,059,527    2,398,730 ( 5.1%)   44,658,688        4,988,934  (10.6%)     3.89s    137  0.0027%
  70  46,231,581    3,560,275 ( 7.7%)   42,670,558        7,400,625  (16.0%)     5.10s    254  0.0034%
  71  22,715,795    1,154,727 ( 5.1%)   21,559,943        2,707,043  (11.9%)     3.80s     79  0.0029%
  72  44,778,204    1,640,145 ( 3.7%)   43,132,463        4,012,430  ( 9.0%)     2.64s     87  0.0022%
  73  44,053,469    2,672,676 ( 6.1%)   41,379,076        5,983,002  (13.6%)     4.37s    189  0.0032%
  74  43,401,907    1,245,434 ( 2.9%)   42,148,090        2,973,505  ( 6.9%)     2.70s     54  0.0018%
  75  21,398,806      918,417 ( 4.3%)   20,479,312        2,188,134  (10.2%)     3.93s     46  0.0021%
  76  42,061,440    2,720,648 ( 6.5%)   39,339,911        5,985,860  (14.2%)     4.83s    171  0.0029%
  77  41,316,125    2,693,084 ( 6.5%)   38,622,215        5,589,750  (13.5%)     4.20s    191  0.0034%
  78  40,571,245    2,469,303 ( 6.1%)   38,100,974        5,936,492  (14.6%)     4.24s    143  0.0024%
  79  40,282,447    2,838,145 ( 7.0%)   37,443,082        5,983,363  (14.9%)     4.71s    178  0.0030%
  80  39,233,218    2,406,689 ( 6.1%)   36,825,519        5,500,032  (14.0%)     4.29s    182  0.0033%
  81  38,522,319    2,194,958 ( 5.7%)   36,326,235        4,810,447  (12.5%)     3.98s    176  0.0037%
  82  37,881,913    1,924,611 ( 5.1%)   35,955,613        4,261,725  (11.3%)     3.85s    126  0.0030%
  83  37,460,193      805,644 ( 2.2%)   36,638,356        2,051,348  ( 5.5%)     1.65s     38  0.0019%
  84  18,460,204      632,388 ( 3.4%)   17,825,090        1,487,992  ( 8.1%)     3.06s     28  0.0019%
  85  36,127,803    3,107,500 ( 8.6%)   33,019,814        7,102,897  (19.7%)     5.37s    265  0.0037%
  86  35,584,769    2,506,665 ( 7.0%)   33,077,510        5,880,571  (16.5%)     4.48s    203  0.0035%
  87  34,821,531    1,959,524 ( 5.6%)   32,861,080        4,489,827  (12.9%)     4.34s    132  0.0029%
  88  34,334,716    1,864,124 ( 5.4%)   32,469,300        3,974,628  (11.6%)     4.25s    109  0.0027%
  89  33,769,162    2,942,348 ( 8.7%)   30,826,350        6,271,593  (18.6%)     5.63s    239  0.0038%
  90  33,174,401    1,889,146 ( 5.7%)   31,284,057        3,828,757  (11.5%)     4.09s    118  0.0031%
  91  32,520,037    1,804,092 ( 5.5%)   30,714,702        3,861,977  (11.9%)     4.31s    113  0.0029%
  92  31,945,541    1,603,486 ( 5.0%)   30,340,311        4,000,370  (12.5%)     3.92s    102  0.0025%
  93  31,221,072    1,142,453 ( 3.7%)   30,074,758        2,586,041  ( 8.3%)     2.93s     55  0.0021%
  94  30,579,410    1,419,300 ( 4.6%)   29,158,811        3,227,146  (10.6%)     4.25s     77  0.0024%
  95  29,977,732    1,670,045 ( 5.6%)   28,306,825        3,509,988  (11.7%)     4.28s     99  0.0028%
  96  29,390,061    2,024,501 ( 6.9%)   27,365,001        4,213,701  (14.3%)     4.91s    179  0.0042%
  97  14,518,368      673,081 ( 4.6%)   13,844,643        1,628,361  (11.2%)     4.16s     33  0.0020%
  98  14,372,444      674,383 ( 4.7%)   13,697,306        1,646,891  (11.5%)     4.25s     36  0.0022%
  99  28,268,021    1,961,040 ( 6.9%)   26,306,479        4,460,155  (15.8%)     4.85s    138  0.0031%
 100  27,849,953      776,104 ( 2.8%)   27,069,145        1,642,316  ( 5.9%)     2.73s     47  0.0029%
 101  13,768,854      358,670 ( 2.6%)   13,406,511          948,556  ( 6.9%)     2.70s     20  0.0021%
 102  26,929,453    1,480,479 ( 5.5%)   25,448,506        3,210,977  (11.9%)     4.20s     77  0.0024%
 103  26,382,806    1,627,257 ( 6.2%)   24,755,148        3,954,240  (15.0%)     4.97s    102  0.0026%
 104   4,359,314      106,790 ( 2.4%)    4,251,978          204,585  ( 4.7%)     2.84s      5  0.0024%
 105  25,997,296      553,229 ( 2.1%)   25,438,557        1,392,701  ( 5.4%)     1.74s     17  0.0012%
 106  25,467,197    2,046,052 ( 8.0%)   23,420,822        5,187,583  (20.4%)     5.05s    158  0.0030%
 107  24,888,528    2,594,474 (10.4%)   22,293,793        5,492,667  (22.1%)     5.36s    212  0.0039%
 108  24,423,300    1,549,264 ( 6.3%)   22,873,339        3,081,777  (12.6%)     4.87s    115  0.0037%
 109  23,988,326    1,060,926 ( 4.4%)   22,926,252        2,344,796  ( 9.8%)     3.64s     77  0.0033%
 110  23,541,927    1,516,691 ( 6.4%)   22,024,732        3,675,114  (15.6%)     5.16s    101  0.0027%
 111  23,070,530    1,725,617 ( 7.5%)   21,344,524        3,902,758  (16.9%)     5.19s    119  0.0030%
 112  22,609,142    1,439,500 ( 6.4%)   21,169,156        3,090,694  (13.7%)     5.06s     89  0.0029%
 113  22,100,458    1,715,604 ( 7.8%)   20,384,548        3,570,597  (16.2%)     5.36s    135  0.0038%
 114  10,879,514      646,214 ( 5.9%)   10,233,086        1,352,296  (12.4%)     4.83s     54  0.0040%
 115  21,378,062      986,530 ( 4.6%)   20,390,645        2,209,968  (10.3%)     3.90s     70  0.0032%
 116  20,985,174      923,687 ( 4.4%)   20,060,006        2,127,287  (10.1%)     3.37s     65  0.0031%
 117  20,674,972    2,283,050 (11.0%)   18,391,652        4,949,839  (23.9%)     4.69s    219  0.0044%
 118  20,107,116    2,407,570 (12.0%)   17,699,216        4,938,558  (24.6%)     5.60s    299  0.0061%
 119  19,854,606    1,012,689 ( 5.1%)   18,841,219        2,199,685  (11.1%)     4.48s     68  0.0031%
 120   9,732,970    1,254,580 (12.9%)    8,478,241        2,661,968  (27.4%)     7.04s    142  0.0053%
 121  19,084,488    2,241,347 (11.7%)   16,842,865        5,306,748  (27.8%)     6.62s    250  0.0047%
 122   9,491,325      334,076 ( 3.5%)    9,156,443          801,054  ( 8.4%)     3.35s     21  0.0026%
 123  18,532,281    1,431,368 ( 7.7%)   17,100,657        3,192,735  (17.2%)     5.79s     98  0.0031%
 124   9,142,485      546,994 ( 6.0%)    8,595,187        1,303,370  (14.3%)     4.35s     28  0.0021%
 125  18,075,269    1,958,007 (10.8%)   16,116,996        4,520,609  (25.0%)     6.36s    192  0.0042%
 126  17,675,306    1,479,294 ( 8.4%)   16,195,762        3,293,219  (18.6%)     5.46s    113  0.0034%
 127  17,545,752    1,134,197 ( 6.5%)   16,410,992        2,660,419  (15.2%)     4.71s     75  0.0028%
 128  16,990,098    1,505,277 ( 8.9%)   15,484,546        3,487,298  (20.5%)     6.38s    110  0.0032%
 129   8,369,473      461,602 ( 5.5%)    7,907,647        1,078,398  (12.9%)     4.98s     27  0.0025%
 130  16,406,705    1,927,427 (11.7%)   14,479,045        4,258,553  (26.0%)     6.63s    196  0.0046%
 131  16,189,996    1,118,886 ( 6.9%)   15,070,707        2,354,683  (14.5%)     5.17s     61  0.0026%
 132  15,791,769      862,534 ( 5.5%)   14,928,869        1,877,697  (11.9%)     4.87s     66  0.0035%
 133   2,613,345       62,626 ( 2.4%)    2,550,237          136,582  ( 5.2%)     3.09s      1  0.0007%
 134  15,362,664    1,749,834 (11.4%)   13,612,613        4,104,816  (26.7%)     6.29s    168  0.0041%
 135  15,272,476      973,428 ( 6.4%)   14,298,483        2,203,097  (14.4%)     4.85s     73  0.0033%
 136  14,918,036    1,009,141 ( 6.8%)   13,908,358        2,497,335  (16.7%)     4.77s     67  0.0027%
 137   7,254,450      374,522 ( 5.2%)    6,879,664          890,496  (12.3%)     4.68s     21  0.0024%
 138  14,383,075    1,469,623 (10.2%)   12,913,183        2,993,378  (20.8%)     5.53s    150  0.0050%
 139   7,011,714      823,238 (11.7%)    6,188,391        1,683,424  (24.0%)     6.47s     71  0.0042%
 140  13,738,161      706,192 ( 5.1%)   13,031,182        1,592,312  (11.6%)     3.90s     39  0.0024%
 141  13,445,152    1,301,180 ( 9.7%)   12,143,783        2,819,152  (21.0%)     6.68s     95  0.0034%
 142   6,593,805      700,723 (10.6%)    5,892,982        1,661,279  (25.2%)     7.08s     64  0.0039%
 143  12,918,117    1,466,447 (11.4%)   11,451,516        3,207,077  (24.8%)     7.75s    124  0.0039%
 144   6,403,269      588,879 ( 9.2%)    5,814,281        1,321,478  (20.6%)     6.61s     44  0.0033%
 145  12,568,136    1,635,113 (13.0%)   10,932,826        3,810,745  (30.3%)     7.39s    176  0.0046%
 146  12,354,720    1,324,533 (10.7%)   11,029,950        2,868,726  (23.2%)     7.41s    109  0.0038%
 147  12,036,469    1,204,290 (10.0%)   10,832,032        2,558,294  (21.3%)     7.51s     95  0.0037%
 148   5,931,073      383,504 ( 6.5%)    5,547,313          882,762  (14.9%)     5.30s     25  0.0028%
 149   5,949,060      402,344 ( 6.8%)    5,546,439          990,266  (16.6%)     5.77s     29  0.0029%
 150  11,577,852    1,150,011 ( 9.9%)   10,427,678        2,620,313  (22.6%)     7.25s     83  0.0032%
 151  11,435,633      865,019 ( 7.6%)   10,570,270        1,837,483  (16.1%)     5.66s     56  0.0030%
 152  11,155,974      653,313 ( 5.9%)   10,501,976        1,482,969  (13.3%)     3.90s     42  0.0028%
 153  10,671,486    1,376,766 (12.9%)    9,294,550        3,272,854  (30.7%)     7.06s    154  0.0047%
 154  10,525,735    1,325,606 (12.6%)    9,199,988        2,871,203  (27.3%)     7.65s    114  0.0040%
 155  10,188,634    1,641,785 (16.1%)    8,546,678        3,428,040  (33.6%)     8.24s    164  0.0048%
 156  10,059,617    1,046,110 (10.4%)    9,013,368        2,389,101  (23.7%)     7.09s     86  0.0036%
 157   9,805,813    1,119,211 (11.4%)    8,686,461        2,474,299  (25.2%)     6.52s    106  0.0043%
 158   9,629,320      901,716 ( 9.4%)    8,727,445        1,949,009  (20.2%)     7.07s     55  0.0028%
 159   9,490,222    1,011,741 (10.7%)    8,478,323        2,105,444  (22.2%)     7.12s     92  0.0044%
 160   9,280,124      672,569 ( 7.2%)    8,607,156        1,550,498  (16.7%)     5.02s     30  0.0019%
 161   8,844,112      954,447 (10.8%)    7,889,526        2,169,434  (24.5%)     6.47s     70  0.0032%
 162   8,628,099    1,252,150 (14.5%)    7,375,827        2,572,423  (29.8%)     8.09s    110  0.0043%
 163   8,429,593      936,870 (11.1%)    7,492,593        2,068,251  (24.5%)     6.81s     85  0.0041%
 164   8,227,144      859,823 (10.5%)    7,367,211        1,862,766  (22.6%)     6.93s     56  0.0030%
 165   7,998,287    1,305,236 (16.3%)    6,692,908        2,556,809  (32.0%)     8.70s    140  0.0055%
 166   7,813,413      907,560 (11.6%)    6,905,738        2,088,441  (26.7%)     7.16s     79  0.0038%
 167   3,839,149      408,726 (10.6%)    3,430,332          981,591  (25.6%)     6.28s     47  0.0048%
 168   7,548,052    1,322,554 (17.5%)    6,225,324        2,673,449  (35.4%)     7.92s    171  0.0064%
 169   7,349,287    1,158,442 (15.8%)    6,190,682        2,408,959  (32.8%)     7.65s    154  0.0064%
 170   7,146,807    1,155,601 (16.2%)    5,991,102        2,431,705  (34.0%)     8.23s     98  0.0040%
 171   6,993,422      532,938 ( 7.6%)    6,460,300        1,088,523  (15.6%)     4.70s     44  0.0040%
 172   6,828,801      719,064 (10.5%)    6,109,639        1,684,386  (24.7%)     6.88s     61  0.0036%
 173   6,674,911      787,916 (11.8%)    5,886,886        1,741,591  (26.1%)     7.41s     67  0.0038%
 174   6,476,248      525,066 ( 8.1%)    5,951,058        1,209,437  (18.7%)     6.58s     37  0.0031%
 175   3,166,465      319,233 (10.1%)    2,847,166          723,530  (22.8%)     6.24s     33  0.0046%
 176   6,205,963      940,604 (15.2%)    5,265,248        2,067,367  (33.3%)     8.24s     98  0.0047%
 177   6,040,631      973,198 (16.1%)    5,067,310        2,068,832  (34.2%)     7.63s    115  0.0056%
 178   5,882,934      799,224 (13.6%)    5,083,618        1,617,686  (27.5%)     7.11s     80  0.0049%
 179   5,812,748      898,163 (15.5%)    4,914,484        1,841,743  (31.7%)     7.49s     88  0.0048%
 180   5,615,082      706,783 (12.6%)    4,908,217        1,560,812  (27.8%)     7.68s     66  0.0042%
 181   5,461,387      665,782 (12.2%)    4,795,528        1,509,794  (27.6%)     7.33s     62  0.0041%
 182   5,367,414      436,054 ( 8.1%)    4,931,230        1,003,145  (18.7%)     5.96s     35  0.0035%
 183   5,222,068      218,250 ( 4.2%)    5,003,248          513,441  ( 9.8%)     3.53s     12  0.0023%
 184   5,072,949      686,079 (13.5%)    4,386,762        1,414,281  (27.9%)     7.17s     84  0.0059%
 185   4,918,277      806,513 (16.4%)    4,111,648        1,794,296  (36.5%)     7.95s    110  0.0061%
 186   4,778,878      528,659 (11.1%)    4,250,130        1,144,927  (24.0%)     6.26s     47  0.0041%
 187   4,641,003      384,009 ( 8.3%)    4,256,867          869,291  (18.7%)     4.96s     38  0.0044%
 188   4,539,624      379,319 ( 8.4%)    4,160,186          874,381  (19.3%)     5.94s     34  0.0039%
 189   4,407,284      363,626 ( 8.3%)    4,043,551          848,852  (19.3%)     6.11s     28  0.0033%
 190   2,186,822      218,907 (10.0%)    1,967,841          496,372  (22.7%)     6.91s     19  0.0038%
 191   4,220,821      377,160 ( 8.9%)    3,843,582          811,484  (19.2%)     6.30s     30  0.0037%
 192   4,158,097      339,335 ( 8.2%)    3,818,654          740,293  (17.8%)     5.15s     21  0.0028%
 193   4,070,158      283,462 ( 7.0%)    3,786,518          707,552  (17.4%)     5.14s     17  0.0024%
 194   3,857,103      481,491 (12.5%)    3,375,565        1,045,210  (27.1%)     7.89s     37  0.0035%
 195   3,785,628      323,229 ( 8.5%)    3,462,311          718,327  (19.0%)     6.31s     19  0.0026%
 196   3,693,474      298,084 ( 8.1%)    3,395,264          691,934  (18.7%)     4.95s     27  0.0039%
 197   3,555,681      527,692 (14.8%)    3,027,900        1,085,383  (30.5%)     7.92s     74  0.0068%
 198   3,453,089      444,575 (12.9%)    3,008,452          916,901  (26.6%)     7.38s     32  0.0035%
 199   3,345,667      624,739 (18.7%)    2,720,840        1,305,629  (39.0%)     8.33s     80  0.0061%
 200   3,252,227      553,806 (17.0%)    2,698,341        1,177,122  (36.2%)     8.11s     66  0.0056%
 201   3,165,254      581,268 (18.4%)    2,583,902        1,194,265  (37.7%)     8.40s     82  0.0069%
 202   3,064,062      357,476 (11.7%)    2,706,510          763,452  (24.9%)     6.81s     28  0.0037%
 203   2,966,309      373,164 (12.6%)    2,593,089          817,026  (27.5%)     6.77s     34  0.0042%
 204   2,932,890      370,632 (12.6%)    2,562,202          808,768  (27.6%)     7.27s     33  0.0041%
 205   2,841,380      342,124 (12.0%)    2,499,195          767,412  (27.0%)     6.88s     36  0.0047%
 206   2,701,985      517,954 (19.2%)    2,183,958        1,107,622  (41.0%)     7.98s     70  0.0063%
 207   2,628,788      470,484 (17.9%)    2,158,231          963,053  (36.6%)     8.28s     71  0.0074%
 208   2,532,198      309,210 (12.2%)    2,222,944          716,008  (28.3%)     7.56s     22  0.0031%
 209   2,443,960      438,640 (17.9%)    2,005,273          883,810  (36.2%)     8.72s     43  0.0049%
 210   1,243,959      191,871 (15.4%)    1,052,063          382,294  (30.7%)     7.24s     22  0.0058%
 211   2,317,171      458,163 (19.8%)    1,858,952          966,673  (41.7%)     8.18s     54  0.0056%
 212   2,357,854      378,362 (16.0%)    1,979,429          798,841  (33.9%)     7.76s     52  0.0065%
 213   1,137,589       84,372 ( 7.4%)    1,053,164          197,286  (17.3%)     5.35s      5  0.0025%
 214   1,083,228       92,020 ( 8.5%)      991,165          232,906  (21.5%)     6.48s     11  0.0047%
 215   2,183,311      345,527 (15.8%)    1,837,728          760,853  (34.8%)     7.44s     45  0.0059%
 216   2,244,753      311,923 (13.9%)    1,932,778          659,823  (29.4%)     7.39s     38  0.0058%
 217   2,143,677      149,699 ( 7.0%)    1,993,838          321,169  (15.0%)     5.07s     15  0.0047%
 218   2,100,798      144,399 ( 6.9%)    1,956,108          336,097  (16.0%)     4.63s      7  0.0021%
 219   1,007,465       50,583 ( 5.0%)      956,718          121,451  (12.1%)     3.17s      4  0.0033%
 220   1,970,315      138,593 ( 7.0%)    1,831,558          275,959  (14.0%)     4.58s     11  0.0040%
 221   1,841,722      193,786 (10.5%)    1,647,879          396,475  (21.5%)     6.08s     14  0.0035%
 222   1,873,099      176,477 ( 9.4%)    1,696,506          351,217  (18.8%)     5.26s     17  0.0048%
 223   1,772,301      139,764 ( 7.9%)    1,632,393          298,106  (16.8%)     4.58s     12  0.0040%
 224     347,777        8,518 ( 2.4%)      338,076           20,374  ( 5.9%)     2.55s      0  0.0000%
 225   1,968,442      110,730 ( 5.6%)    1,857,312          238,884  (12.1%)     3.67s      6  0.0025%
 226   1,677,704      126,339 ( 7.5%)    1,551,319          273,714  (16.3%)     4.74s      9  0.0033%
 227   1,521,001      178,153 (11.7%)    1,342,823          387,633  (25.5%)     6.72s     17  0.0044%
 228   1,498,734      139,609 ( 9.3%)    1,359,098          293,340  (19.6%)     5.94s     11  0.0037%
 229   1,515,366      167,985 (11.1%)    1,347,346          366,044  (24.2%)     5.75s     22  0.0060%
 230   1,457,098      108,517 ( 7.4%)    1,348,541          282,478  (19.4%)     5.04s     16  0.0057%
 231   1,331,185      173,263 (13.0%)    1,157,909          352,918  (26.5%)     6.93s      8  0.0023%
 232   1,279,569      110,972 ( 8.7%)    1,168,584          233,673  (18.3%)     5.21s      2  0.0009%
 233   1,262,013      111,083 ( 8.8%)    1,150,910          226,174  (17.9%)     5.49s      9  0.0040%
 234   1,218,744      166,427 (13.7%)    1,052,289          372,675  (30.6%)     6.79s     23  0.0062%
 235     386,642       59,837 (15.5%)      326,792          115,175  (29.8%)     7.60s      8  0.0069%
 236   1,182,963      208,728 (17.6%)      974,211          403,765  (34.1%)     7.41s     22  0.0054%
 237     570,172       16,436 ( 2.9%)      553,647           37,474  ( 6.6%)     3.19s      1  0.0027%
 238   1,111,083       78,874 ( 7.1%)    1,032,201          188,396  (17.0%)     4.93s      2  0.0011%
 239   1,076,551      133,326 (12.4%)      943,211          271,978  (25.3%)     6.33s     13  0.0048%
 240     167,032        6,847 ( 4.1%)      160,182           18,748  (11.2%)     4.36s      0  0.0000%
 241     533,940       63,768 (11.9%)      470,159          134,362  (25.2%)     7.80s      5  0.0037%
 242   1,048,083      146,961 (14.0%)      901,103          321,949  (30.7%)     7.33s     15  0.0047%
 243     974,591      185,824 (19.1%)      788,747          379,855  (39.0%)     9.30s     19  0.0050%
 244     967,788      172,055 (17.8%)      795,714          348,880  (36.0%)     9.40s     18  0.0052%
 245     455,310       57,021 (12.5%)      398,282          118,141  (25.9%)     7.84s      2  0.0017%
 246     915,249      125,429 (13.7%)      789,799          269,962  (29.5%)     8.53s     12  0.0044%
 247     500,537       48,591 ( 9.7%)      451,920          101,465  (20.3%)     5.77s      4  0.0039%
 248     783,336      197,539 (25.2%)      585,775          400,217  (51.1%)     9.04s     22  0.0055%
 249     822,496      163,050 (19.8%)      659,427          326,091  (39.6%)     8.68s     18  0.0055%
 250   4,118,353      713,357 (17.3%)    3,404,804        1,533,914  (37.2%)     8.35s    102  0.0066%
 260   4,942,966    1,105,648 (22.4%)    3,837,174        2,287,497  (46.3%)     9.76s    141  0.0062%
 270   2,374,942      585,337 (24.6%)    1,789,524        1,159,132  (48.8%)     9.69s     80  0.0069%
 280   1,443,458      309,734 (21.5%)    1,133,668          618,091  (42.8%)    10.16s     42  0.0068%
 290   1,584,461      388,991 (24.6%)    1,195,407          765,544  (48.3%)     9.96s     63  0.0082%
 300   2,097,068      645,532 (30.8%)    1,451,421        1,186,912  (56.6%)     9.33s    105  0.0088%
------------------------------------------------------------------------------------------------------
   5,472,730,538  478,364,693 ( 8.7%)                   961,772,175  (17.6%)
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

Re: Low/Hi Clue Thresholds

Postby Mathimagics » Tue Feb 11, 2020 3:50 pm

Thanks, Mladen. I'm not actually investigating 17s, only tabulating the 18s that we have found + how many remain to be found.

I just thought that there might be something of interest in this table for the 17s search, but I can see from your linked thread that much work has already been done in this area, and that there is little of relevance in the 18s table.
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

Gen18Z Testing

Postby Mathimagics » Thu Feb 13, 2020 8:18 am

Ok, Gen18Z now has a built-in mechanism for checking its new grid yield on the fly. I added a function IsNewGrid(G) which identifies the relevant band, then does a binary search using file seek/read operations, and retrieves the grid's LCT status.

This function can be slow on JILL (my test PC) due to the location of the catalog on a slow-access disk, but on JACK (the 16-core production PC) the catalog is on a fast-access disk, and the cost of searching is very much less - each IsNewGrid call takes ~2 msecs.

Testing indicated that the new grids found in each propagation pass first rises and ultimately falls, so a rough rule-of thumb is applied in each batch - if the new grid yield for a given pass has declined for two passes in succession, the batch is terminated, saved, and we move on to a new seed grid.

I ran 16 Gen18Z workers on JILL for 20 hours, and got a net yield of NPH = 4075, which is similar to recent yields from Gen18H:

Code: Select all
Date              Batches     ED grids     New grids   Yield     Hours   NPH
----------------------------------------------------------------------------
01 Feb 2020    1313 - 1328   15,618,031    1,410,782    9.04%     ~22   4008    Gen18H
02 Feb 2020    1329 - 1344   15,676,083    1,423,940    9.08%     ~22   4045     "
03 Feb 2020    1345 - 1360   15,724,916    1,383,585    8.80%     ~22   3931     "
04 Feb 2020    1361 - 1376   15,709,656    1,458,855    9.29%     ~22   4144     "
06 Feb 2020    1377 - 1392   15,684,163    1,328,930    8.47%     ~22   3775     "
07 Feb 2020    1393 - 1408   15,661,502    1,406,948    8.98%     ~22   4000     "
07 Feb 2020    1409 - 1424   15,552,359    1,413,591    9.09%     ~22   4015     "

12 Feb 2020       1 -  419   13,669,983    1,304,065    9.54%      20   4075    Gen18Z

Note that NPH = # of new grids / (16 * Hours). Gen18H sets are all similar size, with 16 batches per set, average time 22 hours to produce. Gen18Z produces many smaller batches.

So, our first test of Gen18Z shows remarkably similar yields to Gen18H. A little disappointing, but there are several "tuning" options that we can play with to try and increase the yield.

Also, since we test each new grid we find with IsNewGrid(G), it makes sense to try a mode in which each list propagation pass discards any grids/puzzles that are not "new 18C" grids. So we only keep and propagate (apply selective {-2,+2} search) newly found puzzles on "new 18c grids".

Tests on JILL suggest that this can boost yields considerably. I'm running a live test on JACK now and will have results later tonight.
User avatar
Mathimagics
2017 Supporter
 
Posts: 1926
Joined: 27 May 2015
Location: Canberra

PreviousNext

Return to General