David P Bird wrote:SpAce, as the originator of GEM, I admire your perseverance in employing it manually and am pleased that you have been able to benefit from it.
Thanks, David, and good job for creating GEM! I'm a fan of your invention so I'm glad to hear from you. I guess I was biased to picking up GEM, because I'd wanted to create something similar to replace my old trial-and-error markers, especially after experimenting a bit with X-Colors. Then I found you had my vision already nailed perfectly so there was no need to reinvent the wheel, except for the manual mark-up details.
At first I tried but quickly ditched your spreadsheet approach, even though it's clearly more flexible with regards to multiple seeding points. It seemed tedious and hard-to-read for me, and I'm a pencil-and-paper purist anyway (at least for now). I also haven't found use for group markers, because they seem more confusing than helpful (my mark-up already highlights group-relationships so they'd be kinda redundant, too). With those minor tweaks, I find GEM very intuitive and quick to use, and it has nice synergy with my other mark-up which is designed to make it easy to find and follow various kinds of chains.
After a while the housekeeping involved in solving puzzles gets very tedious, so I designed a 'Sudoku Drudge' spreadsheet to highlight singles, doubles, etc so I could quickly get to the more challenging bits. I then extended its colouring capabilities to be able to follow alternating inference chains using the GEM equivalence marks.
Nice. For some crazy reason I've enjoyed the challenge of adding similar features to my pencil-and-paper system. Of course there's no avoiding the housekeeping and the time it takes when done manually, but at least my in-place bookkeeping system ensures that mistakes occur almost never, basic solving gets done almost automatically, and the advanced mark-up stays up-to-date all the time. It's also purely additive so there's no need for an eraser (unless one makes an actual mistake, which rarely happens). I'm sure one of these days I'll get tired and turn my system into software, but so far I'm quite happy to endure the pains There's just something nice about doing it with the simplest possible tools, and the time wasted on the initial mark-up and housekeeping is insignificant next to the thinking time in the more difficult puzzles.
However I discipline myself only to follow single, un-branched chains, so I do not grade-mark these candidates as that would amount to using a network approach.
I admire your discipline I may give that approach a try. Then again, nowadays I only use GEM when it seems that I may actually need a network approach or can't otherwise proceed, and in that case I freely take everything it's willing to give. Of course it typically reveals un-branched chains I've missed as well, and I prioritize those over possible netting results (which aren't normally necessary). I avoid taking advantage of netting unless I see no other way out.
Taken to completion, GEM marking will kill most published problems very easily, but will identify many insignificant eliminations in the process. Here the challenge is to firstly only to mark up the parts of a puzzle that appear to have openings and secondly try to keep the solution as short as possible by identifying and eliminating the significant candidates first.
I understand. I'm not yet in the level that I'd try to optimize or restrict the solving path too much, but I'll keep in mind those additional challenge options. My first priority is to find at least one working path, but especially with simpler puzzles I try to find some alternate ways as well. So far I've been aiming more for simplicity and repeatability than maximum efficiency or elegance. I'm sure priorities will change with improving skills.
As the level of difficulty of the puzzles increases though, it becomes necessary to look for patterns such as Unique Rectangles and Finned Fish that will provide further inferences that can be followed.
Yes, it seems that the power of GEM grows exponentially with one's general solving skills. That's probably one reason why it could now solve the difficult puzzle that got stuck earlier, because I got more candidates marked than before (all of them, actually). By the way, it got solved in a bit weird way that I hadn't seen with GEM before and didn't immediately even recognize as a solution:
GEM only gave me a few eliminations and one solved cell directly, which didn't help much, and it didn't provide any parity-wide contradictions either. At first glance I thought the result was useless. Then I looked at it again and noticed that every cell that didn't have two opposing par markers had one candidate with either a par (only a few) or a super marker (many) of the same parity -- and there was one for each number in each unit (the rest were obviously sub markers). Surprisingly the whole solution sat right there in those aligned super and par markers. It took me a minute to grasp and believe that but it was easily verified to be true. Basically it turned into a classic trial-and-error happy path, which I surely didn't expect or aim for. Lucky seeding point?
Used in that way it need not be the 'Dark Side of the Force' that you are making it out!
I wasn't insulting GEM -- I'm a fan of the Dark Side of the Force just like I'm a fan of GEM! I just see this similarity and its associated risks:
Luke: "Is the dark side stronger?"
Yoda: "No, no, no. Quicker, easier, more seductive."
What I mean is that it's quite easy to ditch discipline and use the full power without much thinking, which may hinder learning and enjoying other techniques. On the other hand, it may also help learning, as it has for me. When I was a complete beginner with patterns and chains, I used GEM to find eliminations first and then looked for logical reasons behind them. That's how I learned to recognize useful chains. Also, as you said, in the real difficult puzzles one needs those "light-side" techniques as well to boost GEM, so it's not a silver bullet alone.