Well from: https://github.com/1to9only/essentially-different-minlex-grids
Hidden Text: Show
I took 010.sudz! Why did I not do 006.sudz? It is the biggest one? Anyway using the sudz program, I produced 010.txt. About 3.8 GiB. I could not open it up with my geany editor. I discoverd the Linux terminal split command.
>split -C 1G 010.txt produced 5 smaller files 1 GiB in size (except last one was smaller) The number of items in those files were: 13_094_412. But, I like even numbers at a 'nice" binary size. So I chose 10 MiB which is 10_485_760 or A0_0000 hex . I have been a binary guy since college. So why not use Hex indexes instead of decimal. These smaller files wtih 10MiB entries took up 820.0 MiB (859,832,320 bytes). So with a few calculations I figured it would ONLY take 522 text files to do the whole ED!
So a Python script could probably do this. But I would have to execute 416 sudz to text file operations and along way create the 522.txt files. And how about all the residue along the way. Maybe just better to put it in one SQL database file?