Very interesting! I wonder: if I would like a LLM that is specialized in for example Physics knowledge, how could I use this method to generate such a specialized LLM?
One glaring omission form this list is a check of data's veracity. Or did I miss that? An easy way to do it would be to feed the answers from the originating LLM back to itself and have them evaluated for accuracy, truthfulness.