At least with where AI is now, it’s basically an incredible data compressor. My local copy of gemm4:31b takes up less than 50GB iirc, and I can retrieve information from the entire Internet with it without an internet connection.
Using an AI to train an AI is like taking a jpg of a jpg. You’re going to lose information eventually. Hallucinations will become worse like in a game of telephone
At least with where AI is now, it’s basically an incredible data compressor. My local copy of gemm4:31b takes up less than 50GB iirc, and I can retrieve information from the entire Internet with it without an internet connection.
Using an AI to train an AI is like taking a jpg of a jpg. You’re going to lose information eventually. Hallucinations will become worse like in a game of telephone
Lossy compression with no internal mechanism for detecting information corruption.