"How do you know about all this AI stuff?"
I just read tweets, buddy.
Page 1 of 1
This is good in combination with Hugging Face's Synthetic data: save money, time and carbon with open source.
A discussion of model sizes vs quantization on /r/LocalLLaMA, relevant for anyone interested in running models on their own machines. Generally:
Ive read that a larger sized model even at a lower quant will most likely yield better results than a smaller model at a higher quant
