🃏Joker@sh.itjust.works to Technology@lemmy.worldEnglish · 2 days agoMake illegally trained LLMs public domain as punishmentwww.theregister.comexternal-linkmessage-square197fedilinkarrow-up11.56Karrow-down142file-text
arrow-up11.51Karrow-down1external-linkMake illegally trained LLMs public domain as punishmentwww.theregister.com🃏Joker@sh.itjust.works to Technology@lemmy.worldEnglish · 2 days agomessage-square197fedilinkfile-text
minus-squareFaceDeer@fedia.iolinkfedilinkarrow-up3·2 days agoI’ve been working with local LLMs for over a year now. No guardrails, and many of them fine-tuned against censorship. They can’t output arbitrary training material verbatim. Llama 3 was trained on 15 trillion tokens, both the 8B and 70B parameter versions.. So around 1:1000, not 1:7.
I’ve been working with local LLMs for over a year now. No guardrails, and many of them fine-tuned against censorship. They can’t output arbitrary training material verbatim.
Llama 3 was trained on 15 trillion tokens, both the 8B and 70B parameter versions.. So around 1:1000, not 1:7.