• Harlehatschi@lemmy.ml
    link
    fedilink
    English
    arrow-up
    1
    ·
    7 hours ago

    But spending a lot of processing power to gain smaller sizes matters mostly in cases you want to store things long term. You probably wouldn’t want to keep the exact same LLM with the same weightings and stuff around in that case.