swiftywizard@discuss.tchncs.de to Programmer Humor@programming.dev · 2 months agoLavalamp too hotdiscuss.tchncs.deimagemessage-square70linkfedilinkarrow-up1439arrow-down111
arrow-up1428arrow-down1imageLavalamp too hotdiscuss.tchncs.deswiftywizard@discuss.tchncs.de to Programmer Humor@programming.dev · 2 months agomessage-square70linkfedilink
minus-squareFishFace@piefed.sociallinkfedilinkEnglisharrow-up1·2 months agoThere is something wrong if it’s not discarding old context to make room for new
minus-squarebunchberry@lemmy.worldlinkfedilinkarrow-up1·2 months agoAt least llama.cpp doesn’t seem to do that by default. If it overruns the context window it just blorps.
minus-squareFishFace@piefed.sociallinkfedilinkEnglisharrow-up1·2 months agoI think there are parameters for that, from googling.
There is something wrong if it’s not discarding old context to make room for new
At least llama.cpp doesn’t seem to do that by default. If it overruns the context window it just blorps.
I think there are parameters for that, from googling.