server: --checkpoint-every-nt N, context checkpoints inside a long message (off by default) - #338

server: --checkpoint-every-nt N, context checkpoints inside a long message (off by default)#338

professorpalmer wants to merge 2 commits into

PrismML-Eng:prismPrismML-Eng/llama.cpp:prismfrom

professorpalmer:checkpoint-every-ntprofessorpalmer/llama.cpp-ada-ternary:checkpoint-every-ntCopy head branch name to clipboard