1DOLLY 72PACKAGE llama3REQUIRES HOST runtime@04REQUIRES HOST gpu@056789FROM /v0.1.7/Dollyfile-system-tools 6699b9ce9339fe8ee70c02972b8a4b10242adb71dd63c3a5ac5da48f8d1828ed10USE /v0.1.7/demos/local-llm/Dollyfile-llama-cpp 58daed0e84d8ba3df3f68cd8e803a4cc91547929c8c5659886403c290c7de5cd11REQUIRES HEADER llama12REQUIRES LIB llama13REQUIRES LIB llama-common14REQUIRES LIB ggml15REQUIRES LIB ggml-base16REQUIRES LIB ggml-cpu17REQUIRES LIB ggml-webgpu18REQUIRES LIB dolly-webgpu19REQUIRES LIB dolly-gpu20REQUIRES TOOL c++21REQUIRES TOOL cp22REQUIRES TOOL mkdir23REQUIRES TOOL rm24REQUIRES TOOL tar2526SOURCE /v0.1.7/dist/static/llama/engine.tar 320eac803d1b96305f6422c9d2257e60ea539e27aec0c7ce670721d77c705ed1 /tmp/llm-engine.tar27SLOP tar -xf /tmp/llm-engine.tar -C /28SLOP c++ -std=c++20 -O1 -I/usr/include/dolly-llm /tmp/dolly-llama/main.cpp \29 -L/usr/lib/dolly-llm -lllama-common -lllama -lggml -lggml-webgpu -ldolly-webgpu -lggml-cpu -lggml-base -ldolly-gpu -lm -o /usr/bin/dolly-llama3031SLOP mkdir -p /usr/share/licenses/dolly-llama32SLOP cp -R /usr/share/licenses/dolly-llm/. /usr/share/licenses/dolly-llama33SLOP rm -rf /tmp/dolly-llama /tmp/llm-engine.tar3435EXPORTS TOOL dolly-llama36FOLDER /usr/share/licenses/dolly-llama37FILE /usr/share/man/cat1/dolly-llama.138 dolly-llama: llama.cpp on WebGPU, serving a GGUF model to Pi (provider webgpu).39 40 dolly-llama MODEL.gguf serves the model41 dolly-llama --check prints the shader kind this adapter gets42 43 Each line of standard input is a request as llama-server takes it at44 /v1/chat/completions; standard output is the event stream it would answer45 with, and a field it does not implement is an error naming it. It uses the46 adapter gpu@0 grants: with shader-f16 llama.cpp's WGSL as upstream wrote it,47 without it the f16 shader code widened to f32. The chat template, tool48 calls, stop tokens and sampling defaults are the GGUF's own. Pi's /model,49 /thinking and /local choose and tune the model.50