From 09f649ebad910dad63418bc1e90fa9666ac43fe2 Mon Sep 17 00:00:00 2001 From: Charlotte Som Date: Wed, 5 Mar 2025 11:19:22 +0000 Subject: [PATCH] add tsnsrv instructions to readme --- README.md | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/README.md b/README.md index c0e5d4d..a06d635 100644 --- a/README.md +++ b/README.md @@ -8,3 +8,14 @@ $ deno task setup $ # any llm plugins: `uv pip install ...` $ deno task run ``` + +i also use tsnsrv to expose the llm server internally in my tailnet: + +```shell +$ # let's say $SOCK_PATH is /run/llm.sock +$ # in your llm-py-web systemd unit, have: +$ # Exec=/usr/bin/env deno task run --uds $SOCK_PATH +$ tsnsrv -name llm -stateDir /srv/llm/ts-state \ + -ephemeral -suppressWhois \ + -upstreamUnixAddr $SOCK_PATH http://llm-py-web +```