add tsnsrv instructions to readme

This commit is contained in:
Charlotte Som 2025-03-05 11:19:22 +00:00
parent 115c762e57
commit 09f649ebad

View file

@ -8,3 +8,14 @@ $ deno task setup
$ # any llm plugins: `uv pip install ...`
$ deno task run
```
i also use tsnsrv to expose the llm server internally in my tailnet:
```shell
$ # let's say $SOCK_PATH is /run/llm.sock
$ # in your llm-py-web systemd unit, have:
$ # Exec=/usr/bin/env deno task run --uds $SOCK_PATH
$ tsnsrv -name llm -stateDir /srv/llm/ts-state \
-ephemeral -suppressWhois \
-upstreamUnixAddr $SOCK_PATH http://llm-py-web
```