add tsnsrv instructions to readme
This commit is contained in:
parent
115c762e57
commit
09f649ebad
1 changed files with 11 additions and 0 deletions
11
README.md
11
README.md
|
@ -8,3 +8,14 @@ $ deno task setup
|
|||
$ # any llm plugins: `uv pip install ...`
|
||||
$ deno task run
|
||||
```
|
||||
|
||||
i also use tsnsrv to expose the llm server internally in my tailnet:
|
||||
|
||||
```shell
|
||||
$ # let's say $SOCK_PATH is /run/llm.sock
|
||||
$ # in your llm-py-web systemd unit, have:
|
||||
$ # Exec=/usr/bin/env deno task run --uds $SOCK_PATH
|
||||
$ tsnsrv -name llm -stateDir /srv/llm/ts-state \
|
||||
-ephemeral -suppressWhois \
|
||||
-upstreamUnixAddr $SOCK_PATH http://llm-py-web
|
||||
```
|
||||
|
|
Loading…
Reference in a new issue