add tsnsrv instructions to readme
This commit is contained in:
parent
115c762e57
commit
09f649ebad
1 changed files with 11 additions and 0 deletions
11
README.md
11
README.md
|
@ -8,3 +8,14 @@ $ deno task setup
|
||||||
$ # any llm plugins: `uv pip install ...`
|
$ # any llm plugins: `uv pip install ...`
|
||||||
$ deno task run
|
$ deno task run
|
||||||
```
|
```
|
||||||
|
|
||||||
|
i also use tsnsrv to expose the llm server internally in my tailnet:
|
||||||
|
|
||||||
|
```shell
|
||||||
|
$ # let's say $SOCK_PATH is /run/llm.sock
|
||||||
|
$ # in your llm-py-web systemd unit, have:
|
||||||
|
$ # Exec=/usr/bin/env deno task run --uds $SOCK_PATH
|
||||||
|
$ tsnsrv -name llm -stateDir /srv/llm/ts-state \
|
||||||
|
-ephemeral -suppressWhois \
|
||||||
|
-upstreamUnixAddr $SOCK_PATH http://llm-py-web
|
||||||
|
```
|
||||||
|
|
Loading…
Reference in a new issue