haven@laptop $ git clone https://github.com/InferHaven/bulkhead
Cloning into 'bulkhead'... done.
haven@laptop $ cd bulkhead && cp .env.example .env
haven@laptop $ docker compose build workspace
[+] Building workspace image locally... done ✓
haven@laptop $ docker compose up -d
[+] Running 4/4
✓ ollama Started
✓ workspace Started
✓ code-server Started
✓ caddy Started
haven@laptop $ ssh -p 2222 haven@localhost
Welcome to Bulkhead · tmux session 'Haven' restored
haven@haven $ bulkhead pull qwen2.5-coder:14b
pulling manifest... downloading 8.5GB ✓
haven@haven $ curl http://localhost/v1/chat/completions \
$ -d '{"model":"qwen2.5-coder","messages":[{"role":"user","content":"hi"}]}'
{"choices":[{"message":{"role":"assistant","content":"Hello, world."}}]}
haven@haven $ bulkhead chat qwen2.5-coder:14b
> write a tiny haiku about safe harbors
Anchor holds the line,
lighthouse cuts the storm in two,
code sleeps in the bay.
haven@haven $