Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
segmenta
78 days ago
|
parent
|
context
|
favorite
| on:
Show HN: Rowboat – Open-source, local-first altern...
Yes! You can use local models through Ollama and LM Studio. We do some special handling when you use local models, such as suppressing background agents when you chat, so the model is not overwhelmed.
nshotton
77 days ago
[–]
sweet, is there any plans to implement VLLM in the future?
segmenta
77 days ago
|
parent
[–]
vLLM works today - it exposes an OpenAI-compatible endpoint, and you can point Rowboat at a custom base URL in model settings.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
