Ask HN: What models can you use with OpenCode that offer some level of privacy

1 pointsposted 11 hours ago
by ciwolex

Item id: 48497111

6 Comments

sds357

8 hours ago

I use qwen3.6 27b and 35b hosted locally on ollama

jonahbenton

11 hours ago

Run llama.cpp on your machine and point opencode to it

ciwolex

11 hours ago

I'm not quite familiar, do you think opencode is privacy focused?

jonahbenton

10 hours ago

OpenCode is a "harness" that manages conversations/interactions with LLMs. It does not run a model itself. An extended interaction can include- many turns of conversation, providing files for the LLM to process, having the LLM direct the running of programs called tools by the harness. The privacy aspect is determined by which LLM you configure OpenCode to use. If you configure it to use an LLM you host yourself, then you maintain your privacy. If you have it use an LLM provider you do not host yourself then your conversation and file and tool results and whatever else is sent to the provider and your privacy is dependent on the provider. There have been no reports of OpenCode communicating out of band with user data to any servers- it does do things like check for version updates and can download plugins and the like. But in that sense OpenCode is reasonably configurable for privacy. The default however is to use an external provider for LLM, not a local model, so you have to change that and not use it oob.

To have your own LLM provider, you have to run different software. Ollama is one option (though it also by default uses external provider) and llama.cpp is another. Jan and LMStudio are other options for actually running a model on your own hardware, to which you can direct OpenCode.

bigyabai

11 hours ago

Local ones

ciwolex

11 hours ago

Do you have any specific ones that you recommend?