While LLMs deliver at times questionable quality of code, they can be none the less helpful to give feedback, explain syntax or high level concepts. I was wondering how people are integrating them in neovim. How are you using LLMs? Is it worth thinking about a setup?
I gave a try to ollama.nvim, but I’m not conviced (not by the plugin, but by using LLM directly in IDE). Because of security reasons, I cannot send code to public LLMs, so I have to either use my company’s internal LLM (GPT4o), but which just have a front end, no API. Either I have to use local LLM through ollama for ex.
I tried several models, but they are to slow or too dumb. In the end, when I need help, I copy/past code into LLM portal front end.