It would be interesting to look at the latest version of LM Studio and contrast it with Ollama. I like both, and both have their advantages. It would be nice if people expert in Continue would do a comparison.
The biggest problem with LMStudio is it uses too much resource just on it's own. I think last time I checked it was consuming 2gb of memory, and that is an issue for the memory hungry LLMs, specially on a Mac. They tried to solve this recently by adding an update they called headless mode, but I'm still not satisfied.
I believe ollama limits the context to 2k making it hard for the LLM to preform to the max. There is a way to overcome that but it's a little bit complicated.
Small feedback. It feels weird, not natural, the way the video is trimmed and jumps from one point to another. I prefer the original, even if a bit longer. At least for me.
It would be interesting to look at the latest version of LM Studio and contrast it with Ollama. I like both, and both have their advantages. It would be nice if people expert in Continue would do a comparison.
The biggest problem with LMStudio is it uses too much resource just on it's own. I think last time I checked it was consuming 2gb of memory, and that is an issue for the memory hungry LLMs, specially on a Mac. They tried to solve this recently by adding an update they called headless mode, but I'm still not satisfied.
I believe ollama limits the context to 2k making it hard for the LLM to preform to the max. There is a way to overcome that but it's a little bit complicated.
Small feedback. It feels weird, not natural, the way the video is trimmed and jumps from one point to another. I prefer the original, even if a bit longer. At least for me.