Skip to content

Some LLMs will not load in Local Server mode but will run if LM Studio is selected #86

@electronart

Description

@electronart

bartwoski\nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_K_M.gguf
mistralai\Ministral-3-8B-instruct-2512-Q4_K_M.gguf

Both above will not load if Local Server is selected in drop down. They will run if LM Studio is selected in drop down.
Models were downloaded in TARILIO from Hugging Face.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions