[Bug]: fetching models: has been blocked by CORS policy

[bangbangsheshotmedown]

Browser

Chrome

Description

I try to use API from nvidia, but i get this error when fetching models:

:5173/:1 Access to fetch at 'https://integrate.api.nvidia.com/v1/models' from origin 'http://localhost:5173' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: No 'Access-Control-Allow-Origin' header is present on the requested resource.

chunk-PNGJSGSD.js?v=72800f4e:21609 Download the React DevTools for a better development experience: https://reactjs.org/link/react-devtools
i18next.js?v=72800f4e:207 i18next: languageChanged en
i18next.js?v=72800f4e:207 i18next: initialized Object
index.ts:649 Starting migration from localStorage to IndexedDB...
index.ts:668 No legacy conversations found for migration.
index.ts:649 Starting migration from localStorage to IndexedDB...
index.ts:668 No legacy conversations found for migration.
i18next.js?v=72800f4e:207 i18next::translator: missingKey en translation sidebar.groups.August 2025 August 2025
i18next.js?v=72800f4e:207 i18next::translator: missingKey en translation sidebar.groups.August 2025 August 2025
i18next.js?v=72800f4e:207 i18next::translator: missingKey en translation sidebar.groups.August 2025 August 2025
i18next.js?v=72800f4e:207 i18next::translator: missingKey en translation sidebar.groups.August 2025 August 2025
i18next.js?v=72800f4e:207 i18next::translator: missingKey en translation sidebar.groups.August 2025 August 2025
i18next.js?v=72800f4e:207 i18next::translator: missingKey en translation sidebar.groups.August 2025 August 2025
i18next.js?v=72800f4e:207 i18next::translator: missingKey en translation sidebar.groups.August 2025 August 2025
i18next.js?v=72800f4e:207 i18next::translator: missingKey en translation sidebar.groups.August 2025 August 2025
:5173/:1 Access to fetch at 'https://integrate.api.nvidia.com/v1/models' from origin 'http://localhost:5173' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: No 'Access-Control-Allow-Origin' header is present on the requested resource.
integrate.api.nvidia.com/v1/models:1  Failed to load resource: net::ERR_FAILED
BaseOpenAIProvider.ts:267 Non-JSON response received: SyntaxError: Unexpected end of input
    at BaseOpenAIProvider.isErrorResponse (BaseOpenAIProvider.ts:264:29)
    at BaseOpenAIProvider.getModels (BaseOpenAIProvider.ts:133:16)
    at async inference.tsx:178:21
    at async inference.tsx:213:22
isErrorResponse @ BaseOpenAIProvider.ts:267
inference.tsx:181 fetch models failed:  Error: No response: Server closed connection without response
    at BaseOpenAIProvider.isErrorResponse (BaseOpenAIProvider.ts:293:15)
    at async BaseOpenAIProvider.getModels (BaseOpenAIProvider.ts:133:5)
    at async inference.tsx:178:21
    at async inference.tsx:213:22
(anonymous) @ inference.tsx:181
settings:1 Access to fetch at 'https://integrate.api.nvidia.com/v1/models' from origin 'http://localhost:5173' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: No 'Access-Control-Allow-Origin' header is present on the requested resource.
integrate.api.nvidia.com/v1/models:1  Failed to load resource: net::ERR_FAILED
BaseOpenAIProvider.ts:267 Non-JSON response received: SyntaxError: Unexpected end of input
    at BaseOpenAIProvider.isErrorResponse (BaseOpenAIProvider.ts:264:29)
    at BaseOpenAIProvider.getModels (BaseOpenAIProvider.ts:133:16)
    at async inference.tsx:178:21
isErrorResponse @ BaseOpenAIProvider.ts:267
inference.tsx:181 fetch models failed:  Error: No response: Server closed connection without response
    at BaseOpenAIProvider.isErrorResponse (BaseOpenAIProvider.ts:293:15)
    at async BaseOpenAIProvider.getModels (BaseOpenAIProvider.ts:133:5)
    at async inference.tsx:178:21
(anonymous) @ inference.tsx:181

Steps to Reproduce

1. select NVIDIA provider
2. enter key
3. click fetch models

Expected Behavior

It should load models

Version

main branch

Additional Context

No response

[mcm007]

The same problem with llama.cpp provider hosted locally behind reverse proxy on another hostname than llama.ui.

V2.23.4 - is working
V2.24.0 - and later have the CORS error

[olegshulyakov]

@bangbangsheshotmedown Can you please re-test on v2.32.3?

I am not able to get API key, OTP is not working.

[bangbangsheshotmedown]

@olegshulyakov I get the same issue with v2.32.3

I can setup an API key for you so you can test, let me know how/where i should send it to you

I think the best solution would be to add an option to add a proxy for CORS

Ex:

[ x ] Enable CORS Proxy
[URL]

So llama.ui would forward API calls to that url

ex:

https://corsproxy.io/ or a local one

But I am not a webdev, so I don't really know