-
Notifications
You must be signed in to change notification settings - Fork 1.9k
Open
Labels
Description
Version
v0.24
Model
UI-TARS-2B-SFT
Deployment Method
Local
Issue Description
Expected behavior: Search the internet for cute pictures.
Actual behavior: Dies because of the context length error.
Error Logs
cd UI-TARS-desktop && npx pnpm run dev:ui-tars
Desktop/temp > cd UI-TARS-desktop && npx pnpm run dev:ui-tars
npm warn Unknown project config "shamefully-hoist". This will stop working in the next major version of npm.
npm warn Unknown project config "node-linker". This will stop working in the next major version of npm.
> monorepo@0.0.1 dev:ui-tars /home/takasura/Desktop/temp/UI-TARS-desktop
> turbo run ui-tars-desktop#dev
turbo 2.4.4
• Packages in scope: @agent-infra/bing-search, @agent-infra/browser, @agent-infra/browser-search, @agent-infra/browser-use, @agent-infra/duckduckgo-search, @agent-infra/logger, @agent-infra/mcp-benchmark, @agent-infra/mcp-client, @agent-infra/mcp-server-browser, @agent-infra/mcp-server-commands, @agent-infra/mcp-server-filesystem, @agent-infra/mcp-server-search, @agent-infra/mcp-shared, @agent-infra/search, @agent-infra/shared, @common/configs, @common/electron-build, @ui-tars/action-parser, @ui-tars/cli, @ui-tars/electron-ipc, @ui-tars/operator-adb, @ui-tars/operator-browser, @ui-tars/operator-browserbase, @ui-tars/operator-nut-js, @ui-tars/sdk, @ui-tars/shared, @ui-tars/utio, create-new-mcp, mcp-http-server, ui-tars-desktop, ui-tars-desktop-renderer
• Running ui-tars-desktop#dev in 31 packages
• Remote caching disabled
ui-tars-desktop:dev: cache bypass, force executing 8741b2b05637fbfc
ui-tars-desktop:dev:
ui-tars-desktop:dev: > ui-tars-desktop@0.2.4 dev /home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars
ui-tars-desktop:dev: > electron-vite dev
ui-tars-desktop:dev:
ui-tars-desktop:dev: vite v6.2.2 building SSR bundle for development...
../../node_modules/file-type/core.js (1419:16): Use of eval in "../../node_modules/file-type/core.js" is strongly discouraged as it poses security risks and may cause issues with minification.
✓ 2368 modules transformed.
Generated an empty chunk: "app_private".
dist/main/app_private-Dyvby5gX.js 0.01 kB
ui-tars-desktop:dev: dist/main/index-CtsU6c2f.js 0.68 kB
ui-tars-desktop:dev: dist/main/BrowserWebSocketTransport-D0cjxDeU.js 0.94 kB
ui-tars-desktop:dev: dist/main/fileFromPath-1g7i6PBK.js 4.66 kB
ui-tars-desktop:dev: dist/main/source-map-support-D6d8GHBV.js 18.99 kB
ui-tars-desktop:dev: dist/main/index-D7bHkL9b.js 20.76 kB
ui-tars-desktop:dev: dist/main/systemPermissions-AHXYQjon.js 102.59 kB
ui-tars-desktop:dev: dist/main/index-8DzgTOz1.js 282.25 kB
ui-tars-desktop:dev: dist/main/bidi-9VA-E60H.js 603.55 kB
ui-tars-desktop:dev: dist/main/main.js 6,920.18 kB
ui-tars-desktop:dev: ✓ built in 4.35s
ui-tars-desktop:dev:
ui-tars-desktop:dev: build the electron main process successfully
ui-tars-desktop:dev:
ui-tars-desktop:dev: -----
ui-tars-desktop:dev:
ui-tars-desktop:dev: vite v6.2.2 building SSR bundle for development...
✓ 1 modules transformed.
dist/preload/index.js 2.02 kB
ui-tars-desktop:dev: ✓ built in 6ms
ui-tars-desktop:dev:
ui-tars-desktop:dev: build the electron preload files successfully
ui-tars-desktop:dev:
ui-tars-desktop:dev: -----
ui-tars-desktop:dev:
dev server running for the electron renderer process at:
ui-tars-desktop:dev:
ui-tars-desktop:dev: ➜ Local: http://localhost:5173/
ui-tars-desktop:dev: ➜ Network: use --host to expose
ui-tars-desktop:dev:
ui-tars-desktop:dev: start electron app...
ui-tars-desktop:dev:
ui-tars-desktop:dev: 23:32:30.737 (main) › [env] {
ui-tars-desktop:dev: forceDownload: false,
ui-tars-desktop:dev: isDev: true,
ui-tars-desktop:dev: isE2eTest: false,
ui-tars-desktop:dev: isLinux: true,
ui-tars-desktop:dev: isMacOS: false,
ui-tars-desktop:dev: isProd: false,
ui-tars-desktop:dev: isWindows: false,
ui-tars-desktop:dev: isWindows11: false,
ui-tars-desktop:dev: mode: 'development',
ui-tars-desktop:dev: port: 1212,
ui-tars-desktop:dev: rendererUrl: 'http://localhost:5173'
ui-tars-desktop:dev: }
ui-tars-desktop:dev: Gtk-Message: 23:32:30.765: Failed to load module "colorreload-gtk-module"
ui-tars-desktop:dev: Gtk-Message: 23:32:30.765: Failed to load module "window-decorations-gtk-module"
ui-tars-desktop:dev: 23:32:30.819 (main) › isAccessibilityEnabled true
ui-tars-desktop:dev: 23:32:30.819 (main) › Checking browser availability...
ui-tars-desktop:dev: [DefaultBrowserOperator] Find browser on platform: linux
ui-tars-desktop:dev: [DefaultBrowserOperator] browserPath: /usr/bin/google-chrome-stable
ui-tars-desktop:dev: 23:32:30.820 (main) › Browser availability: true
ui-tars-desktop:dev: 23:32:30.826 (main) › createTray
ui-tars-desktop:dev: 23:32:30.830 (main) › [UTIO] endpoint:
ui-tars-desktop:dev: 23:32:30.830 (main) › createMainWindow
ui-tars-desktop:dev: 23:32:30.830 (main) › [createWindow]: routerPath: / config: {
ui-tars-desktop:dev: show: false,
ui-tars-desktop:dev: width: 1200,
ui-tars-desktop:dev: height: 700,
ui-tars-desktop:dev: movable: true,
ui-tars-desktop:dev: alwaysOnTop: false,
ui-tars-desktop:dev: webPreferences: {
ui-tars-desktop:dev: preload: '/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/preload/index.js',
ui-tars-desktop:dev: sandbox: false,
ui-tars-desktop:dev: webSecurity: true
ui-tars-desktop:dev: },
ui-tars-desktop:dev: icon: '/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/resources/icon.png'
ui-tars-desktop:dev: }
ui-tars-desktop:dev: renderer url http://localhost:5173
ui-tars-desktop:dev: 23:32:30.861 (main) › mainZustandBridge
ui-tars-desktop:dev: 23:32:30.861 (main) › initializeApp end
ui-tars-desktop:dev: 23:32:30.862 (main) › TypeError: installExtension is not a function
ui-tars-desktop:dev: at /home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:167855:25
ui-tars-desktop:dev: 23:32:30.867 (main) › app.whenReady end
ui-tars-desktop:dev: [getEnsurePermissions] ensurePermissions { screenCapture: true, accessibility: true }
ui-tars-desktop:dev: 23:32:41.190 (main) › runAgent
ui-tars-desktop:dev: 23:32:41.190 (main) › settings.operator Local Browser Operator
ui-tars-desktop:dev: 23:32:41.190 (main) › Checking browser availability...
ui-tars-desktop:dev: 23:32:41.190 (main) › Browser availability: true
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] Browser Options: {
ui-tars-desktop:dev: logger: ConsoleLogger {
ui-tars-desktop:dev: prefix: '[DefaultBrowserOperator]',
ui-tars-desktop:dev: lastPrefixColor: null,
ui-tars-desktop:dev: level: 1
ui-tars-desktop:dev: }
ui-tars-desktop:dev: }
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] Launching browser with options: {
ui-tars-desktop:dev: executablePath: '/usr/bin/google-chrome-stable',
ui-tars-desktop:dev: browserType: 'chrome'
ui-tars-desktop:dev: }
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] Using executable path: /usr/bin/google-chrome-stable
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] Launch options: {
ui-tars-desktop:dev: browser: 'chrome',
ui-tars-desktop:dev: executablePath: '/usr/bin/google-chrome-stable',
ui-tars-desktop:dev: dumpio: false,
ui-tars-desktop:dev: headless: false,
ui-tars-desktop:dev: defaultViewport: { width: 1280, height: 800, deviceScaleFactor: 0 },
ui-tars-desktop:dev: args: [
ui-tars-desktop:dev: '--no-sandbox',
ui-tars-desktop:dev: '--mute-audio',
ui-tars-desktop:dev: '--disable-gpu',
ui-tars-desktop:dev: '--disable-blink-features=AutomationControlled',
ui-tars-desktop:dev: '--disable-infobars',
ui-tars-desktop:dev: '--disable-background-timer-throttling',
ui-tars-desktop:dev: '--disable-popup-blocking',
ui-tars-desktop:dev: '--disable-backgrounding-occluded-windows',
ui-tars-desktop:dev: '--disable-renderer-backgrounding',
ui-tars-desktop:dev: '--disable-window-activation',
ui-tars-desktop:dev: '--disable-focus-on-load',
ui-tars-desktop:dev: '--no-default-browser-check',
ui-tars-desktop:dev: '--disable-web-security',
ui-tars-desktop:dev: '--disable-features=IsolateOrigins,site-per-process',
ui-tars-desktop:dev: '--disable-site-isolation-trials',
ui-tars-desktop:dev: '--window-size=1280,890'
ui-tars-desktop:dev: ],
ui-tars-desktop:dev: ignoreDefaultArgs: [ '--enable-automation' ],
ui-tars-desktop:dev: timeout: 0,
ui-tars-desktop:dev: downloadBehavior: { policy: 'deny' }
ui-tars-desktop:dev: }
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] setupPageListener()
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] Browser launched successfully
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] PageListener: targetcreated, type: page
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] New page created: about:blank
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] PageListener: targetchanged: page
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] The target changed https://www.google.com/
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] PageListener: targetchanged: page
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] The target changed https://www.google.com/
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator] Clickable elements highlighting disabled
ui-tars-desktop:dev: 23:32:42.735 (main) › [UTIO] endpoint:
ui-tars-desktop:dev: [31774:1020/233242.753348:ERROR:atom_cache.cc(229)] Add _NET_WM_WINDOW_TYPE_TOOLBAR to kAtomsToCache
ui-tars-desktop:dev: 23:32:42.774 (main) › [GUIAgent] run:
ui-tars-desktop:dev: system prompt: You are a GUI agent. You are given a task and your action history, with screenshots. You need to perform the next action to complete the task.
ui-tars-desktop:dev:
ui-tars-desktop:dev: ## Output Format
ui-tars-desktop:dev: ```
ui-tars-desktop:dev: Thought: ...
ui-tars-desktop:dev: Action: ...
ui-tars-desktop:dev: ```
ui-tars-desktop:dev:
ui-tars-desktop:dev: ## Action Space
ui-tars-desktop:dev:
ui-tars-desktop:dev: click(start_box='<|box_start|>(x1,y1)<|box_end|>')
ui-tars-desktop:dev: left_double(start_box='<|box_start|>(x1,y1)<|box_end|>')
ui-tars-desktop:dev: right_single(start_box='<|box_start|>(x1,y1)<|box_end|>')
ui-tars-desktop:dev: drag(start_box='<|box_start|>(x1,y1)<|box_end|>', end_box='<|box_start|>(x3,y3)<|box_end|>')
ui-tars-desktop:dev: hotkey(key='ctrl c') # Split keys with a space and use lowercase. Also, do not use more than 3 keys in one hotkey action.
ui-tars-desktop:dev: type(content='xxx') # Use escape characters \', \", and \n in content part to ensure we can parse the content in normal python string format. If you want to submit your input, use \n at the end of content.
ui-tars-desktop:dev: scroll(start_box='<|box_start|>(x1,y1)<|box_end|>', direction='down or up or right or left') # Show more information on the `direction` side.
ui-tars-desktop:dev: wait() # Sleep for 5s and take a screenshot to check for any changes.
ui-tars-desktop:dev: finished()
ui-tars-desktop:dev: call_user() # Submit the task and call the user when the task is unsolvable, or when you need the user's help.
ui-tars-desktop:dev:
ui-tars-desktop:dev:
ui-tars-desktop:dev: ## Note
ui-tars-desktop:dev: - Use English in `Thought` part.
ui-tars-desktop:dev: - Generate a well-defined and practical strategy in the `Thought` section, summarizing your next move and its objective.
ui-tars-desktop:dev:
ui-tars-desktop:dev: ## User Instruction
ui-tars-desktop:dev: ,
ui-tars-desktop:dev: model version: 1.5,
ui-tars-desktop:dev: model config: {"modelConfig":{"baseURL":"http://127.0.0.1:8081/v1","apiKey":"empty","model":"ByteDance-Seed/UI-TARS-2B-SFT","useResponsesApi":false},"headImageContext":null}
ui-tars-desktop:dev: 23:32:42.774 (main) › [onGUIAgentData] status running 0
ui-tars-desktop:dev: 23:32:42.774 (main) › [onGUIAgentData] ======data======
ui-tars-desktop:dev: null null {} running
ui-tars-desktop:dev: ========
ui-tars-desktop:dev: 23:32:42.775 (main) › [GUIAgent] loopCnt: 0
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator] Starting screenshot...
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] getActivePage: current activePage CdpPage { _isDragging: false, _timeoutSettings: TimeoutSettings {} }
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator] Getting deviceScaleFactor info...
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] getActivePage: current activePage CdpPage { _isDragging: false, _timeoutSettings: TimeoutSettings {} }
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator] DeviceScaleFactor: 1
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator] Taking screenshot...
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator]:[UIHelper] cleanupTemporaryVisuals up...
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BaseBrowser] getActivePage: current activePage CdpPage { _isDragging: false, _timeoutSettings: TimeoutSettings {} }
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator]:[UIHelper] cleanupTemporaryVisuals up done!
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator] Screenshot taken in 79ms
ui-tars-desktop:dev: [DefaultBrowserOperator]:[BrowserOperator] Screenshot Info { base64: '<base64>', scaleFactor: 1 }
ui-tars-desktop:dev: 23:32:42.931 (main) › [onGUIAgentData] status running 1
ui-tars-desktop:dev: 23:32:42.932 (main) › [onGUIAgentData] ======data======
ui-tars-desktop:dev: null {
ui-tars-desktop:dev: size: { width: 1280, height: 800 },
ui-tars-desktop:dev: mime: 'image/jpeg',
ui-tars-desktop:dev: scaleFactor: 1
ui-tars-desktop:dev: } {
ui-tars-desktop:dev: from: 'human',
ui-tars-desktop:dev: value: '<image>',
ui-tars-desktop:dev: timing: { start: 1761017562775, end: 1761017562931, cost: 156 }
ui-tars-desktop:dev: } running
ui-tars-desktop:dev: ========
ui-tars-desktop:dev: 23:32:42.932 (main) › [UITarsModel] invoke: screenContext={"width":1280,"height":800}, scaleFactor=1, uiTarsVersion=1.5, useResponsesApi=false
ui-tars-desktop:dev: 23:32:43.055 (main) › [UITarsModel] error Error: 400 'max_tokens' or 'max_completion_tokens' is too large: 65535. This model's maximum context length is 32768 tokens and your request has 348 input tokens (65535 > 32768 - 348). None
ui-tars-desktop:dev: at APIError2.generate (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:66969:14)
ui-tars-desktop:dev: at OpenAI2.makeStatusError (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:72542:23)
ui-tars-desktop:dev: at OpenAI2.makeRequest (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:72675:24)
ui-tars-desktop:dev: at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
ui-tars-desktop:dev: at async UITarsModel.invokeModelProvider (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:73359:20)
ui-tars-desktop:dev: at async UITarsModel.invoke (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:73381:20)
ui-tars-desktop:dev: at async async_retry.retries._retry_model (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:73595:28)
ui-tars-desktop:dev: at async GUIAgent.run (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:73593:85)
ui-tars-desktop:dev: at async runAgent (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:158974:3)
ui-tars-desktop:dev: at async Object.handle (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:159019:5)
ui-tars-desktop:dev: 23:32:43.055 (main) › [UITarsModel cost]: 40ms
ui-tars-desktop:dev: 23:32:43.055 (main) › [GUIAgent] guiAgentErrorParser: Error: 400 'max_tokens' or 'max_completion_tokens' is too large: 65535. This model's maximum context length is 32768 tokens and your request has 348 input tokens (65535 > 32768 - 348). None
ui-tars-desktop:dev: at APIError2.generate (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:66969:14)
ui-tars-desktop:dev: at OpenAI2.makeStatusError (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:72542:23)
ui-tars-desktop:dev: at OpenAI2.makeRequest (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:72675:24)
ui-tars-desktop:dev: at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
ui-tars-desktop:dev: at async UITarsModel.invokeModelProvider (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:73359:20)
ui-tars-desktop:dev: at async UITarsModel.invoke (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:73381:20)
ui-tars-desktop:dev: at async async_retry.retries._retry_model (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:73595:28)
ui-tars-desktop:dev: at async GUIAgent.run (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:73593:85)
ui-tars-desktop:dev: at async runAgent (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:158974:3)
ui-tars-desktop:dev: at async Object.handle (/home/takasura/Desktop/temp/UI-TARS-desktop/apps/ui-tars/dist/main/main.js:159019:5)
ui-tars-desktop:dev: 23:32:50.419 (main) › mainWindow closed
Tasks: 1 successful, 1 total
Cached: 0 cached, 1 total
Time: 25.088s
temp/UI-TARS-desktop - (main) ✗ >