Unable to run Janus Pro locally using Chrome on Ubuntu 22.04 LTS

[amalic]

I am getting this error message when I load the model on my Workstation

• 16 Core / 32 Threads AMD Epyc CPU
• 64 GB Ram
• 1080 Ti
• Ubuntu 22.04 LTS
• Chrome 132.0.6834.159 (Official Build) (64-bit)

First I had issues enabling Vulkan and WebGPU which i eventually managed.

When loading the model I got this error message

u/huggingface_transformers.js?v=82803131:12815 Uncaught (in promise) Error: Can't create a session. failed to allocate a buffer of size 2079237968.
at Kt (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:12815:30)
at Cr (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:12820:123)
at pc (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13085:25)
at pn.loadModel (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13156:165)
at mn.createInferenceSessionHandler (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13205:28)
at e.create (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:4338:51)
at async createInferenceSession (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13354:25)
at async http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:18985:29
at async Promise.all (index 0)
at async constructSessions (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:18982:35)

After running it with this switch to increas max Ram using this command google-chrome --args --js-flags="--max_old_space_size=8192" I am getting this error message on the console.

Uncaught (in promise) 4168718248

I don't know what this means.

[xenova]

Are you sure that you have set device: "webgpu"? The error message looks like you are running on WASM.