[WIP] Deno browser WASM/WebGPU support

[xenova]

An experimental branch/PR to test running Transformers.js in Deno's WASM and WebGPU runtimes. This is a bit hacky, but it works... at least for now!

You can test this out by building this PR, and hosting the js files locally.

import { pipeline } from "http://localhost:8080/dist/transformers.js";

const extractor = await pipeline(
    "feature-extraction", "Xenova/all-MiniLM-L6-v2",
    // { device: "webgpu" }, // <-- Enable WebGPU acceleration
);

// Compute sentence embeddings
const sentences = ["Hello world", "This is an example sentence"];
const output = await extractor(sentences, { pooling: "mean", normalize: true });
console.log(output.tolist());

NOTE: This is different to running with the native EP (#1306), which will enable WebGPU support in Deno, via ONNXRuntime's Native WebGPU EP implementation.

There are some bugs/limitations with the current runtime (based on wgpu), e.g.,

An uncaught WebGPU validation error was raised: 
Shader 'Gather' parsing error: the `f16` enable-extension is not yet supported
  ┌─ wgsl:1:8
  │
1 │ enable f16;
  │        ^^^ this enable-extension specifies standard functionality which is not yet implemented in Naga
  │
  = note: Let Naga maintainers know that you ran into this at <https://github.com/gfx-rs/wgpu/issues/4384>, so they can prioritize it!

: the `f16` enable-extension is not yet supported
An uncaught WebGPU validation error was raised: ShaderModule with 'Gather' label is invalid
An uncaught WebGPU validation error was raised: ComputePipeline with 'Gather' label is invalid
An uncaught WebGPU validation error was raised: BindGroupLayout with '' label is invalid
An uncaught WebGPU validation error was raised: In a set_pipeline command: ComputePipeline with 'Gather' label is invalid
An uncaught WebGPU validation error was raised: In a set_bind_group command: BindGroup with 'Gather' label is invalid
An uncaught WebGPU validation error was raised: ComputePipeline with 'Gather' label is invalid
An uncaught WebGPU validation error was raised: BindGroupLayout with '' label is invalid
An uncaught WebGPU validation error was raised: In a set_bind_group command: BindGroup with 'Gather' label is invalid

but WASM works well 👍

cc @crowlKats for viz

[xenova]

Deno doesn't support relative URLs, so this is necessary... even if we have filesystem access

[xenova]

Very hacky, but is a current workaround, otherwise we get errors related to worker_threads not being prefixed with node:

cc @fs-eire if you have a better idea.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[xenova]

Handles an edge case where it is a node-like environment (e.g., Deno), but we are running in an environment where onnxruntime-node is not bundled (but onnxruntime-wasm is)

[xenova]

Turns out, this is also necessary to ensure v0.dev operates correctly, otherwise we get this error:

Failed to load model: no available backend found. ERR: [webgpu] TypeError: Failed to resolve module specifier 'worker_threads'

[fs-eire]

Turns out, this is also necessary to ensure v0.dev operates correctly, otherwise we get this error:

Failed to load model: no available backend found. ERR: [webgpu] TypeError: Failed to resolve module specifier 'worker_threads'

could you try replace "worker_threads" to "node:worker_threads"?

[xenova]

Unfortunately, I've tried that and it doesn't fix the issue:

Deno:

error: Uncaught (in promise) Error: no available backend found. ERR: [wasm] Error: The argument 'filename' must be a file URL object, file URL string, or absolute path string. Received http://localhost:1923/dist/ort-wasm-simd-threaded.jsep.mjs

v0:

Access to script at 'node:module' from origin 'https://....lite.vusercontent.net' has been blocked by CORS policy: Cross origin requests are only supported for protocol schemes: chrome, chrome-extension, chrome-untrusted, data, http, https, isolated-app.

[xenova]

Superseded by #1546 and #1556