HuggingFace has just released Transformer.js v4 with WebGPU support

2 pointsposted 6 hours ago
by pavelai

1 Comments

pavelai

6 hours ago

Transformers.js allows you to run models right in the browser. The fourth version focuses on performance. The new version has support of WebGPU and it opens new era in browser-run models

Here the demos on HuggingFace: https://huggingface.co/collections/webml-community/transform...

It's just a surprise to see what can be done with the models in browsers today. This demos shows the abilities of the models, and this is the time for creators to bring their ideas and make solutions for real tasks

This release also adds new models to be run in browser Mistral4, Qwen2, DeepSeek-v3 and others. It has limited number of changes, what makes it pretty stable for a major version