Is it possible to make wasm support all models in huggingface?

Models
1

Wasm have below advantages

  1. run locally, no server or extran machine needed, which can help user to try new model without any cost.
  2. no any privacy concerns

Now, there are several model that support wasm.

  1. whisper.wasm, which can convert audio to text.
  2. secret-llama: text-to-text LLM, realize by web-gpu
  3. web-llm: text-to-text LLM

If it is possible to make a project to support wasm for all huggingface models, this can definitely accelerate the development of LLM.

2

I think the demand is there.
BTW, it’s hard for the HF staff to hear you on the forum, so it’s faster to mention directly and discuss it on the Post.
For the most part, you can copy the following post.

3

Thanks a lot, this is useful.

I found I don’t know where to creat a post, is that a permission problem?

4

I wonder if there is any permission in the post? Maybe nothing specific like that?

I don’t have long experience with HF either, so I’m a bit somewhat vague, but for example, if you click on the @-like symbol on this page, you can go to the post creation screen addressed to victor. Be careful, because if you really send it, the post will be posted!

Also, you can do the mention itself from the forum. Just write @ and put some letters.

1 Like
5

Yes, I found that, Posts on Hugging Face is a PRO feature.

thanks a lot

6

Seriously! I didn’t know that.:scream_cat:
Maybe it’s an anti-vandalism measure.

I don’t know if the post below is still valid, but maybe you can just write it.
（As far as I know) people without Pro subscriptions are also writing. I think it’s only new Post that can’t.

7

Sorry, I know what is the problem right now.
I can not creat new post because I am not pro user, but I can reply to other’s posts.
I already reply in below this post.
Thanks again.

8

Good. Maybe the HF staff will take a look.