Use subgroup operations when possible about web-llm

[beaufortfrancois]

@CharlieFRuan @tqchen What are your thoughts on this?

[tqchen]

This is great, subgroup shuffle can be useful for reduction operations. We did have warp shuffle support for metal backend, so maybe we can try add codegen backend for webgpu

[beaufortfrancois]

The following subgroup shuffle functions are actually in Chrome 129 (currently beta):

• subgroupShuffle(value, id): Returns value from the active invocation whose subgroup_invocation_id matches id.
• subgroupShuffleXor(value, mask): Returns value from the active invocation whose subgroup_invocation_id matches subgroup_invocation_id ^ mask. mask must be dynamically uniform.
• subgroupShuffleUp(value, delta): Returns value from the active invocation whose subgroup_invocation_id matches subgroup_invocation_id - delta.
• subgroupShuffleDown(value, delta): Returns value from the active invocation whose subgroup_invocation_id matches subgroup_invocation_id + delta.

[beaufortfrancois]

@tqchen @CharlieFRuan Is this being implemented in Apache TVM?

[CharlieFRuan]

Hi @beaufortfrancois Really appreciate the info and suggestions! We think it is a good idea to have it implemented in the TVM flow. Unfortunately, we are a bit out of bandwidth as of now. We'll revisit in the future!