Skip to content

Hacky tensor parallel for Vision Models#791

Draft
Ph0rk0z wants to merge 3 commits into
turboderp-org:devfrom
Ph0rk0z:patch-1
Draft

Hacky tensor parallel for Vision Models#791
Ph0rk0z wants to merge 3 commits into
turboderp-org:devfrom
Ph0rk0z:patch-1

architecture.py - Tested qwen2 VL 72b TP and it works.

4430729
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs