Skip to content

推理速度慢? #46

@gWeiXP

Description

@gWeiXP

设置的是os.environ["CUDA_VISIBLE_DEVICES"] = "0,1,2,3" (4张L20),推理howto示例(无参考图),需要30min,这个正常吗?我注意到“离散扩散自适应(DiDA)技术大幅提升了推理效率”,现在发布的是“Inference Code (NTP Version)”版本,推理较快的版本是否在“Discrete Diffusion Adaptation (DiDA) Inference & Weights”中。

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions