Skip to content

读完您的博客:https://seanwangjs.github.io/2024/04/05/gptq.html,想与您讨论一些问题。 #9

Description

@NingBoB

博客链接:https://seanwangjs.github.io/2024/04/05/gptq.html
作者你好,对于OBS剪枝我存在疑问,OBS中通过剪枝后对权重矩阵进行补偿,从而实现减少剪枝对模型的影响。该方法的流程中是遍历整个权重矩阵,每次选出最优的剪枝权重,并对其进行剪枝,那么在后续的多次剪枝中,会不会影响之前已经剪枝的权重?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions