Skip to content

support youtu-vl model - #18479

Merged
ngxson merged 18 commits into
ggml-org:masterfrom
f291400:master
Jan 1, 2026
Merged

support youtu-vl model#18479
ngxson merged 18 commits into
ggml-org:masterfrom
f291400:master

Conversation

@f291400

@f291400 f291400 commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

Make sure to read the contributing guidelines before submitting a PR

@github-actions github-actions Bot added examples python python script changes labels Dec 30, 2025
@f291400 f291400 mentioned this pull request Dec 30, 2025
Closed
@loci-dev loci-dev mentioned this pull request Dec 30, 2025
Open
ngxson
ngxson requested changes Dec 30, 2025
View reviewed changes

@ngxson ngxson left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also wait for @CISC @ggerganov reviews for libllama changes

Comment thread gguf-py/gguf/gguf_writer.py Outdated
Comment thread tools/mtmd/clip-model.h Outdated
Comment thread convert_hf_to_gguf_update.py Outdated
CISC
CISC reviewed Dec 30, 2025
View reviewed changes
Comment thread convert_hf_to_gguf.py Outdated
Comment thread convert_hf_to_gguf.py
Comment thread tools/mtmd/clip-impl.h Outdated
Comment thread convert_hf_to_gguf.py Outdated
CISC
CISC reviewed Dec 30, 2025
View reviewed changes
Comment thread convert_hf_to_gguf.py Outdated
@f291400
f291400 requested review from CISC and ngxson December 31, 2025 01:16
CISC
CISC reviewed Dec 31, 2025
View reviewed changes
Comment thread convert_hf_to_gguf.py
CISC
CISC reviewed Dec 31, 2025
View reviewed changes
Comment thread convert_hf_to_gguf.py
CISC
CISC reviewed Dec 31, 2025
View reviewed changes
Comment thread gguf-py/gguf/gguf_writer.py
CISC
CISC reviewed Dec 31, 2025
View reviewed changes
Comment thread convert_hf_to_gguf.py
CISC
CISC reviewed Dec 31, 2025
View reviewed changes
Comment thread convert_hf_to_gguf.py
@github-actions github-actions Bot added the model Model specific label Dec 31, 2025
CISC
CISC approved these changes Dec 31, 2025
View reviewed changes

@CISC CISC left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM after whitespace fixes

@f291400

f291400 commented Dec 31, 2025

Copy link
Copy Markdown
Contributor Author

@ngxson @ggerganov
Could you please review the code and check if there are any remaining bugs that need to be addressed? I would like to merge these changes into the main branch as soon as possible.

@ngxson

ngxson commented Jan 1, 2026

Copy link
Copy Markdown
Collaborator

Lint CI fails, please fix before we can merge.

@CISC

CISC commented Jan 1, 2026

Copy link
Copy Markdown
Member

Lint CI fails, please fix before we can merge.

LOL, I think it just picks up the previous master error somehow...

@f291400 Try rebasing, should fix the CI.

@ngxson

ngxson commented Jan 1, 2026

Copy link
Copy Markdown
Collaborator

If it's fixed on master then I think it's ok to merge as-is then @CISC ?

Beside, @f291400 if you want reviews to be fast and efficient, read the contribution guidelines and validate your changes carefully.

This PR is create from your master branch, maintainers cannot push fixes directly here; the PR is also moved 2-3 times which make our work extremely inefficient.

@CISC

CISC commented Jan 1, 2026

Copy link
Copy Markdown
Member

If it's fixed on master then I think it's ok to merge as-is then @CISC ?

I ran flake8 locally and it doesn't report any errors, and the line number given by CI is bogus, so I think it should be fine.

@svlys

svlys commented Jan 1, 2026

Copy link
Copy Markdown

Thank you for acknowledging this submission, which will greatly advance the use of youtu-llm on llama.cpp.

@ngxson

ngxson commented Jan 1, 2026

Copy link
Copy Markdown
Collaborator

I attempted to merge via GH web UI but failed, so unfortunately you need to fix the merge conflict yourself @f291400

CISC
CISC reviewed Jan 1, 2026
View reviewed changes
Comment thread src/llama-vocab.h Outdated
@CISC

CISC commented Jan 1, 2026

Copy link
Copy Markdown
Member

This PR is create from your master branch, maintainers cannot push fixes directly here; the PR is also moved 2-3 times which make our work extremely inefficient.

So, it seems GitHub started allowing this now?

@ngxson

ngxson commented Jan 1, 2026

Copy link
Copy Markdown
Collaborator

So, it seems GitHub started allowing this now?

No idea, probably allowed via web UI only?

I never have problem applying patches via web UI. But if I do gh pr checkout locally and if the PR is created from fork's master branch, I always get permission error on git push

@CISC

CISC commented Jan 1, 2026

Copy link
Copy Markdown
Member

So, it seems GitHub started allowing this now?

No idea, probably allowed via web UI only?

I never have problem applying patches via web UI. But if I do gh pr checkout locally and if the PR is created from fork's master branch, I always get permission error on git push

I'm pretty sure merging from master used to fail.

@ngxson
ngxson merged commit ced765b into ggml-org:master Jan 1, 2026
72 checks passed
srogmann pushed a commit to srogmann/llama.cpp that referenced this pull request Jan 1, 2026
@f291400 @ngxson
@CISC @srogmann
model: support youtu-vl model (ggml-org#18479)
0b60ba6 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
ronaldmannak pushed a commit to PicoMLX/llama.cpp that referenced this pull request Jan 2, 2026
@f291400 @ngxson
@CISC @ronaldmannak
model: support youtu-vl model (ggml-org#18479)
7fb22d6 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
@github-actions github-actions Bot mentioned this pull request Jan 2, 2026
Open
ronaldmannak pushed a commit to PicoMLX/llama.cpp that referenced this pull request Jan 9, 2026
@f291400 @ngxson
@CISC @ronaldmannak
model: support youtu-vl model (ggml-org#18479)
6949d14 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
blime4 referenced this pull request in blime4/llama.cpp Feb 5, 2026
@f291400 @ngxson
@CISC shaobo.xie
model: support youtu-vl model (#18479)
0d98a12 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
@svlys svlys mentioned this pull request Feb 5, 2026
Open
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
@f291400 @ngxson @CISC
model: support youtu-vl model (ggml-org#18479)
c20e037 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
@f291400 @ngxson @CISC
model: support youtu-vl model (ggml-org#18479)
f1621f6 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
@f291400 @ngxson @CISC
model: support youtu-vl model (ggml-org#18479)
325a5f8 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
@f291400 @ngxson @CISC
model: support youtu-vl model (ggml-org#18479)
1e5e42b 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
phibya pushed a commit to ziee-ai/llama.cpp that referenced this pull request May 29, 2026
@f291400 @ngxson @CISC
model: support youtu-vl model (ggml-org#18479)
cbb97fc 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
fewtarius pushed a commit to fewtarius/CachyLLama that referenced this pull request May 30, 2026
@f291400 @ngxson @CISC
model: support youtu-vl model (ggml-org#18479)
ee043c0 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
@f291400 @ngxson @CISC
model: support youtu-vl model (ggml-org#18479)
5c3b08d 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
MrLordCat referenced this pull request in MrLordCat/llama.cpp-rdna-lab Jul 16, 2026
@f291400 @ngxson @CISC
model: support youtu-vl model (#18479)
3e24a40 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
zommiommy pushed a commit to zommiommy/llama.cpp that referenced this pull request Aug 18, 2026
@f291400 @ngxson
@CISC @zommiommy
model: support youtu-vl model (ggml-org#18479)
dc2ee32 
* Support Youtu-VL Model

* merge code

* fix bug

* revert qwen2 code & support rsplit in minja.hpp

* update warm info

* fix annotation

* u

* revert minja.hpp

* fix

* Do not write routed_scaling_factor to gguf when routed_scaling_factor is None

* fix expert_weights_scale

* LGTM after whitespace fixes

* fix

* fix

* fix

* layers to layer_index

* enum fix

---------

Co-authored-by: Xuan-Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@CISC CISC CISC approved these changes
@ngxson ngxson ngxson approved these changes
@ggerganov ggerganov Awaiting requested review from ggerganov ggerganov is a code owner

Assignees

No one assigned

Labels

examples model Model specific python python script changes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@f291400 @CISC @caohaoyuabcd @ngxson @svlys