Skip to content

HuggingFace model/tokenizer loader #1301

@zyaoj

Description

@zyaoj

Is your feature request related to a problem? Please describe:

Some users might want to load model ckpt directly from HF to quickly explore and do some testing.

Describe the solution you would like:

Adding a wrapper class or a model family that create_model wrapping HF lib.

Describe the alternatives you have considered:

Simply expose a functional interface as a function but this is less ideal.

Additional Context:

For directly loading qwen models (inference) that are not implemented in fairseq2 yet.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestmodelingRelated to modeling APIs

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions