Skip to content

Conversation

@zhaohb
Copy link

@zhaohb zhaohb commented Oct 24, 2025

Just for EXAONE-4.0-1.2B

ticket : 175853

What does this PR do?

Conversion cmd-line for LGAI-EXAONE/EXAONE-4.0-1.2B:

optimum-cli export openvino -m  LGAI-EXAONE/EXAONE-4.0-1.2B EXAONE-4.0-1.2B

Inference of LGAI-EXAONE/EXAONE-4.0-1.2B using OpenVINO backend:

import torch
from transformers import AutoTokenizer
from optimum.intel.openvino import OVModelForCausalLM

model_dir="LGAI-EXAONE/EXAONE-4.0-1.2B"

tokenizer = AutoTokenizer.from_pretrained(model_dir)
model = OVModelForCausalLM.from_pretrained(model_dir)

prompt = "What is the capital of France?"

messages = [
    {"role": "user", "content": prompt}
]
input_ids = tokenizer.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    return_tensors="pt"
)

# Run inference
output_ids = model.generate(input_ids, max_new_tokens=10)
output_text = tokenizer.decode(output_ids[0])

print(output_text)

Before submitting

  • [N/A] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

Copy link
Collaborator

@rkazants rkazants left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide tests and JIRA ticket.

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@zhaohb
Copy link
Author

zhaohb commented Oct 31, 2025

Please provide tests and JIRA ticket.

Hi, I had add JITA ticket and tests.
Thank you very much.

@rkazants
Copy link
Collaborator

rkazants commented Nov 3, 2025

@zhaohb, please provide PR description in a format as here: #1354
Example:
image

@nikita-savelyevv nikita-savelyevv added the openvino-slow Runs OpenVINO slow tests with different versions of transformers label Nov 3, 2025
@zhaohb
Copy link
Author

zhaohb commented Nov 4, 2025

@zhaohb, please provide PR description in a format as here: #1354 Example: image

Done, thanks.

Copy link
Collaborator

@rkazants rkazants left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhaohb zhaohb force-pushed the support_exaone4_model branch from b48eaf0 to 4acbc70 Compare November 14, 2025 08:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

openvino-slow Runs OpenVINO slow tests with different versions of transformers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants