Skip to content

Augment run plugins to support custom script argument override styles #570

@ananthsub

Description

@ananthsub

The NeMo-Run plugins here are targeted for recipe users: https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/src/megatron/bridge/recipes/run_plugins.py

For users relying on the run.Script launch mechanism, the plugins today pass args according to the hydra-style overrides. however, users may not always configure their scripts to accept args in this way.

To allow for more customizability, we can augment the plugins to take in a script_args_converter_fn which should return a list of args to append to the task's arguments. this would allow users to specify their own conversion function if their training script doens't use hydra-style overrides

Metadata

Metadata

Assignees

Labels

Type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions