Skip to content

Commit 1d7f95b

Browse files
authored
[Compiler] Disable Inductor standalone compile by default (#25391)
Signed-off-by: ElizaWszola <[email protected]>
1 parent cfbee3d commit 1d7f95b

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

vllm/envs.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -126,6 +126,7 @@
126126
VLLM_DP_RANK: int = 0
127127
VLLM_DP_RANK_LOCAL: int = -1
128128
VLLM_DP_SIZE: int = 1
129+
VLLM_USE_STANDALONE_COMPILE: bool = False
129130
VLLM_DP_MASTER_IP: str = ""
130131
VLLM_DP_MASTER_PORT: int = 0
131132
VLLM_MOE_DP_CHUNK_SIZE: int = 256
@@ -437,9 +438,9 @@ def get_vllm_port() -> Optional[int]:
437438

438439
# Feature flag to enable/disable Inductor standalone compile.
439440
# In torch <= 2.7 we ignore this flag; in torch >= 2.8 this is
440-
# enabled by default.
441+
# disabled by default.
441442
"VLLM_USE_STANDALONE_COMPILE":
442-
lambda: os.environ.get("VLLM_USE_STANDALONE_COMPILE", "1") == "1",
443+
lambda: os.environ.get("VLLM_USE_STANDALONE_COMPILE", "0") == "1",
443444

444445
# local rank of the process in the distributed setting, used to determine
445446
# the GPU device id

0 commit comments

Comments
 (0)