Skip to content

Commit

Permalink
[XPU] Open ir pass (#8598)
Browse files Browse the repository at this point in the history
  • Loading branch information
zhink authored Jun 13, 2024
1 parent 8e24341 commit 2dc4d7b
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions llm/predictor.py
Original file line number Diff line number Diff line change
Expand Up @@ -1092,6 +1092,8 @@ def _create_predictor(self, predictor_args: PredictorArgument):
xpu_config.l3_size = 63 * 1024 * 1024
xpu_config.l3_autotune_size = 63 * 1024 * 1024
config.set_xpu_config(xpu_config)
config.switch_ir_optim(True)
config.enable_memory_optim()
else:
device_id = int(os.environ.get("FLAGS_selected_gpus", 0))
config.enable_use_gpu(100, device_id)
Expand Down

0 comments on commit 2dc4d7b

Please sign in to comment.