Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AOTInductor] Include constants in AOTInductor .so file. #108473

Closed
wants to merge 4 commits into from

Commits on Sep 6, 2023

  1. [AOTInductor] Include constants in AOTInductor .so file. (pytorch#108473

    )
    
    Summary:
    
    Include constants in AOTInductor .so file.
    Added some difference:
    1) serialize with ctypes instead of the native of torch.storage
    2) Use the underlying for_blob instead of from_blob to construct Tensor.
    
    Test Plan:
    Unit tests:
    ```
    test/inductor/test_aot_inductor.py
    ```
    fb:
    MRS tests (https://fburl.com/gdoc/ffllzw72):
    ```
    LOGLEVEL=DEBUG TORCHINDUCTOR_MAX_AUTOTUNE=1 CUDA_VISIBLE_DEVICES=0,1,2,3 ../buck-out/v2/gen/fbcode/3408cf5f8424049a/hpc/new/models/feed/benchmark/__feed_lower_benchmark__/feed_lower_benchmark.par --load=manifold://ig_inference_model/tree/user/facebook/fblearner/predictor/966480198/289/gpu_lowering/input.predictor --skip-trt --sync-mode=0 --enable-aot-inductor
    ```
    
    Previous failed buck tests:
    ```
    buck2 test 'fbcode//mode/dev-nosan' fbcode//caffe2/torch/fb/model_transform/experimental/benchmark/test:test_aot_inductor_benchmark -- --exact 'caffe2/torch/fb/model_transform/experimental/benchmark/test:test_aot_inductor_benchmark - test_aot_inductor_benchmark_oemae (caffe2.torch.fb.model_transform.experimental.benchmark.test.test_aot_inductor_benchmark.AOTInductorBenchmark)'
    ```
    
    Differential Revision: D48927532
    muchulee8 authored and facebook-github-bot committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    d1bd637 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. Configuration menu
    Copy the full SHA
    76d2a97 View commit details
    Browse the repository at this point in the history
  2. lintrunner

    muchulee8 committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    9077584 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1868687 View commit details
    Browse the repository at this point in the history