Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

【prim】New layer_norm grad #51750

Merged
merged 68 commits into from
Mar 20, 2023
Merged

【prim】New layer_norm grad #51750

merged 68 commits into from
Mar 20, 2023

Commits on Feb 20, 2023

  1. Add flatten composite rule

    @xysheng-baidu
    xysheng-baidu committed Feb 20, 2023
    Configuration menu
    Copy the full SHA
    ba39d24 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2023

  1. get the right xshape and pass func test

    @xysheng-baidu
    xysheng-baidu committed Feb 21, 2023
    Configuration menu
    Copy the full SHA
    a80f705 View commit details
    Browse the repository at this point in the history

  2. add cinn unit test

    @xysheng-baidu
    xysheng-baidu committed Feb 21, 2023
    Configuration menu
    Copy the full SHA
    4943544 View commit details
    Browse the repository at this point in the history

  3. Remove cinn test, wait for it to be added after repair

    @xysheng-baidu
    xysheng-baidu committed Feb 21, 2023
    Configuration menu
    Copy the full SHA
    d9ffe5e View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2023

  1. add comp test to test_flatten_contiguous_range_op.py

    @xysheng-baidu
    xysheng-baidu committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    d3f8af7 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'PaddlePaddle:develop' into composite_rule_flatten

    @xysheng-baidu
    xysheng-baidu committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    83deca7 View commit details
    Browse the repository at this point in the history

  3. remove func test on composite_ops

    @xysheng-baidu
    xysheng-baidu committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    4e43a73 View commit details
    Browse the repository at this point in the history

  4. Add comments to maybe_wrap_dim func

    @xysheng-baidu
    xysheng-baidu committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    3c906bb View commit details
    Browse the repository at this point in the history

  5. remove commented code

    @xysheng-baidu
    xysheng-baidu committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    c569f59 View commit details
    Browse the repository at this point in the history

  6. fix the problem with 0D tensor case

    @xysheng-baidu
    xysheng-baidu committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    48547ab View commit details
    Browse the repository at this point in the history

  7. add flatten split rule comment

    @xysheng-baidu
    xysheng-baidu committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    d384698 View commit details
    Browse the repository at this point in the history

  8. fix conflicts

    @xysheng-baidu
    xysheng-baidu committed Feb 22, 2023
    Configuration menu
    Copy the full SHA
    c11d340 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2023

  1. Merge branch 'PaddlePaddle:develop' into composite_rule_flatten

    @xysheng-baidu
    xysheng-baidu committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    28af93d View commit details
    Browse the repository at this point in the history

  2. fix syntax issues

    @xysheng-baidu
    xysheng-baidu committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    e09e5f1 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2023

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … composite_rule_flatten
    @xysheng-baidu
    xysheng-baidu committed Feb 24, 2023
    Configuration menu
    Copy the full SHA
    bb4c836 View commit details
    Browse the repository at this point in the history

  2. block flatten on resnet_prim_cinn

    @xysheng-baidu
    xysheng-baidu committed Feb 24, 2023
    Configuration menu
    Copy the full SHA
    70d7453 View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2023

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … layernorm_grad
    @xiaoguoguo626807
    xiaoguoguo626807 committed Feb 27, 2023
    Configuration menu
    Copy the full SHA
    593d1a2 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2023

  1. init change

    @xiaoguoguo626807
    xiaoguoguo626807 committed Feb 28, 2023
    Configuration menu
    Copy the full SHA
    55e9f2a View commit details
    Browse the repository at this point in the history

  2. fix_conflict

    @xiaoguoguo626807
    xiaoguoguo626807 committed Feb 28, 2023
    Configuration menu
    Copy the full SHA
    9697474 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2023

  1. tmp commit

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    3e4e1cf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … layernorm_grad
    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    e4aaa86 View commit details
    Browse the repository at this point in the history

  3. add layer_norm InferMeta check

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    1b4f8a1 View commit details
    Browse the repository at this point in the history

  4. cast type modify

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    3d48002 View commit details
    Browse the repository at this point in the history

  5. [CINN]Enhance CacheKey hash logic by considering input dtypes (Paddle… 

    …Paddle#50557)

* [CINN]Enhance CacheKey hash logic by considering input dtypes

* add unittest

* fix typo

* fix typo

* fix map.at

* fix find

* fix test

* fix cinn cache key structure realize

* using ordered map for attributes

* add test by review advice

---------

Co-authored-by: jiangcheng <thisjiang@qq.com>
    @Aurelius84 @thisjiang @cxxly
    2 people authored and cxxly committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    81fbf68 View commit details
    Browse the repository at this point in the history

  6. [prim] enable dygraph_to_static to support custom_vjp

    @cxxly
    cxxly committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    6f71cd9 View commit details
    Browse the repository at this point in the history

  7. Pr 50885 (#7) 

    * [CINN]Enhance CacheKey hash logic by considering input dtypes (PaddlePaddle#50557)

* [CINN]Enhance CacheKey hash logic by considering input dtypes

* add unittest

* fix typo

* fix typo

* fix map.at

* fix find

* fix test

* fix cinn cache key structure realize

* using ordered map for attributes

* add test by review advice

---------

Co-authored-by: jiangcheng <thisjiang@qq.com>

* [prim] enable dygraph_to_static to support custom_vjp

* fix code in a dy2static-friendly way.

* [dystatic] add hooker for prim

---------

Co-authored-by: Aurelius84 <zhangliujie@baidu.com>
Co-authored-by: jiangcheng <thisjiang@qq.com>
Co-authored-by: cxxly <chenxx_id@163.com>
    @2742195759 @Aurelius84
    @thisjiang @cxxly
    4 people committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    99e7bd8 View commit details
    Browse the repository at this point in the history

  8. [prim] enable dygraph_to_static to support custom_vjp

    @cxxly
    cxxly committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    28f8d74 View commit details
    Browse the repository at this point in the history

  9. fix cast prim and vjp dtype mapping error bug

    @cxxly
    cxxly committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    342abb2 View commit details
    Browse the repository at this point in the history

  10. recover

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    26fc165 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … layernorm_grad
    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    3ad5919 View commit details
    Browse the repository at this point in the history

  12. fix_conflict

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    ef1a424 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2023

  1. big tol

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    120867e View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2023

  1. [CINN]Enhance CacheKey hash logic by considering input dtypes (Paddle… 

    …Paddle#50557)

* [CINN]Enhance CacheKey hash logic by considering input dtypes

* add unittest

* fix typo

* fix typo

* fix map.at

* fix find

* fix test

* fix cinn cache key structure realize

* using ordered map for attributes

* add test by review advice

---------

Co-authored-by: jiangcheng <thisjiang@qq.com>
    @Aurelius84 @thisjiang @cxxly
    2 people authored and cxxly committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    42c64de View commit details
    Browse the repository at this point in the history

  2. [prim] enable dygraph_to_static to support custom_vjp

    @cxxly
    cxxly committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    baa82d4 View commit details
    Browse the repository at this point in the history

  3. Pr 50885 (#7) 

    * [CINN]Enhance CacheKey hash logic by considering input dtypes (PaddlePaddle#50557)

* [CINN]Enhance CacheKey hash logic by considering input dtypes

* add unittest

* fix typo

* fix typo

* fix map.at

* fix find

* fix test

* fix cinn cache key structure realize

* using ordered map for attributes

* add test by review advice

---------

Co-authored-by: jiangcheng <thisjiang@qq.com>

* [prim] enable dygraph_to_static to support custom_vjp

* fix code in a dy2static-friendly way.

* [dystatic] add hooker for prim

---------

Co-authored-by: Aurelius84 <zhangliujie@baidu.com>
Co-authored-by: jiangcheng <thisjiang@qq.com>
Co-authored-by: cxxly <chenxx_id@163.com>
    @2742195759 @Aurelius84
    @thisjiang @cxxly
    4 people committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    9e584bd View commit details
    Browse the repository at this point in the history

  4. [prim] enable dygraph_to_static to support custom_vjp

    @cxxly
    cxxly committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    8d50dd9 View commit details
    Browse the repository at this point in the history

  5. fix cast prim and vjp dtype mapping error bug

    @cxxly
    cxxly committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    80c4ee9 View commit details
    Browse the repository at this point in the history

  6. Cxx prim custom vjp (#8) 

    * [CINN]Enhance CacheKey hash logic by considering input dtypes (PaddlePaddle#50557)

---------

Co-authored-by: jiangcheng <thisjiang@qq.com>

* [prim] enable dygraph_to_static to support custom_vjp

* Pr 50885 (#7)

* [CINN]Enhance CacheKey hash logic by considering input dtypes (PaddlePaddle#50557)

* [CINN]Enhance CacheKey hash logic by considering input dtypes

---------

Co-authored-by: jiangcheng <thisjiang@qq.com>

* [prim] enable dygraph_to_static to support custom_vjp

* fix code in a dy2static-friendly way.

* [dystatic] add hooker for prim

---------

Co-authored-by: Aurelius84 <zhangliujie@baidu.com>
Co-authored-by: jiangcheng <thisjiang@qq.com>
Co-authored-by: cxxly <chenxx_id@163.com>

* [prim] enable dygraph_to_static to support custom_vjp

* fix cast prim and vjp dtype mapping error bug

* [dy2static-ci] fix dy2static ci errors.

---------

Co-authored-by: Aurelius84 <zhangliujie@baidu.com>
Co-authored-by: jiangcheng <thisjiang@qq.com>
Co-authored-by: cxxly <chenxx_id@163.com>
    @2742195759 @Aurelius84
    @thisjiang @cxxly
    4 people committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    d44eb19 View commit details
    Browse the repository at this point in the history

  7. [Prim] enable whitelist and blacklist for custom_vjp

    @cxxly
    cxxly committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    74fd37a View commit details
    Browse the repository at this point in the history

  8. fix_conflict

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    f037d4b View commit details
    Browse the repository at this point in the history

  9. fix_conflict

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    907647d View commit details
    Browse the repository at this point in the history

  10. fix_conflict with 50885

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    ccaa51f View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2023

  1. debug log

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    97066c3 View commit details
    Browse the repository at this point in the history

  2. clear log

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    a5c60a4 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. Merge branch 'develop' into layer_norm_grad

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    1e79731 View commit details
    Browse the repository at this point in the history

  2. fix_conflict

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    3ca656c View commit details
    Browse the repository at this point in the history

  3. fix

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    ccce35a View commit details
    Browse the repository at this point in the history

  4. Merge branch 'layer_norm_grad' of https://github.com/xiaoguoguo626807… 

    …/Paddle into layer_norm_grad
    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    f6e017c View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2023

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … layer_norm_grad
    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    ade18e4 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2023

  1. nothing

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    6f5e584 View commit details
    Browse the repository at this point in the history

  2. conflict

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    18cd8c0 View commit details
    Browse the repository at this point in the history

  3. less memory

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    3b1f6b4 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2023

  1. recover utils

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    abab32b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'layer_norm_grad' of https://github.com/xiaoguoguo626807… 

    …/Paddle into layer_norm_grad
    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    e05dd44 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. conflict

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    2d55f26 View commit details
    Browse the repository at this point in the history

  2. fix

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    c7166ea View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2023

  1. Merge branch 'develop' into layer_norm_grad

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    983931d View commit details
    Browse the repository at this point in the history

  2. modify threshold value

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    00b7f54 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'layer_norm_grad' of https://github.com/xiaoguoguo626807… 

    …/Paddle into layer_norm_grad
    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    b2a16b6 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2023

  1. skip layer_norm for test_bert

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    595c6fd View commit details
    Browse the repository at this point in the history

  2. Merge commit 'refs/pull/51135/head' of https://github.com/PaddlePaddl… 

    …e/Paddle into new_l_n_g
    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    7c968ab View commit details
    Browse the repository at this point in the history

  3. back to bert success state

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    9c1d5f2 View commit details
    Browse the repository at this point in the history

  4. add epsion

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    9065511 View commit details
    Browse the repository at this point in the history

  5. delete unnecessary compute

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    78ec3dc View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2023

  1. modify amp dtype

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 17, 2023
    Configuration menu
    Copy the full SHA
    afbf4d2 View commit details
    Browse the repository at this point in the history

  2. modify * order

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 17, 2023
    Configuration menu
    Copy the full SHA
    9ceb78d View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2023

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … new_l_n_g
    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    dc72787 View commit details
    Browse the repository at this point in the history

  2. delete sqrt check and fp16

    @xiaoguoguo626807
    xiaoguoguo626807 committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    f43e433 View commit details
    Browse the repository at this point in the history