…27714)

* fleet support non_distributed training in dygraph mode; test=develop

* refine grid_sample and temporal_shift

* Add test_resnet_v2.py test=develop

* add multinomial cpu kernel

* fix C++ notype error

* fix windows ci array len error

* let array len be const

* change array to vector

* add cuda kernrl with num_distribution is 1, and not support replacement=False

* add multinomial python api

* support num_distribution different multinomial distributions

* add categorical class

* fix test_distribution enable_static error

* add unittest for different setting of Categorical

* optimize format

* little change

* little change

* add raise error if shape not match, optimize format

* fix windows CI dtype error in concat

* little changes

* little changes2

* change values type to int64

* change values type to int64

* change values type to int64

* add visualdl callback

* move dygraph amp api to paddle

* refine code and add unit test

* test=develop, update example

…#27654)

* Fix ErrorClipByValue api and demo code of clip_by_value. test=develop

Co-authored-by: tianshuo78520a <707759223@qq.com>

…ops (#27741)

test=develop

* Add avx instructions check

* Small fix

* Change function name

* Change uint to unsigned int

* - condidate fix to issue #25537

test=develop

* - UT for transpose NHWC

test=develop

* Add test skip from cmake

* Remove print

Add Simnet Test for V2 APIs.

We used tool from https://www.paddlepaddle.org.cn/documentation/docs/zh/2.0-beta/guides/migration_cn.html#paddle1-xpaddle2-0beta to do v1.x to v2 transformation.

This PR pulled changes from #27430, please DO NOT merge before #27430 is merged

…sed_embedding_seq_pool. (#27692)

* Polish the error message of fc_op.

* Polish the error message of fused_fc_elementwise_layer_norm op.

* Polish an error message in fused_embedding_seq_pool_op.

* fix huber_loss ans npair_loss doc and example code, test=document_fix

* remove disable_static in example code, test=document_fix

* remove huber_loss and refine npair_loss example code, test=document_fix

* remove huber_loss in functional/__init__.py, test=document_fix

* modify doc for Layer, test=develop

* modify doc for Layer2, test=develop

* set dtype default value to float32, test=develop

* add example code for paddle.nn.Layer, test=develop

* set create_parameter and create_variable dtype default value to None, test=develop

* modify some example code, tet=develop

* refine, test=develop

* del no ues code, test=develop

* modify doc, example code, args, test=develop

* modify doc, test=develop

…tch, test=develop (#27605)

* modify doc for ParameterList and LayerList, test=develop

* add empty line after code-block, test=develop

* fix bilateral bug

* keep summary mode unchange

* add no grad decorator

* reimplement paddle.nn.functional.sigmoid_focal_loss. test=develop

* fix reduction error message. test=develop

* fix exp. test=develop

* reset the shape of logit. test=develop

* delete disable_static in example. test=develop

* Optimize the error message for OPs.

* Optimize the error message for OPs in details.

…v) error message enhancement (#27572)

* API(Compute) error message enhancement on line 44, 50, 53.

* lstm_unit error message enhancement.
lstmp error message enhancement.
sequence_conv error message enhencement.
sequence_enumerate error message enhencement.
sequence_mask error message enhencement.

* Update lstm_unit_op.cc

* Update lstm_unit_op.h

* error msg enhancement.

* Update sequence_conv_op.cc

* Update lstm_unit_op.cc

* Update sequence_conv_op.cc

* Update sequence_enumerate_op.cc

* Update sequence_enumerate_op.cu

* Update sequence_enumerate_op.h

* Update sequence_pool_op.h

* error message enhencement.

* error message enhancement.

test=develop

- compilation fix

test=develop

…paddle.nn.functional.linear (#27759)

Fix cross, cumsum op docs

* fix dynamic parallel for hapi

* fix code style

…st=document_fix (#27679)

* Add api of constant in paddle.nn.initializer

* Add api of constant in paddle.nn.initializer

* Add api of constant in paddle.nn.initializer

* Add api of constant in paddle.nn.initializer

* Add api of constant in paddle.nn.initializer

* Add api of constant in paddle.nn.initializer

* Add api of constant in paddle.nn.initializer

* fix pool3d bug, test=develop

* fix unitest, test=develop

* fix test and fix pool2d bug, test=develop

* disable_fuse_all_reduce

* fix test

* fix ut

* Reimplement paddle.static.nn.fc, mainly change the parameters and English documentation.

* Polish the documentation format.

…27805)

* add matmul doublegrad op

* fix compile errors

* modify code according to review

* delete float16

* replace config by kwargs

* change save path form dir to prefix

* fix failed unittests

* revert unittest name change

* polish en docs

* add more tests for coverage

* Add test attribute in channelwise_quant op, test=develop

Add xpu kernel for KUNLUN core:

* accuracy op
* sign op
* scale op
* sum op

Add default atol in xpu unittest.

* Add double grad in Squeeze and Unsqueeze

* Add double grad in Squeeze and Unsqueeze

* fix model bugs, inputs can be InputSpec instance

* correct error message

* error message optimization in softmax_with_cross_entropy_op

* fix some unsuited comment

* add flattern weight of lstm

* use IndexList to improve performance, test=develop

* remove EIGEN_HAS_INDEX_LIST, test=develop

* use IndexList only when EIGEN_HAS_INDEX_LIST is true

Mutiply allows non-tensor data input

* fix fluid doc

* fix fluid doc

* fix fluid doc, test=document_fix

* fix fluid doc, test=document_fix

* refine parameters order && doc

* update rmsprop doc

* refine adam/transpose/unstack/stride_slice

* fix bug && doc

* fix doc

* bug fix

* bug fix

* fix doc

* fix doc

* fix doc

* fix doc

* depercate old strided_slice

* update doc

* set default value for name

* update doc

* add load_op_xpu for Baidu Kunlun, test=kunlun

* add is_compiled_with_xpu for unit test, test=kunlun

* add is_compiled_with_xpu for unit test, test=kunlun

…ad (#27814)

test=develop

As the title

* mig deformable_conv to deform_conv2d

* polish Return doc of DataLoader. test=develop

* add info log for trt input dynamic shape check

* fix error msg error

* refine fleetrun.ps_launch

* update fleet run for multi device support

* ps_graph support ps-gpu

* fix heter save

* add heter save unittest

* fix unittest & simple code

* update fleetrun

* fix fleetrun

* fix launch barrier

* fix role maker

* add paddlecloud rolemaker unittest

* rename heter_worker_device_guard

* remove test_lac predictor run case