Add support for LeakyReLU and Split in ModelSpeedup?

[YuyaKobayashi]

What would you like to be added:
Could you add support for LeakyReLU and aten::split in ModelSpeedup.

Why is this needed:
I tried to prune yolov4 but failed with an error RuntimeError: Has not supported infering output shape from input shape for.
I think supporting these node is useful since they are ubiquitous.

Without this feature, how does current nni work：
Show error as above.

Components that may involve changes:
ModelSpeedup

Brief description of your proposal if any:

[QuanluZhang]

@YuyaKobayashi thanks for reporting your issue. We will support these ops soon. Also we will refactor the implementation to make users easily add the support of new ops. We highly encourage users to contribute new ops :)

[YuyaKobayashi]

Thank you

[hxri]

@YuyaKobayashi thanks for reporting your issue. We will support these ops soon. Also we will refactor the implementation to make users easily add the support of new ops. We highly encourage users to contribute new ops :)

Hi there!

Can I work on this?

[zheng-ningxin]

@hxri
If you are using nn.module's leaky_relu, we have already supported it, but we have not yet supported nn.functional's leaky_relu, you are welcome to contribute code

[scarlett2018]

@hxri @zheng-ningxin - has this issue been supported in previous releases?

[zheng-ningxin]

#4996
It should work when this PR is merged. Thanks

[Lijiaoa]

hi, @hxri You could use nni v2.9 to test it. It will be released soon. Please reopen or new an issue if you have any problem.

[scarlett2018]

hi, @hxri You could use nni v2.9 to test it. It will be released soon. Please reopen or new an issue if you have any problem.

thanks for the follow up, I'm closing as fixed downstream.