Feature Addition: PRelu Module

[Arjun31415]

Addtion of PRelu Activation Layer

Checklist

• Confirmed that run-checks all script has been executed.
• Made sure the book is up to date with changes in this PR.

Related Issues/PRs

Provide links to relevant issues and dependent PRs.

Changes

Summarize the problem being addressed and your solution.

Testing

• Tested on 2D data
• tested for positive, negative and 0 as weight param
• tested forward pass

[Arjun31415]

Adding docs to the book is pending.
Tests are also missing

[codecov]

Codecov Report

Attention: Patch coverage is 91.03448% with 13 lines in your changes are missing coverage. Please review.

Project coverage is 84.51%. Comparing base (bff4961) to head (c24c94f).
Report is 3 commits behind head on main.

Files	Patch %	Lines
crates/burn-core/src/nn/prelu.rs	0.00%	13 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1328      +/-   ##
==========================================
+ Coverage   78.87%   84.51%   +5.64%     
==========================================
  Files         555      583      +28     
  Lines       62176    64908    +2732     
==========================================
+ Hits        49040    54858    +5818     
+ Misses      13136    10050    -3086     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[Arjun31415]

I believe I'm doing the reshape and broadcast wrongly also. Need to check that too.
Edit: Fixed

[antimora]

Just a quick note. Can we also update the burn-books in these sections with your new activation function and module?

1. https://burn.dev/book/building-blocks/tensor.html#activation-functions
2. https://burn.dev/book/building-blocks/module.html#built-in-modules

[Arjun31415]

Sure I will add the book section If my implementation is correct

[Arjun31415]

I think I resolved all the merge conflicts now

[nathanielsimard]

Good job, that's a nice addition, I have some comments, but I don't think they are going to be hard to resolve.

[Arjun31415]

I don't understand how the coverage is decreasing for test function
https://app.codecov.io/gh/tracel-ai/burn/pull/1328/blob/crates/burn-tensor/src/tests/activation/prelu.rs.

Do I need to add tests for prelu layer in burn-core crate?

[antimora]

I don't understand how the coverage is decreasing for test function https://app.codecov.io/gh/tracel-ai/burn/pull/1328/blob/crates/burn-tensor/src/tests/activation/prelu.rs

@Arjun31415 , Missing #[test] above the function?

[Arjun31415]

I don't understand how the coverage is decreasing for test function https://app.codecov.io/gh/tracel-ai/burn/pull/1328/blob/crates/burn-tensor/src/tests/activation/prelu.rs

@Arjun31415 , Missing #[test] above the function?

yeah that was silly of me

[Arjun31415]

Just a quick note. Can we also update the burn-books in these sections with your new activation function and module?

1. https://burn.dev/book/building-blocks/tensor.html#activation-functions

2. https://burn.dev/book/building-blocks/module.html#built-in-modules

Added docs

[antimora]

LGTM from my end. Just take care of Nathaniel's comments.

[Arjun31415]

@nathanielsimard please check. I have made the changes as requested