Skip to content

Conversation

mattdangerw
Copy link
Member

No description provided.

@mattdangerw mattdangerw requested a review from hertschuh April 4, 2022 23:41
Copy link
Contributor

@hertschuh hertschuh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch, thanks!

@mattdangerw mattdangerw merged commit 61ecffb into keras-team:master Apr 5, 2022
adhadse pushed a commit to adhadse/keras-nlp that referenced this pull request Sep 17, 2022
mattdangerw added a commit that referenced this pull request May 21, 2024
* Add a response_mask input

* Improved attention logic to account for response mask (#87)

* Improved attention logic to account for response mask

* Addressed several comments

* remove vit_num_classes arg from pali_gemma_backbone

* fix backbone test

* Try simplifying the masking code

* Updated tests for thoroughness

* Comments and one fix

* update preset version

* deleted test using unused code path

* Added cast to solve bool issues

* update presets path

* code reformat#	modified:   keras_nlp/src/models/pali_gemma/pali_gemma_decoder_block_test.py

* remove changes to backbone args

---------

Co-authored-by: divyashreepathihalli <divyashreepathihalli@gmail.com>
Co-authored-by: Matt Watson <mattdangerw@gmail.com>

---------

Co-authored-by: Varun Singh <VarunS1997@users.noreply.github.com>
Co-authored-by: divyashreepathihalli <divyashreepathihalli@gmail.com>
mattdangerw added a commit that referenced this pull request May 21, 2024
* Add a response_mask input

* Improved attention logic to account for response mask (#87)

* Improved attention logic to account for response mask

* Addressed several comments

* remove vit_num_classes arg from pali_gemma_backbone

* fix backbone test

* Try simplifying the masking code

* Updated tests for thoroughness

* Comments and one fix

* update preset version

* deleted test using unused code path

* Added cast to solve bool issues

* update presets path

* code reformat#	modified:   keras_nlp/src/models/pali_gemma/pali_gemma_decoder_block_test.py

* remove changes to backbone args

---------

Co-authored-by: divyashreepathihalli <divyashreepathihalli@gmail.com>
Co-authored-by: Matt Watson <mattdangerw@gmail.com>

---------

Co-authored-by: Varun Singh <VarunS1997@users.noreply.github.com>
Co-authored-by: divyashreepathihalli <divyashreepathihalli@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants