Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DAP/Whisper]Add initial documents for Whisper Preprocessor. #313

Merged
merged 9 commits into from
Jul 15, 2024

Conversation

taiqzheng
Copy link
Contributor

@taiqzheng taiqzheng commented May 24, 2024

Currently, it is in draft form with some remaining work to be completed.
However, it is now capable of being used to build an end-to-end Whisper model.

Work should be done in this PR:

  • Correct format for data
    Theclang-formattool offers different strategies for formatting data. Please check file ExtandDAPPass.cpp in “Files changed”.
  • Add an example
    The example has been designed, but the file location needs to be changed.
  • Correct the relationship with DAP Pass
    Update file locations for the extand-dap pass and also change the operation name.

Future work, not in this PR:

  • Update pass pipeline
    The one-shot-bufferize pass has conflicts with some operations.
  • Update example
    Currently only one case is supported, where its audio data is directly written into the example file. To support more audio cases, we need an audio library to read data from audio files.
  • Extract operators
    Some operators need to be extracted so that they can be reused in other algorithms.
  • Optimize the algorithm
    After extracting the operators, design vectorization pattern for each one.

@taiqzheng taiqzheng marked this pull request as draft May 29, 2024 08:20
@taiqzheng taiqzheng force-pushed the preprocess branch 4 times, most recently from 5d08f61 to e433100 Compare July 1, 2024 14:07
@taiqzheng taiqzheng marked this pull request as ready for review July 2, 2024 03:33
Copy link
Member

@zhanghb97 zhanghb97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@zhanghb97 zhanghb97 merged commit a1a0384 into buddy-compiler:main Jul 15, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants