Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added python and c++ alignment code #5346

Merged
merged 10 commits into from
Nov 15, 2022
Merged

added python and c++ alignment code #5346

merged 10 commits into from
Nov 15, 2022

Conversation

yzhang123
Copy link
Contributor

Signed-off-by: Yang Zhang yangzhang@nvidia.com

What does this PR do ?

provides both python and c++ alignment

Collection: tools

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
@yzhang123 yzhang123 requested a review from ekmb November 8, 2022 00:20
Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
@lgtm-com
Copy link

lgtm-com bot commented Nov 8, 2022

This pull request introduces 2 alerts when merging b0adc4d into d37db88 - view on LGTM.com

new alerts:

  • 2 for Unused import

Copy link
Collaborator

@ekmb ekmb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is great, thank you!
How about adding these scripts to a separate folder?
Could add a README with the requirements?

tools/text_processing_deployment/alignment.py Outdated Show resolved Hide resolved
tools/text_processing_deployment/alignment.py Outdated Show resolved Hide resolved
tools/text_processing_deployment/alignment.py Outdated Show resolved Hide resolved
tools/text_processing_deployment/alignment.cpp Outdated Show resolved Hide resolved
tools/text_processing_deployment/alignment.py Outdated Show resolved Hide resolved
tools/text_processing_deployment/alignment.py Outdated Show resolved Hide resolved
tools/text_processing_deployment/alignment.py Outdated Show resolved Hide resolved
tools/text_processing_deployment/alignment.py Outdated Show resolved Hide resolved
@anand-nv
Copy link
Collaborator

anand-nv commented Nov 8, 2022

cerr << "Unexpected format: State has multiple outgoing arcs" << endl;

Assuming that the FST is deterministic and shortest path is considered, will there be multiple outgoing arcs?

@yzhang123
Copy link
Contributor Author

cerr << "Unexpected format: State has multiple outgoing arcs" << endl;

Assuming that the FST is deterministic and shortest path is considered, will there be multiple outgoing arcs?

i don't think so

yzhang123 and others added 2 commits November 11, 2022 09:04
Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
@yzhang123 yzhang123 requested a review from ekmb November 11, 2022 17:04
@ekmb ekmb merged commit dd20381 into main Nov 15, 2022
@ekmb ekmb deleted the text_processing_alignment branch November 15, 2022 17:42
hainan-xv pushed a commit to hainan-xv/NeMo that referenced this pull request Nov 29, 2022
* added python and c++ alignment code

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* update

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* update

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* moved files

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Hainan Xu <hainanx@nvidia.com>
hainan-xv pushed a commit to hainan-xv/NeMo that referenced this pull request Nov 29, 2022
* added python and c++ alignment code

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* update

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* update

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* moved files

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Hainan Xu <hainanx@nvidia.com>
JimmyZhang12 pushed a commit to JimmyZhang12/NeMo that referenced this pull request Dec 14, 2022
* added python and c++ alignment code

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* update

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* update

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* moved files

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
andrusenkoau pushed a commit to andrusenkoau/NeMo that referenced this pull request Jan 5, 2023
* added python and c++ alignment code

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* update

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* update

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* moved files

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: andrusenkoau <andrusenkoau@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants