Connectionist Temporal Classification example #32

trungnt13 · 2015-11-09T19:30:29Z

I found these lines in array_grad.py

# Edit Distance has no gradient (but can be used to eval seq2seq or CTC).
ops.NoGradient("EditDistance")

Is there any implementation of CTC cost function in tensorflow, or any example concern CTC ?

ebrevdo · 2015-11-09T21:39:28Z

Thank you for inquiring. We are working on an implementation. It will be released if/when we are happy with its performance, API, and documentation.

mschonwe · 2015-11-10T00:54:46Z

Here's another request for a CTC layer / objective. I'm working on speech modeling, and CTC is pretty much essential to this.

kdavis-mozilla · 2015-11-10T06:30:34Z

Here here, I'm working on speech modeling too. A CTC implementation will help my effort greatly.

ebrevdo · 2015-12-08T00:27:26Z

Just an update on timelines: we're getting closer but it won't happen before January sometime at the earliest.

ekelsen · 2016-01-14T18:29:41Z

Baidu has just released a fast open source implementation of CTC for CPUs and GPUs.
https://github.com/baidu-research/warp-ctc

It has a very simple C interface and it should hopefully be fairly easy to create Tensorflow bindings (we're happy to help). The release includes Torch bindings.

tjacobs · 2016-01-15T11:10:56Z

China is out silicon valleying silicon valley!

qingzew · 2016-01-15T14:41:11Z

what's the timeline now @ebrevdo

ebrevdo · 2016-01-15T17:34:47Z

We're closer. Still cleaning up code for release.
On Jan 15, 2016 6:41 AM, "qingzew" notifications@github.com wrote:

what's the timeline now @ebrevdo https://github.com/ebrevdo

—
Reply to this email directly or view it on GitHub
#32 (comment)
.

drdozer · 2016-01-22T16:57:04Z

Hi Ebrevdo,

A CTC implementation would be really useful to me for some genome analysis tasks that are handled poorly by HMM approaches.

Matthew

raindeer · 2016-02-03T13:57:15Z

@ebrevdo any progress? :)

bmilde · 2016-02-22T13:34:26Z

Also highly interested in this and I hope that you can release your implementation soon! @ebrevdo

ebrevdo · 2016-02-24T01:07:38Z

Coming very soon (I hope).
On Feb 22, 2016 5:34 AM, "bmilde" notifications@github.com wrote:

Also highly interested in this and I hope that you can release your
implementation soon! @ebrevdo https://github.com/ebrevdo

—
Reply to this email directly or view it on GitHub
#32 (comment)
.

ebrevdo · 2016-02-26T19:11:58Z

The CTC loss and two decoders (greedy & beam search for CTC) should be in the next push.

ebrevdo · 2016-02-26T19:13:01Z

(it'll be accessible via tf.contrib.ctc.ctc_loss etc.)

kdavis-mozilla · 2016-02-26T20:31:10Z

Awesome!

aidangomez · 2016-02-26T20:49:14Z

Very Awesome

Duum · 2016-02-27T10:23:50Z

very very awesome!

vrv · 2016-02-29T17:22:04Z

8509f88

ctc_loss and friends is now part of contrib directory -- once it matures and we fix any issues, we'll add it to the core.

Added a verbosity control option

Update CROSSTOOL_hipcc.tpl to support ROCm 1.8

Add use_explicit_batch parameter available in OpConverterParams and other places Formatting and make const bool everywhere Enable use_explicit_batch for TRT 6.0 Revise validation checks to account for use_explicit_batch. Propagate flag to ConversionParams and TRTEngineOp Rename use_explicit_batch/use_implicit_batch Formatting Add simple activtion test for testing dynamic input shapes. Second test with None dims is disabled Update ConvertAxis to account for use_implicit batch fix use of use_implicit_batch (tensorflow#7) * fix use of use_implicit_batch * change order of parameters in ConvertAxis function fix build (tensorflow#8) Update converters for ResNet50 (except Binary ops) (tensorflow#9) * Update RN50 converters for use_implicit_batch: Conv2D, BiasAdd, Transpose, MaxPool, Squeeze, MatMul, Pad * Fix compilation errors * Fix tests Use TRT6 API's for dynamic shape (tensorflow#11) * adding changes for addnetworkv2 * add plugin utils header file in build * optimization profile api added * fix optimization profile * TRT 6.0 api changes + clang format * Return valid errors in trt_engine_op * add/fix comments * Changes to make sure activation test passes with TRT trunk * use HasStaticShape API, add new line at EOF Allow opt profiles to be set via env variables temporarily. Undo accidental change fix segfault by properly returning the status from OverwriteStaticDims function Update GetTrtBroadcastShapes for use_implicit_batch (tensorflow#14) * Update GetTrtBroadcastShapes for use_implicit_batch * Formatting Update activation test Fix merge errors Update converter for reshape (tensorflow#17) Allow INT32 for elementwise (tensorflow#18) Add Shape op (tensorflow#19) * Add Shape op * Add #if guards for Shape. Fix formatting Support dynamic shapes for strided slice (tensorflow#20) Support dynamic shapes for strided slice Support const scalars + Pack on constants (tensorflow#21) Support const scalars and pack with constants in TRT6 Fixes/improvements for BERT (tensorflow#22) * Support shrink_axis_mask for StridedSlice * Use a pointer for final_shape arg in ConvertStridedSliceHelper. Use final_shape for unpack/unstack * Support BatchMatMulV2. * Remove TODO and update comments * Remove unused include * Update Gather for TRT 6 * Update BatchMatMul for TRT6 - may need more changes * Update StridedSlice shrink_axis for TRT6 * Fix bugs with ConvertAxis, StridedSlice shrink_axis, Gather * Fix FC and broadcast * Compile issue and matmul fix * Use nullptr for empty weights * Update Slice * Fix matmul for TRT6 * Use enqueueV2. Don't limit to 1 input per engine Change INetworkConfig to IBuilderConfig Allow expand dims to work on dynamic inputs by slicing shape. Catch problems with DepthwiseConv. Don't try to verify dynamic shapes in CheckValidSize (tensorflow#24) Update CombinedNMS converter (tensorflow#23) * Support CombinedNMS in non implicit batch mode. The squeeze will not work if multiple dimensions are unknown * Fix compile error and formatting Support squeeze when input dims are unknown Support an additional case of StridedSlice where some dims aren't known Use new API for createNetworkV2 Fix flag type for createNetworkV2 Use tensor inputs for strided slice Allow squeeze to work on -1 dims Add TRT6 checks to new API spliting ConvertGraphDefToEngine (tensorflow#29) * spliting ConvertGraphDefToEngine into ConvertGraphDefToNetwork and BuildEngineFromNetwork * some compiler error * fix format Squeeze Helper function (tensorflow#31) * Add squeeze helper * Fix compile issues * Use squeeze helper for CombinedNMS Update Split & Unpack for dynamic shapes (tensorflow#32) * Update Unpack for dynamic shapes * Fix compilation error Temporary hack to fix bug in config while finding TRT library Fix errors from rebasing Remove GatherV2 limitations for TRT6 Fix BiasAdd elementwise for NCHW case with explicit batch mode (tensorflow#34) Update TRT6 headers, Make tests compile (tensorflow#35) * Change header files for TRT6 in configure script * Fix bug with size of scalars. Use implicit batch mode based on the converter flag when creating network * Fix compilation of tests and Broadcast tests Properly fix biasadd nchw (tensorflow#36) Revert tensorflow#29 to fix weight corruption (tensorflow#37) * Revert tensorflow#29 to fix weight corruption * Revert change in test Fix bug with converters and get all tests passing for TRT6 (tensorflow#39) Update DepthToSpace and SpaceToTest for TRT6 + dynamic shapes (tensorflow#40) Add new C++ tests for TRT6 converters (tensorflow#41) * Remove third shuffle layer since bug with transpose was fixed * Add new tests for TRT6 features * Update TRT6 headers list Fix compilation errors Remove bazel_build.sh Enable quantization mnist test back Disabled by mistake I believe Remove undesirable changes in quantization_mnist_test Add code back that was missed during rebase Fix bug: change "type" to type_key

…pt-target Remove extra target.lst file and add the targets in Dockerfile

added stubbed add operator

* Added readme to build Intel-tensorflow container * Fix * Fix * Format fix * Format fix * format fix * Changed tag and added instructions for avx

girving assigned ebrevdo Dec 7, 2015

vrv closed this as completed Feb 29, 2016

ilblackdragon added a commit to ilblackdragon/tensorflow that referenced this issue Mar 9, 2016

Merge pull request tensorflow#32 from ivallesp/master

7d03b9e

Added a verbosity control option

zhanglix mentioned this issue Apr 8, 2016

python cifar10_eval.py hang forever sometimes #1819

Closed

wangyongliang mentioned this issue Apr 27, 2016

core dump when import tensorflow #2129

Closed

Hibbert-pku mentioned this issue Apr 28, 2016

CTC GPU support #2146

Closed

psnegi mentioned this issue Jul 20, 2016

CUDA_ERROR_ILLEGAL_ADDRESS on GTX 1080 #3422

Closed

bluezone2015 mentioned this issue Mar 8, 2017

import tensorflow Segmentation fault (core dumped) #8197

Closed

zhangdingfei mentioned this issue Jun 21, 2017

tensorflow-1.2.0 import tensorflow Segmentation fault #10870

Closed

whchung referenced this issue in ROCm/tensorflow-upstream Apr 10, 2018

Merge pull request #32 from ROCmSoftwarePlatform/rocm18-fixes-1

1005b34

Update CROSSTOOL_hipcc.tpl to support ROCm 1.8

sanket-kamthe mentioned this issue May 8, 2018

Linalg.LinearOperators do not give any performance improvement #19145

Closed

Anukkavishka mentioned this issue Jul 4, 2018

E1101:Module 'tensorflow.tools.api.generator.api.contrib' has no 'lite' member even though i'm using version 1.8.0 #20169

Closed

ychen404 mentioned this issue Aug 19, 2018

Not able to port a 6-layered mobilenet tflite model to mobile #21368

Closed

chenjiasheng mentioned this issue Dec 12, 2018

Distributed Training Randomly Stops During the Training Process #12667

Closed

lorenzoriano mentioned this issue Jan 11, 2019

BUS Error, likely with blas #24844

Closed

dkashkin mentioned this issue Apr 25, 2019

TFLite Interpreter fails to load quantized model on Android (stock ssd_mobilenet_v2) #28163

Closed

amilsted mentioned this issue May 22, 2019

Optimize transpose ops #28933

Closed

chengdianxuezi mentioned this issue Nov 1, 2019

Bug: tensorflow-gpu takes long time before beginning to compute #18652

Closed

yanceyblog mentioned this issue Nov 28, 2019

armeabi-v7a libtensorflowlite_jni.so：signal 7 (SIGBUS), code 1 (BUS_ADRALN), fault addr 0xeef5445f #34669

Closed

cjolivier01 pushed a commit to Cerebras/tensorflow that referenced this issue Dec 6, 2019

Merge pull request tensorflow#32 from ROCmSoftwarePlatform/build-scri…

73b2006

…pt-target Remove extra target.lst file and add the targets in Dockerfile

1vash mentioned this issue Mar 19, 2020

UnknownError: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. #37725

Closed

liuyibox mentioned this issue Jul 2, 2020

tf.estimator.predict cannot run consecutively on Colab TPU #41014

Closed

keithm-xmos added a commit to xmos/tensorflow that referenced this issue Feb 1, 2021

Merge pull request tensorflow#32 from xmos/feature/add_operator

a001a05

added stubbed add operator

dinkdeep mentioned this issue Apr 7, 2021

Segmentation fault in tf-opt while running a tf dialect mlir file #48365

Open

rsanthanam-amd mentioned this issue Jul 1, 2021

[ROCm] This change replaces the original assert for detecting multiple #49232

Closed

elfringham mentioned this issue Nov 24, 2021

Unit test //tensorflow/compiler/xla/tests:xla_hlo_profile_test_cpu gives illegal instruction on AARCH64 #53189

Closed

ashahba pushed a commit to ashahba/tensorflow that referenced this issue Jan 20, 2022

Shwetaoj/container build readme (tensorflow#32)

82e62ab

* Added readme to build Intel-tensorflow container * Fix * Fix * Format fix * Format fix * format fix * Changed tag and added instructions for avx

spacycoder mentioned this issue Dec 11, 2023

Why does my full integer quantized tflite model crash when loaded? #62618

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Connectionist Temporal Classification example #32

Connectionist Temporal Classification example #32

trungnt13 commented Nov 9, 2015

ebrevdo commented Nov 9, 2015

mschonwe commented Nov 10, 2015

kdavis-mozilla commented Nov 10, 2015

ebrevdo commented Dec 8, 2015

ekelsen commented Jan 14, 2016

tjacobs commented Jan 15, 2016

qingzew commented Jan 15, 2016

ebrevdo commented Jan 15, 2016

drdozer commented Jan 22, 2016

raindeer commented Feb 3, 2016

bmilde commented Feb 22, 2016

ebrevdo commented Feb 24, 2016

ebrevdo commented Feb 26, 2016

ebrevdo commented Feb 26, 2016

kdavis-mozilla commented Feb 26, 2016

aidangomez commented Feb 26, 2016

Duum commented Feb 27, 2016

vrv commented Feb 29, 2016

Connectionist Temporal Classification example #32

Connectionist Temporal Classification example #32

Comments

trungnt13 commented Nov 9, 2015

ebrevdo commented Nov 9, 2015

mschonwe commented Nov 10, 2015

kdavis-mozilla commented Nov 10, 2015

ebrevdo commented Dec 8, 2015

ekelsen commented Jan 14, 2016

tjacobs commented Jan 15, 2016

qingzew commented Jan 15, 2016

ebrevdo commented Jan 15, 2016

drdozer commented Jan 22, 2016

raindeer commented Feb 3, 2016

bmilde commented Feb 22, 2016

ebrevdo commented Feb 24, 2016

ebrevdo commented Feb 26, 2016

ebrevdo commented Feb 26, 2016

kdavis-mozilla commented Feb 26, 2016

aidangomez commented Feb 26, 2016

Duum commented Feb 27, 2016

vrv commented Feb 29, 2016