Split to sentences implementation

[maxkoryukov]

Hello!

This PR contains the implementation of Sentence Buffer: Split

Usage:

./ccextractor -sbs ~/source.ts

Currently, it works only with sub->type == CC_BITMAP. Implementation details - in comments to the PR.

Long example

New output

1
00:00:00,001 --> 00:00:00,189
Oleon costs.

2
00:00:00,191 --> 00:00:00,783
buried in the annex, 95 Oleon costs.

3
00:00:00,785 --> 00:00:05,159
Didn't want to acknowledge the pressures on hospitals, schools and infrastructure.

Old output

1
00:00:00,001 --> 00:00:00,000
Oleon

2
00:00:00,001 --> 00:00:00,189
Oleon costs.

3
00:00:00,190 --> 00:00:00,889
buried in the annex, 95 Oleon costs.
Didn't

4
00:00:00,890 --> 00:00:01,129
buried in the annex, 95 Oleon costs.
Didn't want

5
00:00:01,130 --> 00:00:01,359
buried in the annex, 95 Oleon costs.
Didn't want to

6
00:00:01,360 --> 00:00:02,059
buried in the annex, 95 Oleon costs.
Didn't want to acknowledge

7
00:00:02,060 --> 00:00:02,299
buried in the annex, 95 Oleon costs.
Didn't want to acknowledge the

8
00:00:02,300 --> 00:00:03,419
Didn't want to acknowledge the
pressures

9
00:00:03,420 --> 00:00:03,609
Didn't want to acknowledge the
pressures on

10
00:00:03,610 --> 00:00:04,029
Didn't want to acknowledge the
pressures on hospitals,

11
00:00:04,030 --> 00:00:04,779
Didn't want to acknowledge the
pressures on hospitals, schools

12
00:00:04,780 --> 00:00:05,019
Didn't want to acknowledge the
pressures on hospitals, schools and

13
00:00:05,020 --> 00:00:05,159
pressures on hospitals, schools and
infrastructure.

[maxkoryukov]

fix maxkoryukov#1

[maxkoryukov]

There is a lot of changes lines. BUT, the most changes - deleted symbol. Just ignore whitespaces here:

https://github.com/CCExtractor/ccextractor/pull/491/files?w=1

[maxkoryukov]

This is the most important point in this PR.

SBS works as transformation filter. It takes incoming subs, and convert them to other subs with sub->type = CC_TEXT. This transformation occurred before all other encoders, so other encoders remain unchanged.

[maxkoryukov]

This is just a helper for debugging. You could remove this file, and all references to LOG_DEBUG... But they are useful for debugging (with existing tests)

[maxkoryukov]

The new tests folder contains unit-tests for SBS. They are written with libcheck

There is README.md, with short how-to instructions.

[maxkoryukov]

@cfsmp3, @canihavesomecoffee , is there a chance to merge this to the upstream?

[cfsmp3]

Not for 0.83 (which will be released today). Could happen for 0.84. Note though that most likely you PR won't merge now since there's been many changes, so you may need to resubmit.

…

On Wed, Dec 14, 2016 at 5:38 AM, Maksim Koryukov ***@***.***> wrote: @cfsmp3 <https://github.com/cfsmp3>, @canihavesomecoffee <https://github.com/canihavesomecoffee> , is there a chance to merge this to the upstream? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#491 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AFrJ2WREdhE7S6PrKxbnn3RFVqZW663yks5rH_FQgaJpZM4LHmbu> .