JCodec main repo
Java
zhuker and svitvitskiy Prepare code for STJS - Part VI (#338)
* micro fixes to prepare code for stjs

* Assert - no method overloads

* no same method/field names

* use Preconditions instead of Assert

* Circular Deps: WebpDemuxer - JCodecUtil

* use Preconditions instead of Assert

* CD: EsdsBox - AACUtils

* CD: JpegToThumb4x4 - JpegDecoder - JpegToThumb2x2

* CD: MPEGDecoder - Mpeg2Thumb4x4 - Mpeg2Thumb2x2

* CD: ProresToThumb2x2 - ProresToThumb - ProresDecoder - ProresToThumb4x4

* CD: DPXReader - DPXMetadata

* single constuctor per class

* CD: MetaBox - KeysBox - UdtaBox - BoxFactory - DefaultBoxes - UdtaMetaBox

* Flag single constructor

* AWTUtil method overloads

* dont use java.nio.charset.Charset

* use Platform.deleteFile()

* MXFCodec enum to class

* converted Codec and Format from enum to class

* MXFCodec single constructor

* Platform.arrayEquals

* UL.newULFromInts

* ArrayUtil.printMatrixBytes

* MPEGES.frame()

* TrackFragmentHeaderBox.createTrackFragmentHeaderBox -> tfhd

* NIOUtils.fetchAllFromChannel

* moved intializers to constructor

* initializers to constructors

* Platform.stdin()

* initializers to constructors

* CD: MPEG4Decoder - MPEG4Bitstream - MPEG4DecodingContext

* CD: IListBox - MetaBox - UdtaBox - DefaultBoxes - BoxFactory - UdtaMetaBox

* no varargs

* Long.toHexString

* mpeg4 descriptor parser

* minimize reflection usage

* Platform.toJSON

* use Platform to/from String/bytes

* Long.toHexString

* InterModeInfo.readInter

* removed unused methods

* use Platform.newInstance instead of custom constructor calling

* Platform.invokeStaticMethod

* double catch blocks not supported in javascript

* usage before definition not supported in stjs

* vpx.Macroblock -> VPXMacroblock

* restored performance testdata

* performance tweaks - static methods

* compile fix

* pass testcases

* removed PriorityFuture

* PerformanceTest

* Platform.isAssignableFrom

* NIOUtils.combineBuffers

* uniform testcase names

* Platform.stringFromBytes

* Format.name

* Platform.unsignedInt

* Tuple.triple

* Platform.deleteFile

* removed Platform.getResource

* DecoderConfig -> AACDecoderConfig

* JpegDecoder static methods

* more statics

* Mp3DecoderTest assertEpsilonEquals

* more statics

* use jcodec png decoder in testcases

* png encoder/decoder optimizations

* IntDCT.CONST_BITS define before usage

* non-test method name start with _test

* verbose Asserts

* AWTUtil.decodePNG

* stricter PNGDecoderTest

* DctTest static test arrays

* H264Utils.searchEscapeLocations workaround js bitshift arithmetic

* use jcodec png encoder to write test pngs

* ResamplerTest doesnt use awt

* StringBuilder.append(char)

* removed all varargs

* use Preconditions instead of Assert in main code

* long bit shift

* Platform.stringFromChars

* Platform.arrayComponentType

* Platform.isAssignableFrom

* @Test(expected = ...Exception.class)

* Codec enum

* dont use String.format

* disabled non-tests

* Integer.MIN_VALUE

* ToJSON doesnt append extra comma

* self

* lanczos

* no awt png read

* better test cases

* quick fix
Latest commit 82cdc2e Mar 15, 2018

README.md

jcodec - a pure java implementation of video/audio codecs.

About

JCodec is a library implementing a set of popular video and audio codecs. Currently JCodec supports:

  • Video codecs

    • H.264 main profile decoder;
    • H.264 baseline profile encoder;
    • VP8 decoder (I frames only);
    • VP8 encoder (I frames only);
    • MPEG 1/2 decoder ( I/P/B frames, interlace );
    • Apple ProRes decoder/encoder;
    • JPEG decoder;
    • PNG decoder/encoder.
    • DivX/Xvid
  • Audio codecs

    • SMPTE 302M decoder;
    • AAC decoder (JAAD)
    • RAW PCM.
  • Formats:

    • MP4 ( MOV ) demuxer / muxer;
    • MKV ( Matroska ) demuxer / muxer;
    • MPEG PS demuxer;
    • MPEG TS demuxer;
    • WAV demuxer/muxer;
    • MPEG Audio (MP3) demuxer;
    • ADTS demuxer.
    • DPX parser

JCodec is free software distributed under FreeBSD License.

Future development

Those are just some of the things JCodec dev team is planning to work on:

  • Video
    • Improve H.264 encoder: CABAC, rate control;
    • Performance optimize H.264 decoder.
  • Audio
    • MP3 decoder;
    • AAC encoder.

Getting started

JCodec can be used in both standard Java and Android. It contains platform-agnostic java classes. To use the latest version of JCodec add the maven dependency as below:

<dependency>
    <groupId>org.jcodec</groupId>
    <artifactId>jcodec</artifactId>
    <version>0.2.3</version>
</dependency>

OR gradle dependency as below:

dependencies {
    ...
    compile 'org.jcodec:jcodec:0.2.3'
    ...
}

Additionally if you want to use JCodec with AWT images (BufferedImage) add this maven dependency:

<dependency>
    <groupId>org.jcodec</groupId>
    <artifactId>jcodec</artifactId>
    <version>0.2.3</version>
</dependency>
<dependency>
    <groupId>org.jcodec</groupId>
    <artifactId>jcodec-javase</artifactId>
    <version>0.2.3</version>
</dependency>

OR if you want to use JCodec with Android images (Bitmap) add this gradle dependency:

android {
    configurations.all {
        resolutionStrategy.force 'com.google.code.findbugs:jsr305:3.0.2'
    }
}
dependencies {
    ...
    compile 'org.jcodec:jcodec:0.2.3'
    compile 'org.jcodec:jcodec-android:0.2.3'
    ...
}

For the latest and greatest (the 0.2.3-SNAPSHOT) clone this Git project and build locally like so:

git clone https://github.com/jcodec/jcodec.git
cd jcodec
mvn clean install
(cd javase; mvn clean install)
(cd android; mvn clean install)

If you JUST need the jars, download them from here:

There is virtually no documentation right now but the plan is to catch up on this so stay tuned. stackoverflow.com contains quite a bit information at this point.

Also check the 'samples' subfolder. It's a maven project, and it contains some code samples for the popular use-cases:

Performance / quality considerations

Because JCodec is a pure Java implementation please adjust your performance expectations accordingly. We usually make the best effort to write efficient code but despite this the decoding will typically be an order of magnitude slower than the native implementations (such as FFMpeg). We are currently looking into implementing performance-critical parts in OpenCL (or RenderScript for Android) but the ETA is unknown.

Expect the encoded quality/bitrate for h.264 (AVC) to be so much worse compared to the well known native encoders (such as x264). This is because very little work has been put so far into developing the encoder and also because encoders usually trade speed for quality, speed is something we don't have in Java, hence the quality. Again we may potentially fix that in the future by introducing OpenCL (RenderScript) code but at this point it's an unknown.

That said the decode quality should be at the industry level. This is because the decoding process is usually specified by the standard and the correct decoder implementations are expected to produce bit-exact outputs.

Sample code

Getting a single frame from a movie ( supports only AVC, H.264 in MP4, ISO BMF, Quicktime container ):

int frameNumber = 42;
Picture picture = FrameGrab.getFrameFromFile(new File("video.mp4"), frameNumber);

//for JDK (jcodec-javase)
BufferedImage bufferedImage = AWTUtil.toBufferedImage(picture);
ImageIO.write(bufferedImage, "png", new File("frame42.png"));

//for Android (jcodec-android)
Bitmap bitmap = AndroidUtil.toBitmap(picture);
bitmap.compress(Bitmap.CompressFormat.PNG, 100, new FileOutputStream("frame42.png")); 

Get all frames from a video file

File file = new File("video.mp4");
FrameGrab grab = FrameGrab.createFrameGrab(NIOUtils.readableChannel(file));
Picture picture;
while (null != (picture = grab.getNativeFrame())) {
    System.out.println(picture.getWidth() + "x" + picture.getHeight() + " " + picture.getColor());
}

Getting a sequence of frames from a movie ( supports only AVC, H.264 in MP4, ISO BMF, Quicktime container ):

double startSec = 51.632;
int frameCount = 10;
File file = new File("video.mp4");

FrameGrab grab = FrameGrab.createFrameGrab(NIOUtils.readableChannel(file));
grab.seekToSecondPrecise(startSec);

for (int i=0;i<frameCount;i++) {
    Picture picture = grab.getNativeFrame();
    System.out.println(picture.getWidth() + "x" + picture.getHeight() + " " + picture.getColor());
    //for JDK (jcodec-javase)
    BufferedImage bufferedImage = AWTUtil.toBufferedImage(picture);
    ImageIO.write(bufferedImage, "png", new File("frame"+i+".png"));

    //for Android (jcodec-android)
    Bitmap bitmap = AndroidUtil.toBitmap(picture);
    bitmap.compress(Bitmap.CompressFormat.PNG, 100, new FileOutputStream("frame"+i+".png")); 
}

Making a video with a set of images from memory:

SeekableByteChannel out = null;
try {
    out = NIOUtils.writableFileChannel("/tmp/output.mp4");
    // for Android use: AndroidSequenceEncoder
    AWTSequenceEncoder encoder = new AWTSequenceEncoder(out, Rational.R(25, 1));
    for (...) {
        // Generate the image, for Android use Bitmap
        BufferedImage image = ...;
        // Encode the image
        encoder.encodeImage(image);
    }
    // Finalize the encoding, i.e. clear the buffers, write the header, etc.
    encoder.finish();
} finally {
    NIOUtils.closeQuietly(out);
}

Read Tape Timecode from MXF file

TapeTimecode timecode = MXFDemuxer.readTapeTimecode(new File("myfile.mxf"));

Parse DPX metadata

DPXMetadata dpx = DPXReader.readFile(firstDpx).parseMetadata();
System.out.println(dpx.getTimecodeString());

Contact

Feel free to communicate any questions or concerns to us. Dev team email: jcodecproject@gmail.com