Skip to content

Instantly share code, notes, and snippets.

@wobbals
Created October 31, 2012 22:46
Show Gist options
  • Star 53 You must be signed in to star a gist
  • Fork 17 You must be signed in to fork a gist
  • Save wobbals/3990442 to your computer and use it in GitHub Desktop.
Save wobbals/3990442 to your computer and use it in GitHub Desktop.
MediaCodec encoder sample
package com.opentok.media.avc;
import java.io.IOException;
import java.nio.ByteBuffer;
import android.media.MediaCodec;
import android.media.MediaCodecInfo;
import android.media.MediaFormat;
public class AvcEncoder {
private EncodedFrameListener frameListener;
private MediaCodec mediaCodec;
private byte[] sps;
private byte[] pps;
private ParameterSetsListener parameterSetsListener;
public AvcEncoder() {
mediaCodec = MediaCodec.createEncoderByType("video/avc");
MediaFormat mediaFormat = MediaFormat.createVideoFormat("video/avc", 320, 240);
mediaFormat.setInteger(MediaFormat.KEY_BIT_RATE, 125000);
mediaFormat.setInteger(MediaFormat.KEY_FRAME_RATE, 15);
mediaFormat.setInteger(MediaFormat.KEY_COLOR_FORMAT, MediaCodecInfo.CodecCapabilities.COLOR_FormatYUV420Planar);
mediaFormat.setInteger(MediaFormat.KEY_I_FRAME_INTERVAL, 5);
mediaCodec.configure(mediaFormat, null, null, MediaCodec.CONFIGURE_FLAG_ENCODE);
mediaCodec.start();
}
@Override
public void close() throws IOException {
mediaCodec.stop();
mediaCodec.release();
}
@Override
public void offerEncoder(byte[] input) {
try {
ByteBuffer[] inputBuffers = mediaCodec.getInputBuffers();
ByteBuffer[] outputBuffers = mediaCodec.getOutputBuffers();
int inputBufferIndex = mediaCodec.dequeueInputBuffer(-1);
if (inputBufferIndex >= 0) {
ByteBuffer inputBuffer = inputBuffers[inputBufferIndex];
inputBuffer.clear();
inputBuffer.put(input);
mediaCodec.queueInputBuffer(inputBufferIndex, 0, input.length, 0, 0);
}
MediaCodec.BufferInfo bufferInfo = new MediaCodec.BufferInfo();
int outputBufferIndex = mediaCodec.dequeueOutputBuffer(bufferInfo, 0);
while (outputBufferIndex >= 0) {
ByteBuffer outputBuffer = outputBuffers[outputBufferIndex];
byte[] outData = new byte[bufferInfo.size];
outputBuffer.get(outData);
if (sps != null && pps != null) {
ByteBuffer frameBuffer = ByteBuffer.wrap(outData);
frameBuffer.putInt(bufferInfo.size - 4);
frameListener.frameReceived(outData, 0, outData.length);
} else {
ByteBuffer spsPpsBuffer = ByteBuffer.wrap(outData);
if (spsPpsBuffer.getInt() == 0x00000001) {
System.out.println("parsing sps/pps");
} else {
System.out.println("something is amiss?");
}
int ppsIndex = 0;
while(!(spsPpsBuffer.get() == 0x00 && spsPpsBuffer.get() == 0x00 && spsPpsBuffer.get() == 0x00 && spsPpsBuffer.get() == 0x01)) {
}
ppsIndex = spsPpsBuffer.position();
sps = new byte[ppsIndex - 8];
System.arraycopy(outData, 4, sps, 0, sps.length);
pps = new byte[outData.length - ppsIndex];
System.arraycopy(outData, ppsIndex, pps, 0, pps.length);
if (null != parameterSetsListener) {
parameterSetsListener.avcParametersSetsEstablished(sps, pps);
}
}
mediaCodec.releaseOutputBuffer(outputBufferIndex, false);
outputBufferIndex = mediaCodec.dequeueOutputBuffer(bufferInfo, 0);
}
} catch (Throwable t) {
t.printStackTrace();
}
}
}
@GulaSoft
Copy link

Hello!
what is this:
EncodedFrameListener frameListener;
and te
ParameterSetsListener parameterSetsListener?

@XimingCheng
Copy link

I amconfused on EncodedFrameListener and ParameterSetsListener, is it the private Listener which is not provided by the Android SDK?

@npakudin
Copy link

It seems, author means custom class

public class EncodedFrameListener {
    public void frameReceived(byte[] data, int pos, int length) {

    }
}

http://dev.naver.com/projects/nextcinema/code/MediaCodecSample/src/com/TestGroup/mediacodecsample/view/EncodedFrameListener.java?branch=develop

@poojalikop
Copy link

Hi npakudin,
This page is in Korean. Can you please give more details about EncodedFrameListener. Thanks in advance.

@hpp
Copy link

hpp commented Aug 26, 2013

I found this example very useful, thanks wobbals!

EncodedFrameListener is just a listener for when a new frame has been encoded. In my case I would just open the file being written to and write in the new frame information.

ParameterSetsListener is just a listener that updates some parameters.

@bamacken
Copy link

Super old thread but I am having bit of an issue. when offering the data I get the following error:
Attempt to invoke virtual method 'java.nio.ByteBuffer[] android.media.MediaCodec.getInputBuffers()' on a null object reference

This is the line that produces the error:
ByteBuffer[] inputBuffers = mediaCodec.getInputBuffers();

However, I have checked and recheck...the MediaCodec object is not null. Any assistance is appreciated.

@leye0
Copy link

leye0 commented Oct 18, 2015

How is your MediaCodec object created? The part where you are doing MediaCodec.Create(encoder/decoder)By(type/codecName), and after that? Do you configure it? Do you see errors in the log when executing it line by line?

@bamacken
Copy link

Thanks for the reply, it's verbatim from the above code with a few more try/catch attempts. It seems that the mediaCodec object is not being created, but there are no errors thrown during it's creation, no errors during configuration. Here is the entire file.

http://pastebin.com/raw.php?i=fm2a02M3

I really appreciate the assist.

@sulaimansust
Copy link

Can anyone tell me the detail use of this encoder? Actually i can't fully understand it. Do i send the byte data received each call on
new Camera.PreviewCallback() {
@OverRide
public void onPreviewFrame(byte[] data, Camera camera) {
Constants.debugLog(TAG, "data ===" + data.length);
}
to the encoder each time? or all the byte at a single time? How do i save the file?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment