documentation on an FFmpeg structure or function, I just type ' doxygen' into google (like the audio data, so I won't add any junk here that might confuse you. frame->linesize, and other related fields on the FFmpeg docs. the data will be in frame->data and possibly frame->extended_data. If it's packed audio, all the data will be in frame->data. How it's stored in the frame depends on the format of frame now has usable audio data in it. If (formatContext->streams ->codec->codec_type = AVMEDIA_TYPE_AUDIO)ĬodecContext->codec = avcodec_find_decoder(codecContext->codec_id) Īvcodec_decode_audio4(codecContext, frame, &frameFinished, &packet)

}Update Nov 1, 2013: I fixed some stuff and updated it to work with the most recent version of FFmpeg. While (avcodec_decode_audio4(codecContext, frame, &gotFrame, &readingPacket) >= 0 & gotFrame) Decode all the remaining frames in the buffer, until the end is reached If (codecContext->codec->capabilities & CODEC_CAP_DELAY) is set, there can be buffered up frames that need to be flushed, so we'll do that Some codecs will cause frames to be buffered up in the decoding process. You *must* call av_free_packet() after each call to av_read_frame() or else you'll leak memory PrintAudioFrameInfo(codecContext, frame) We now have a fully decoded audio frame Int result = avcodec_decode_audio4(codecContext, frame, &gotFrame, &decodingPacket) Some frames rely on multiple packets, so we have to make sure the frame is finished before Audio packets can have multiple audio frames in a single packet Std::cout channels sample_rate sample_fmt) index) If (avcodec_open2(codecContext, codecContext->codec, NULL) != 0) It's planar, so 'Įxtended_data has the data for channel 1 'Įxtended_data has the data for channel 2 'ĭata to store all the channels, so you can either use 'ĭata or frame->extended_data to access the audio data (they 'ĭata/frame->extended_data has the data for channel 1 'ĭata/frame->extended_data has the data for channel 2 'ĭata/frame->extended_data (kind of like how some 'ĪVCodecContext* codecContext = audioStream->codec Therefore, to access the audio data, you need to use 'Įxtended_data to access the audio data. If (codecContext->channels > AV_NUM_DATA_POINTERS & av_sample_fmt_is_planar(codecContext->sample_fmt)) Std::cout nb_samples channels sample_fmt) sample_fmt) sample_fmt) linesize tells you the size (in bytes) of each plane ' See the following to know what data type (unsigned char, short, float, etc) to use to access the audio data: Void printAudioFrameInfo(const AVCodecContext* codecContext, const AVFrame* frame)

Ffmpeg documentation doxygen