分類(lèi): Android 2011-10-27 Stagefright框架中視頻播放流程
1.創(chuàng )建playerengine
// 設置數據源,以及 audio sink
MediaPlayer::SetDataSource(PATH_TO_FILE)->
MediaPlayerService::create->
MediaPlayerService::Client::setDataSource->
GetPlayerType->
MediaPlayerService:: Client::CreatePlayer->
StagefrightPlayer:: setAudioSink->
StagefrightPlayer:: setDataSource->
Create MediaPlayerImpl(AwesomePlayer)->
MediaPlayerImpl:: MediaPlayerImpl
PlayerType:
PV_PLAYER--------------------(OpenCore中的PVPlayer,2.2之前的默認多媒體框架,從2.3開(kāi)始android源碼中已經(jīng)不存在了,變更為Stagefright,但芯片廠(chǎng)商會(huì )添加進(jìn)來(lái)。位于external/opencore目錄。)
SONIVOX_PLAYER----------- MidiFile()(MIDI 格式)
STAGEFRIGHT_PLAYER----- StagefrightPlayer
NU_PLAYER---------------------NuPlayer(流媒體播放器)
TEST_PLAYER------------------- TestPlayerStub (only for ‘test’ and ‘eng’build)
//以下為與openMax插件的初始化連接。
AwesomePlayer:mClient.connect()->
OMXClient::connect->
MediaPlayerService::getOMX()->
OMXMaster::OMXMaster: addVendorPlugin ()->
addPlugin((*createOMXPlugin ())->
*createOMXPlugin (){
new TIOMXPlugin;
}
2.解析mUri指定的內容,根據header來(lái)確定對應的Extractor
AwesomePlayer:: prepare()
AwesomePlayer:: prepareAsync_l()->
在該函數中啟動(dòng)mQueue,作為EventHandler(stagefright使用event來(lái)進(jìn)行驅動(dòng))
AwesomePlayer::finishSetDataSource_l()->
MediaExtractor::create(datasource)->
3.使用extractor對文件做A/V分離(mVideoTrack/mAudioTrack)
AwesomePlayer::setDataSource_l(extractor)->
AwesomePlayer::setVideoSource()->
AwesomePlayer::setAudioSource()->
mVideoTrack=source
mAudioTrack=source
4.根據mVideoTrace中編碼類(lèi)型來(lái)選擇video_decoder(mVideoSource)
AwesomePlayer::initVideoDecoder()->
mVideoSource->start();(初始化解碼器)
OMXCodec::Create()->
根據編碼類(lèi)型去匹配codecs,將softwareCodec優(yōu)先放在matchCodecs前面,優(yōu)先匹配,即優(yōu)先建立softWareCodec
<MediaSource>softwareCodec=InstantiateSoftwareCodec(componentName, source)->
如果沒(méi)有匹配的softWareCodec則去調用hardware中實(shí)現的omx_codec
omx->allocateNode(componentName...)->
sp<OMXCodec> codec = new OMXCodec(~)->
observer->setCodec(codec)->
err = codec->configureCodec(meta, flags)->
return codec.
5.根據mAudioTrace中編碼類(lèi)型來(lái)選擇audio_decoder(mAudioSource)
AwesomePlayer::initAudioDecoder()->
mAudioSource->start();(初始化解碼器)
OMXCodec::Create()->
根據編碼類(lèi)型去匹配codecs,將softwareCodec優(yōu)先放在matchCodecs前面,優(yōu)先匹配,即優(yōu)先建立softWareCodec
<MediaSource>softwareCodec=InstantiateSoftwareCodec(componentName, source)->
如果沒(méi)有匹配的softWareCodec則去調用Hardware中實(shí)現的omx_codec
omx->allocateNode(componentName...)->
sp<OMXCodec> codec = new OMXCodec(~)->
observer->setCodec(codec)->
err = codec->configureCodec(meta, flags)->
return codec.
6.創(chuàng )建AudioPlayer,解碼并開(kāi)啟Audio output播放audio數據
AwesomePlayer::play_l->
mAudioPlayer = new AudioPlayer(mAudioSink, this);
mAudioPlayer->setSource(mAudioSource);
mAudioPlayer->start
mSource->read(&mFirstBuffer);(在audioplayer啟動(dòng)過(guò)程中,會(huì )先讀取第一段需解碼后的資料。)
mAudioSink->open(..., &AudioPlayer::AudioSinkCallback, ...);
AudioSinkCallback{
me->fillBuffer(buffer, size)
}
開(kāi)啟audio output,同時(shí)AudioPlayer將callback函數設給它,之后每次callback函數被調用,AudioPlayer便會(huì )去讀取Audio decoder解碼后的資料。)
7.根據Codec類(lèi)型選擇Renderer
AwesomePlayer::start->
postVideoEvent_l();
AwesomePlayer::onVideoEvent()->
mVideoSource->read()(&mVideoBuffer, &options)->
AwesomePlayer::initRenderer_l()->
判斷Codec類(lèi)型,
HardWare Codec:
mVideoRenderer =new AwesomeNativeWindowRenderer(mSurface, rotationDegrees);
AwesomeNativeWindowRenderer::render()(hook Called by EGL)->
HardWare Codec不需要進(jìn)行ColorConvert操作,直接push到NativeWindow
SoftWare Codec:
mVideoRenderer = new AwesomeLocalRenderer(mSurface, meta)->
mVideoRenderer = new SoftwareRenderer()->
SoftwareRenderer::render()->
AwesomePlayer::onVideoEvent()->
[Check Timestamp]
mVideoRenderer->render(mVideoBuffer);
8.Audio和Video同步
Stagefright中Audio由CallBack驅動(dòng)數據流,Video則在OnVideoEvent中獲取Audio的timeStamp,進(jìn)行同步。
Audio::fillBuffer()->
mPositionTimeMediaUs為資料中的timestamp,
mPositionTimeRealUs為播放資料的實(shí)際時(shí)間。
AwesomePlayer::onVideoEvent()->
mTimeSourceDeltaUs = realTimeUs- mediaTimeUs
本站僅提供存儲服務(wù),所有內容均由用戶(hù)發(fā)布,如發(fā)現有害或侵權內容,請
點(diǎn)擊舉報。