hiive api參考06發(fā)布日期

客戶服務電話 客戶服務傳真 客戶服務郵箱 本文檔為使用海思媒體處理芯片的IVE協(xié)處理器進行智能分析方案開發(fā)的程序員而文件、錯誤碼、Proc信息等。與本文未做特殊說明，Hi3518EV201Hi3516CV200Hi3518EV200

V200/V201和Hi3516CV200相關內容2HI_MPI_IVE_QueryIVE參數(shù)說明目 概 API參 IVE錯誤 Proc調試信 概 Proc信息說 使用PC端IVEClib與板端IVESDK開發(fā)算法的差 使用IVE與OpenCV開發(fā)算法的區(qū) 圖1-1跨度（stride）示意 \\ 圖1-3IVE_IMAGE_TYPE_YUV420SP類型的IVE_IMAGE_S圖 圖1-4IVE_IMAGE_TYPE_YUV422SP類型的IVE_IMAGE_S圖 圖1-12IVE_MEM_INFO_S類型的數(shù)據(jù)內存示 圖1-13積分圖（IVE_IMAGE_TYPE_U64C1）組合輸出示 圖1-14直方圖輸出格式示 圖2-1快速拷貝示意 圖2-2間隔拷貝示意 圖2-3Filter計算公式示意 圖2-4Sobel計算公式示意 圖2-5MagAndAng計算示意 圖2-6Dilate計算公式示意 圖2-7Erode計算公式示意 圖2-8Thresh8種閾值化模式示意 圖2-9Thresh_S164種閾值化模式示意 圖2-10Thresh_U162種閾值化模式示意 圖2-12灰度圖像GMM模型的內存配置示意 圖2-13RGB圖像GMM模型的內存配置示意 圖2-14灰度圖像GMM2模型的內存配置示意 圖2-15RGB圖像GMM2模型的內存配置示意 圖2-16LBP計算公式示意 圖2-17NormGrad計算公式示意 圖2-183層金字塔LK光流計算示意 圖2-193層金字塔LK光流計算示意 圖2-20前景狀態(tài)標志圖形單個像素各比特位示意 圖2-25SVM輸入樣本向量示意 圖2-26SVM預測結果示意 圖2-27SVM輸入樣本向量數(shù)組示意 圖2-28SVM預測結果示意 圖2-29CNN輸出特征向量數(shù)組示意 圖2-30CNN網(wǎng)絡模型示意 圖2-31CNN各樣本預測結果示意

1IVE（IntelligentVideoEngine）是海思媒體處理芯片智能分析系統(tǒng)中的硬件加速模塊。句柄查詢IVE硬件只能從DDR中獲取數(shù)據(jù)。如果用戶在調用IVE任務時，訪問空間可時用戶需要調用HI_MPI_SYS_MmzFlushCache接口刷cache（詳細信息請參見（stride?素”位寬可以是8bit，16bit等。?IVE_DATA_S1-1

nn?的，具體見各算子API參考中的參數(shù)要求。?輸入、輸出數(shù)據(jù)類型（具體結構定義請參見“3?IVE_IMAGE_TYPE_E，具體的內存分配如圖1-2～圖1-10所示。?11所示；根據(jù)類型IVE_IMAGE_S可以轉化為單個或多個IVE_DATA_S。?輸入等；其內存如圖1-12所示。8bit無符號單通道u32PhyAddr[0]、8bit有符號單通道u32PhyAddr[0]、1-3IVE_IMAGE_S中的pu8VirAddr[0]（Y）u32PhyAddr[1]、1-4IVE_IMAGE_S中的pu8VirAddr[0]（Y）u32PhyAddr[1]、YCbCr420Planar圖1-5所示IVE_IMAGE_S中的u32PhyAddr[2]、度Y跨度）、度U跨度）和度V跨度）YCbCr422Planar圖1-6所示IVE_IMAGE_S中的U跨度）u32PhyAddr[2]、度V跨度）8bit有符號雙通道Package格式1-7所示8bit有符號雙通道81-2所1-2所8bit無符號三通道Package格式1-9所示8bit無符號三通道101-2所1-2所1-2所1-2所?Integ組合輸出?IVE_IMAGE_TYPE_U64C1類型的IVE_IMAGE_S，S（圖像和）28bit，SQ（圖像平方和）36bit1-13?1-14

Width*nbitnbitnbitnbitn nbitnbitnbitnbitn

Y0Y1Y2Y3Y4Y5

V0U0V2U2V4U4V6 Y0Y1Y2Y3Y0Y1Y2Y3Y4Y5U0U1 色度V0V1

S8_00

S8_10 S8_20

對于HSV_PACKAGE圖像，是以“H0S0V0H1S1V1…”形式存儲，H在最前面；回的handle號。具體可參見HI_MPI_IVE_Query中的【舉例】。2API該功能模塊提供以下MPI：HI_MPI_IVE_Map：創(chuàng)建Map（U8->U8賦值）HI_MPI_IVE_Map：創(chuàng)建Map（U8->U8\U8->U16\U8->S16賦值）HI_MPI_IVE_LBP：創(chuàng)建LBP以及對SAD進行閾值化輸出。HI_S32HI_MPI_IVE_DMA(IVE_HANDLE*pIveHandle,IVE_DATA_S*pstSrc,IVE_DST_DATA_S*pstDst,IVE_DMA_CTRL_S*pstDmaCtrl,HI_BOOLbInstant);輸入(set模式下同時也是輸出11直接拷貝時同pstSrc；0Iout(x,y)I(x, (0xwidth,0y

?u8HorSegSize?小的段，拷貝每段中的前u8ElemSize大小的字節(jié)。如圖2-2所示。用u64Val的低字節(jié)填充。… …

輸出

HI_S32HI_MPI_IVE_Filter(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_FILTER_CTRL_S*pstFltCtrl,HI_BOOLbInstant);1616注：U8C1\YUV420SP\YUV422SP均為IVE_IMAGE_TYPE_E成員的簡寫，后續(xù)其他的成員在表述中0Filter2-3x-2,y-1)I(x-1,y-1)I(x,y-1)I(x+1,y-1)I(x+2,y- x-2,y-1)I(x-1,y-1)I(x,y-1)I(x+1,y-1)I(x+2,y- -2,y+1)I(x-1,y+1)I(x,y+1)I(x+1,y+1)-2,y+2)I(x-1,y+2)I(x,y+2)I(x+1,y+2)(-2,-2)coef(-1,-2)coef(0,-2) coef(1,-2)coef( (-2,-1)coef(-1,-1) f(-2,0)coef(-1,0) k[10] mask[12] f(-2,1)coef(-1,1) coef(1,1) Iout(x,y)

I(xi,yj)coef(i,j)2j2

44012024 256368 474012 56 400 23 47444u8Norm u8Norm u8NormHI_S32HI_MPI_IVE_CSC(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_CSC_CTRL_S*pstCscCtrl,HI_BOOLbInstant);16160*pstSrc,IVE_DST_IMAGE_S*pstDst,*pstFltCscCtrl,HI_BOOL16160HI_S32HI_MPI_IVE_Sobel(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstDstH,IVE_DST_IMAGE_S*pstDstV,IVE_SOBEL_CTRL_S*pstSobelCtrl,HI_BOOL高、寬同pstSrc。1616160Sobel2-4Hout(x,y) I(xi,y2j2Vout(x,y) I(xi,y2j2

j)coef(i,coef(j,,,,coef(mask)pstSobelCtrl中的Sobel

0000 0000 0 0

0 0

000 0000 82

4641000

Scharr 0000 0000 3300 0000000000001011010

0 0000 000

00 0000000000000000

00001 00001

000 000

0

*pstSrc,IVE_DST_IMAGE_S*pstDstMag,IVE_DST_IMAGE_S*pstDstAng,IVE_MAG_AND_ANG_CTRL_S*pstMagAndAngCtrl,HI_BOOLbInstant);1616160pstDstMagpstDstAngMag(x,y)Mag(x,

(Mag(x,y)u16Thr)(Mag(x,y)I(x-2,y-2)I(x-1,y-2)I(x,y-2)I(x+1,y-2)I(x+2,y-I(x-2,y-1)I(x-2,y-1)I(x-1,y-1)I(x,y-1)I(x+1,y- I(x-2,y+1)I(x-1,y+1)I(x,y+1)I(x+1,y+1) I(x-2,y+2)I(x-1,y+2)I(x,y+2)I(x+1,y+2)coef(-1,-2)coef(0,- coef(-2,-1)coef(-1,- coef(-2,0)coef(- mask[12] Hout(x,y)Vout(x,y)

I(xi,yj)coef(i,2j2 I(xi,yj)coef(j,2j2Mag(x,y)abs(Hout(x,y))abs(Vout(x,(xy

(x,y)、

(xy以及arctan(H

,,coef(mask)pstMagAndAngCtrlas8Mask[25]HI_S32HI_MPI_IVE_Dilate(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_DILATE_CTRL_S*pstDilateCtrl,HI_BOOL16160 000 000

0 0 00000000000000

00 0

000 00

0

0 0

0 I(x-2,y-2)I(x-1,y-2)I(x,y-2)I(x+1,y-2)I(x+2,y-I(x-2,y-1)I(x-2,y-1)I(x-1,y-1)I(x,y-1)I(x+1,y- I(x-2,y+1)I(x-1,y+1)I(x,y+1)I(x+1,y+1) I(x-2,y+2)I(x-1,y+2)I(x,y+2)I(x+1,y+2)coef(-1,-2)coef(0,- coef(-2,-1)coef(-1,- coef(-2,0)coef(- mask[12] Iout(x,y)f(I(x(k&5)1,y(k%5)1)&coef((k&5)1,(k%5) f(Ak,,cmin,cmax)Ac HI_S32HI_MPI_IVE_Erode(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_ERODE_CTRL_S*pstErodeCtrl,HI_BOOLbInstant);16160 000 000

0 0 00000000000000

00000 0000 00

0

0

0

0 0

0 I(x-2,y-2)I(x-1,y-2)I(x,y-2)I(x+1,y-2)I(x+2,y-I(x-2,y-1)I(x-2,y-1)I(x-1,y-1)I(x,y-1)I(x+1,y- I(x-2,y+1)I(x-1,y+1)I(x,y+1)I(x+1,y+1) I(x-2,y+2)I(x-1,y+2)I(x,y+2)I(x+1,y+2)coef(-1,-2)coef(0,- coef(-2,-1)coef(-1,- coef(-2,0)coef(- mask[12] Iout(x,y)f(I(x(k&5)1,y(k%5)1)|coef((k&5)1,(k%5) f(Ak,,cmin,cmax)Ac HI_S32HI_MPI_IVE_Thresh(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_THRESH_CTRL_S*pstThrCtrl,HI_BOOLbInstant);110?

(x,y)

(I(x,y)(I(x,y)?

(x,y)I(x,

(I(x,y)(I(x,y)?

(x,y)I(x,

(I(x,y)(I(x,y)?

(x,y)

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)?I(x, (I(x,y)

(x,y) (lowThrI(x,y) (I(x,y)?

(x(x,y)I(x,

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)?

(x,y)I(x,

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)?I(x,y)Iout(x,y)I(x,

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)minVal、midValmaxVal分別對應pstThrCtrlenMode、u8LowThr、u8HighThr、u8MinVal、u8MidValu8MaxVal2-8所示。HI_S32HI_MPI_IVE_And(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc1,IVE_SRC_IMAGE_S*pstSrc2,IVE_DST_IMAGE_S*pstDst,HI_BOOLbInstant);1110Iout(x,y)Isrc1(x,y)&Isrc2(x,HI_S32HI_MPI_IVE_Sub(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc1,IVE_SRC_IMAGE_S*pstSrc2,IVE_DST_IMAGE_S*pstDst,IVE_SUB_CTRL_S*pstSubCtrl,HI_BOOL1110 ? ?,HI_S32HI_MPI_IVE_Or(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc1,IVE_SRC_IMAGE_S*pstSrc2,IVE_DST_IMAGE_S*pstDst,HI_BOOLbInstant);1110Iout(x,y)Isrc1(x,y)|Isrc2(x,,HI_S32HI_MPI_IVE_Integ(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_INTEG_CTRL_S*pstIntegCtrl,HI_BOOL16160IVE_IMAGE_TYPE_U64C11-13，計算公式如下：ixjIsum(x,y)I(i,i0ixjIsq(x,y)(I(i,j)I(i,i0Iout(x,y)(Isq(x,y)28)|(Isum(x,y)&0xFFFFFFFixjIsum(x,y)I(i,i0jIout(x,y)Isum(x,ixjIsq(x,y)(I(i,j)I(i,i0jIout(x,y)Isq(x,HI_S32HI_MPI_IVE_Hist(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_MEM_INFO_S*pstDst,HI_BOOLbInstant);16-16-0Iout(x)((I(i,j)x)?1:

x*pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_THRESH_S16_CTRL_S*pstThrS16Ctrl,HI_BOOLbInstant);210?

(x,y)

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)要求：-32768lowThrhighThr?

(x,y)I(x,

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)-128minValmaxVal?

(x,y)

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)要求：-32768lowThrhighThr0minValmidValmaxVal≤255?

(x,y)I(x,

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)0minValmaxVal≤255I(x,ypstSrcIout(x,ypstDst，mode、lowThr、highThr、minVal、midValmaxVal分別對應pstThrS16CtrlenMode、s16LowThr、S16_TO_S8_MlowThr Thr *pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_THRESH_U16_CTRL_S*pstThrU16Ctrl,HI_BOOLbInstant);210?

(x,y)

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)?

(x,y)I(x,

(I(x,y)lowThr)(lowThrI(x,y)(I(x,y)midValmaxVal分別對應pstThrU16Ctrl的enMode、u16LowThr、u16HighThr、u8MinVal、u8MidVal和u8MaxVal。具體示意圖如圖2-10所示。

0

0

lowThrhighThr *pstSrc,IVE_DST_IMAGE_S*pstDst,*pst16BitTo8BitCtrl,HI_BOOL210?Iout(x,y)bI(x,

(aI(x,y)(128 I(x,y) I(x,y)bab?abIout(x,y)

I(x,

I(x,y)aa

I(x,y)b?a I(x,y)baisa Iout(x,y)bI(x,y)

(0 I(x,y)biasa I(x,y)baisb?a I(x,y)a Iout(x,y)bI(x,

(0 I(x,y) I(x,y)b圖如圖2-11所示。要求：u8Numeratoru16Denominatoru16Denominator≠0S16ToIVE16BITTO8BITMODES16ToU16To

IVE16BITTO8BITMODES16TOU8

IVE16BITTO8BITMODES16TOU80IVE16BITTO8BITMODE*pstSrc,IVE_DST_IMAGE_S*pstDst,16160?Iout(x,y)median{I(xi,y?Iout(x,y)max{I(xi,y?Iout(x,y)min{I(xi,yU8C1U8C1、U8C1U16C1、U8C1S16C13種模式的映射。HI_S32HI_MPI_IVE_Map(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_SRC_MEM_INFO_S*pstMap,IVE_DST_IMAGE_S*pstDst,IVE_MAP_CTRL_S1-16-10Iout(x,y)map[I(x,U8C1U8C1、U8C1U16C1、U8C1S16C13種模式的映射。HI_S32HI_MPI_IVE_Map(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_SRC_MEM_INFO_S*pstMap,IVE_DST_IMAGE_S*pstDst,IVE_MAP_CTRL_S-16-160Iout(x,y)map[I(x,*pstSrc,IVE_DST_IMAGE_S*pstDst,1616-16-0pstEqualizeHistCtrl中的stMem，至少需開辟*pstSrc1,IVE_SRC_IMAGE_S*pstSrc2,IVE_DST_IMAGE_S*pstDst,IVE_ADD_CTRL_S*pstAddCtrl,HI_BOOLbInstant);1110Iout(i,jx*I1i,jy*I2i,j)I1i,jpstSrc1I2i,j對應,化前的0<x<1，0<y<1x+y=1。HI_S32HI_MPI_IVE_Xor(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc1,IVE_SRC_IMAGE_S*pstSrc2,IVE_DST_IMAGE_S*pstDst,HI_BOOLbInstant);1110Idst(x,y)Isrc1(x,y)^Isrc2(x,HI_S32HI_MPI_IVE_NCC(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc1,IVE_SRC_IMAGE_S*pstSrc2,IVE_DST_MEM_INFO_S*pstDst,HI_BOOLbInstant);(11-16-0

wi1ww (i,2i1ww (i,2src2 (i,i1

src

) i1pstDst→u64QuadSum1、pstDst→u64QuadSum2分別對應上面公式的 w src(Isrc1(ij)*Isrc2(i,j、(I2(i,j、(I2( srci1j i1 i1HI_S32HI_MPI_IVE_CCL(IVE_HANDLE*pIveHandle,IVE_IMAGE_S*pstSrcDst,IVE_DST_MEM_INFO_S*pstBlob,IVE_CCL_CTRL_S*pstCclCtrl,HI_BOOL輸出254個有效的連通區(qū)域。16-16-0pstBlob→u8RegionNum254個有效的連通區(qū)域；astRegion數(shù)組元素的下標+1。有效的連通區(qū)域并不一定連續(xù)地存儲在數(shù)組中，而pstBlob→s8LabelStatus0，則標記成功（一個區(qū)域一個標記；若為-1，則標當連通區(qū)域數(shù)目大于254，會用pstCclCtrl→u16InitAreaThr刪除面積小的連通區(qū)斯模型個數(shù)為3或者5。HI_S32HI_MPI_IVE_GMM(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstFg,IVE_DST_IMAGE_S*pstBg,IVE_MEM_INFO_S*pstModel,IVE_GMM_CTRL_S*pstGmmCtrl,HI_BOOLbInstant);161616-16-0GMM采用n個(n=35})高斯模型，pstModel2-12所示。weight2字節(jié)、mean2字節(jié)、var3字節(jié)；因此pstModel需要分配的內存大小：pstModel→u32Size=7*pstSrc→u16Width*pstSrc→u16Height*RGBGMM采用n個(n=35})高斯模型，pstModel2-13所示。weight2字節(jié)、mean[3]2*3字節(jié)、var3字節(jié)；因此pstModel需要分配的內存大?。? 11*pstSrc→u16Width*pstSrc→u16Height*HI_S32HI_MPI_IVE_GMM2(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_SRC_IMAGE_S*pstFactor,IVE_DST_IMAGE_S*pstFg,IVE_DST_IMAGE_S*pstBg,IVE_DST_IMAGE_S*pstMatchModelInfo,IVE_MEM_INFO_S*pstModel,IVE_GMM2_CTRL_S*pstGmm2Ctrl,HI_BOOLbInstant);1616161616-16-0的GMM背景建模。8bit為前景模型時長更新參數(shù)，用于控bit為高斯模型匹配標志，0表示匹配失敗，17bit為頻率最大?u16FreqInitVal?u16FreqReduFactor?u16FreqAddFactor?u16FreqThr?u16LifeThr?mean2字節(jié)，var2字節(jié)，freq2字節(jié)，life用2字節(jié)；因此pstModel需要分配的內存大?。?pstSrc,IVE_DST_IMAGE_S*pstEdge,IVE_DST_MEM_INFO_S*pstStack,IVE_CANNY_HYS_EDGE_CTRL_S*pstCannyHysEdgeCtrl,HI_BOOLbInstant);(sizeof(IVE_POINT_U16_S))+1616-16--16-0?0?1?2IveGetStride(pstSrc→u16Width,IVE_STRIDE_ALIGN)*3*pstSrc→u16Height16-16-0使用該接口前必須調用HI_MPI_IVE_CannyHysEdge，在保證輸出pstEdge、pstStack作為該接口的參數(shù)輸入。HI_S32HI_MPI_IVE_LBP(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc,IVE_DST_IMAGE_S*pstDst,IVE_LBP_CTRL_S*pstLbpCtrl,HI_BOOLbInstant);16160I II I I I I7lbp(xy((IiIcthr(7i其中thr7lbp(xy)(abs(IiIc)thr(7i),其中thr?I(xypstSrclpb(xypstDstthrpstLbpCtrl→*pstSrc,IVE_DST_IMAGE_S*pstDstH,IVE_DST_IMAGE_S*pstDstV,IVE_DST_IMAGE_S*pstDstHV,IVE_NORM_GRAD_CTRL_S*pstNormGradCtrl,HI_BOOLS8后，采用package格式存儲（1-7）的圖161616160?IVE_NORM_GRAD_OUT_CTRL_HOR_AND_VER時，pstDstHpstDstV指?IVE_NORM_GRAD_OUT_CTRL_HOR時，pstDstH?IVE_NORM_GRAD_OUT_CTRL_VER時，pstDstV?IVE_NORM_GRAD_OUT_CTRL_COMBINE時，pstDstHVNormGrad2-17Iout(x,y)

I(xi,yj)coef(i,j)2j2 *pstSrcPre,IVE_SRC_IMAGE_S*pstSrcCur,IVE_SRC_MEM_INFO_S*pstPoint,IVE_MEM_INFO_S*pstMv,IVE_LK_OPTICAL_FLOW_CTRL_S*pstLkOptiFlowCtrl,HI_BOOLbInstant);少需分配：pstLkOptiFlowCtrl→u16CornerNum*IVE_MV_S9Q7_S類型；內存至少需分配：16160I

xtyIxI I2 IyIty一半，其計算示意圖如圖2-18所示。???流的真正位移mv。HI_S32HI_MPI_IVE_LKOpticalFlowPyr(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_SastSrcPrevPyr[],IVE_SRC_IMAGE_SastSrcNextPyr[],IVE_SRC_MEM_INFO_S*pstPrevPts,IVE_MEM_INFO_S*pstNextPts,IVE_DST_MEM_INFO_S*pstStatus,IVE_DST_MEM_INFO_S*pstErr,IVE_LK_OPTICAL_FLOW_PYR_CTRL_S*pstLkOptiFlowPyrCtrl,HI_BOOLbInstant);pstLkOptiFlowPyrCtrl→u16PtsNum*對應于下一幀圖像金字塔第0層pstLkOptiFlowPyrCtrl→u16PtsNum*蹤狀態(tài)信息，1表示成功，0表示失敗。對pstNextPts中每個跟蹤成功的特征點，對比估計（HI_U9Q7類型），跟蹤失敗的特征點不161616寬右移n16寬右移n--------0I IIyuIIy xty

It一半，其計算示意圖如圖2-19所示。I(x,y,I(x,y,?3層金字塔特征點對應的坐標：p0，p1，p2；若需要初始光流，計算出m0，m1，m2；否則m0=p0，m1=p1，m2=p2；?00LK光流的最終點p。*pstSrc,IVE_DST_IMAGE_S*pstCandiCorner,1616-16-0 4*IveGetStride(pstSrc→u16Width,IVE_STRIDE_ALIGN)* sizeof(IVE_ST_MAX_EIG_S)HI_S32HI_MPI_IVE_STCorner(IVE_SRC_IMAGE_S*pstCandiCorner,IVE_DST_MEM_INFO_S*pstCorner,IVE_ST_CORNER_CTRL_S*pstStCornerCtrl);16-16-0使用該接口前必須調用HI_MPI_IVE_STCandiCorner，在保證HI_MPI_IVE_STCandiCorner任務完成的情況下，使用HI_MPI_IVE_STCandiCorner的輸出pstCandiCorner作為該接口的參數(shù)輸入。HI_S32HI_MPI_IVE_SAD(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_S*pstSrc1,IVE_SRC_IMAGE_S*pstSrc2,IVE_DST_IMAGE_S*pstSad,IVE_DST_IMAGE_S*pstThr,IVE_SAD_CTRL_S*pstSadCtrl,HI_BOOL根據(jù)模式，高、寬分別為pstSrc1的1/4、1/8、1/16。根據(jù)模式，高、寬分別為pstSrc1的1/4、1/8、1/16。11U8C1、16pstSadCtrl→enMode，1/4、1/8、1/16。16pstSadCtrl→enMode，1/4、1/8、1/16。0Hi3536SADout(x,y) I1(i,j)I2(i, n*yjn*( (x,y) (SADout(x,y)

(x,y),pstSadCtrl→enMode相關，對應IVE_SAD_MODE_MB_4X4、IVE_SAD_MODE_MB_8X8、IVE_SAD_MODE_MB_16X16時分別取4、8、16；pstSadCtrl→u8MinVal和pstSadCtrl→u8MaxVal。HI_S32HI_MPI_IVE_Resize(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_SastSrc[],IVE_DST_IMAGE_SastDst[],IVE_RESIZE_CTRL_S*pstResizeCtrl,HI_BOOL160基于OpenCV中resize實現(xiàn)，IVE_RESIZE_MODE_LINEAR、–U8C1_NUM)字節(jié)，其中U8C1_NUM為混合圖像數(shù)組中U8C1圖像的數(shù)目。*pstBgDiffFg,IVE_SRC_IMAGE_S*pstCurGrad,IVE_SRC_IMAGE_S*pstBgGrad,IVE_DST_IMAGE_S*pstGradFg,IVE_GRAD_FG_CTRL_S*pstGradFgCtrl,HI_BOOL161616160*pstCurImg,IVE_DATA_S*pstBgModel,IVE_IMAGE_S*pstFgFlag,IVE_DST_IMAGE_S*pstBgDiffFg,IVE_DST_IMAGE_S*pstFrmDiffFg,IVE_DST_MEM_INFO_S*pstStatData,IVE_MATCH_BG_MODEL_CTRL_Su16Width*16-16-1616160pstModel→u16Widthsizeof(IVE_BG_MODEL_PIX_S)*pstSrc→u16Width，pstModel→u16Height=pstSrc→u16Heigh，至少需要分配內存大小為IveGetStridesizeof(IVE_BG_MODEL_PIX_S*pstSrc→u16Width，IVE_STRIDE_ALIGN)*pstModel→u16Height。2-20，按從右到左由低位到高位的順序排布：作為輸出，bit5、bit6是由外部函數(shù)計算作為輸入。bit11且bit01bit11且bit00bit5和bit6表示外部函數(shù)對前景狀態(tài)的反饋，bit51時表示前景像素需要短時間保持，bit6為1時表示前景像素需要長時間保持。*pstBgModel,IVE_IMAGE_S*pstFgFlag,IVE_DST_IMAGE_S*pstBgImg,IVE_DST_IMAGE_S*pstChgStaImg,IVE_DST_IMAGE_S*pstChgStaFg,IVE_DST_IMAGE_S*pstChgStaLife,IVE_DST_MEM_INFO_S*pstStatData,IVE_UPDATE_BG_MODEL_CTRL_S*pstUpdateBgModelCtrl,HI_BOOLbInstant);-16-16161616160pstChgStaLife表示變化狀態(tài)前景像素的生命時間圖像，其像素值表示變化前景的HI_S32HI_MPI_IVE_ANN_MLP_LoadModel(constHI_CHAR*pchFileName,IVE_ANN_MLP_MODEL_S*pstAnnMlpModel)0HI_VOID無無HI_S32HI_MPI_IVE_ANN_MLP_Predict(IVE_HANDLE*pIveHandle,IVE_SRC_MEM_INFO_S*pstSrc,IVE_LOOK_UP_TABLE_S*pstActivFuncTab,IVE_ANN_MLP_MODEL_S*pstAnnMlpModel,IVE_DST_MEM_INFO_S*pstDst,HI_BOOL16sizeof(SQ16.16)(16el→u8LayerNum-1]0Identityf(uuSigmoid對稱激活函數(shù)：f(u) 1)1經(jīng)元個數(shù)最大為256。pstActivFuncTabf(uS1Q15類型數(shù)數(shù)為奇或偶函數(shù)，查找表僅對輸入u[0pstActivFuncTab→s32TabInUpper]建表u8LayerNum4，u8LayerCount[8]m0,m1,m2m3,0,0,0,0}?輸入樣本向量（輸入層）SQ16.16m0SQ8.16，超?SQ16.16m3*pstAnnMlpModel,IVE_DST_DATA_S*pstDst,HI_BOOL一維SQ16.16或者SQ18.14向量數(shù)組，每斷到SQ8.16或者SQ10.14計算1616el→u8LayerNum-1]0Identityf(uuSigmoid對稱激活函數(shù)：f(u) 1

各隱藏層神經(jīng)元個數(shù)最大為256。pstActivFuncTabf(uS1Q15類型數(shù)4096ANNIdentify、Sigmoid、Gaussian激活函數(shù)為奇或偶函數(shù)，查找表僅對輸入u[0,pstActivFuncTab→s32TabInUpper]建表u8LayerNum4，u8LayerCount[8]m0,m1,m2,m3,0,0,0,0}=?n個樣本向量（輸入層m0src_elem類型為?nm3dst_elemSQ16.16或者SQ18.14的向量：HI_S32HI_MPI_IVE_SVM_LoadModel(constHI_CHAR*pchFileName,IVE_SVM_MODEL_S*pstSvmModel);0無無*pstSrc,IVE_LOOK_UP_TABLE_S*pstKernelTab,IVE_SVM_MODEL_S*pstSvmModel,IVE_DST_MEM_INFO_S*pstDstVote,HI_BOOLbInstant);SQ8.16計算16160 K(xxxTxcoef0)degree

)exix

2,SigmoidK(xxtanh(xTxcoef lsgn(T(x)b)sgn((yK(x,x))i 2048SVMxTx 2xixj，8TabOutNorm可以表示除法的除數(shù)（0，SvmDivisoru8TabOutNorm）或者移位的數(shù)目（0SvmDivisor1<<2u8abOutNorm?SQ16.16的n維向量（256維SQ8.16，?HI_U16類型的N*pstSrc,IVE_LOOK_UP_TABLE_S*pstKernelTab,IVE_SVM_MODEL_S*pstSvmModel,IVE_DST_DATA_S*pstDstVote,HI_BOOLbInstant);寬為投票類別數(shù)*sizeof(HI_U16)。一維SQ16.16向量數(shù)SQ8.1616160 K(xxxTxcoef0)degree

)exix

2,SigmoidK(xxtanh(xTxcoef lsgn(T(x)b) (yK(x,x))i pstKernelTabK(xixj計算的查找表，其數(shù)據(jù)均為S1Q15類型數(shù)2 =u8abOutNorm為參數(shù)傳入，SvmDivisor見ive_tool_xml2bin.exe的使用說明。?rSQ16.16類型的n維向量（1024維上僅支持SQ8.16，超出部分會截斷：?rHI_U16類型的NHI_S32HI_MPI_IVE_CNN_LoadModel(constHI_CHAR*pchFileName,IVE_CNN_MODEL_S*pstCnnModel);00HI_S32HI_MPI_IVE_CNN_Predict(IVE_HANDLE*pIveHandle,IVE_SRC_IMAGE_SastSrc[],IVE_CNN_MODEL_S*pstCnnModel,IVE_DST_DATA_S*pstDst,IVE_CNN_CTRL_S*pstCnnCtrl,HI_BOOLbInstant);16w：16～80；16stFullConnect.au16LayerCnt0IveAlign(m*pstCnnCtrl->u32Num*sizeof(HI_U32),16)+->?2-29所示，每個向量維數(shù)dim=pstCnnModel->stFullConnect.au16LayerCnt[pstCnnModelstFullConnect.u8LayerNum-1]，向量的元素elem類型為SQ18.14，向量個數(shù)Height=pstCnnCtrl->u32Num。CNN網(wǎng)絡模型支持最多8Conv-ReLU-Pooling8層全連接層；Conv-ReLU-Pooling層的卷積核僅支持3x3，ReLU(RectifiedLinearUnits)Pooling可配（見IVE_CNN_ACTIV_FUNC_EIVE_CNN_POOLING_EConv-ReLU-8]：全連接輸入層（Conv-ReLU-Pooling的最終輸出）維數(shù)[1,1024]，中間隱藏層神經(jīng)元數(shù)目[2,256]，輸出層維數(shù)[1,256]。具體參數(shù)配置參見下列表格：Pooling運算包-1------2（含輸入層層全連接層為例，CNN2-30所示。注意圖示中，F(xiàn)CL-0Pooling-nPooling-nFCL-0的

ReLU-1Pooling-

Convolution-ReLU-PoolingLayers HI_S32HI_MPI_IVE_CNN_GetResult(IVE_SRC_DATA_S*pstSrc,IVE_DST_MEM_INFO_S*pstDst,IVE_CNN_MODEL_S*pstCnnModel,IVE_CNN_CTRL_S0HI_S32HI_MPI_IVE_Query(IVE_HANDLEIveHandle,HI_BOOL*pbFinish,HI_BOOL0IVE內部是按任務創(chuàng)建順序依次執(zhí)行任務的，所以用戶不必每次都使用查詢接務肯定也完成了，此時使用A任務的結果時不必再次調用查詢接口。返回值為HI_S32s32Ret=IVE_HANDLEIveHandle;IVE_SRC_DATA_SstSrc;IVE_DST_DATA_SstDst;IVE_DMA_CTRL_SstDmaCtrl={IVE_DMA_MODE_DIRECT_COPY,HI_BOOLbInstant;HI_BOOLbFinish,bBlock;===========s32Ret=HI_MPI_SYS_MmzAlloc_Cached(&stSrc.u32PhyAddr,&stSrc.pu8VirAddr,"User",HI_NULL,stSrc.u16Height*stSrc.u16Stride);{return}memset(stSrc.pu8VirAddr,1,stSrc.u16Height*s32Ret=HI_MPI_SYS_MmzAlloc_Cached(&stDst.u32PhyAddr,&stDst.pu8VirAddr,"User",HI_NULL,stDst.u16Height*stDst.u16Stride);{returns32Ret;}memset(stDst.pu8VirAddr,0,stDst.u16Height*stDst.u16Stride);s32Ret=HI_MPI_SYS_MmzFlushCache(0,NULL,0);{HI_MPI_SYS_MmzFree(stSrc.u32PhyAddr,stSrc.pu8VirAddr);HI_MPI_SYS_MmzFree(stDst.u32PhyAddr,stDst.pu8VirAddr);returns32Ret;}s32Ret=HI_MPI_IVE_DMA(&IveHandle,&stSrc,&stDst,&stDmaCtrl,{HI_MPI_SYS_MmzFree(stSrc.u32PhyAddr,stSrc.pu8VirAddr);HI_MPI_SYS_MmzFree(stDst.u32PhyAddr,stDst.pu8VirAddr);returns32Ret;}bBlock=s32Ret=HI_MPI_IVE_Query(IveHandle,&bFinish,bBlock);if(SUCCESS==s32Ret){}HI_MPI_SYS_MmzFree(stSrc.u32PhyAddr,stSrc.pu8VirAddr);HI_MPI_SYS_MmzFree(stDst.u32PhyAddr,stDst.pu8VirAddr);returns32Ret;IVE_LBP_CTRL_S：定義LBPHI_U8Q4F4;/*8bitsunsigneddecimalfraction，4bitsflag用UQ1.7來表示。用UQ5.3來表示。用UQ4.12來表示。用UQ6.10來表示。用UQ8.8來表示。用UQ14.2來表示。用UQ12.4來表示。用SQ14.2來表示。用SQ9.7來表示。中用UQ22.10來表示。用UQ25.7來表示。用SQ25.7來表示。Sx表示用xbit#define #define #define #define typedefenum{=====Planar=planar==========1-2。1-2。1-3。1-4。YUV420Planar1-5YUV422Planar1-61-2。1-2。的3通道圖像，且以planar格式存儲。1-2。1-2。1-2。1-2。typedefstruct{IVE_IMAGE_TYPE_EenType;HI_U32u32PhyAddr[3];HI_U8*pu8VirAddr[3];HI_U16u16Stride[3];HI_U16u16Width;HI_U16HI_U16 /*Canbeusedsuchasu16Width、u16Height和u16StridetypedefIVE_IMAGE_StypedefIVE_IMAGE_S

typedefstruct{HI_U32u32PhyAddr;/*Physicaladdressofthedata*/HI_U8*pu8VirAddr;HI_U16u16Stride;/*Datastridebybyte*/HI_U16u16Height;/*Dataheightbybyte*/HI_U16u16Width; /*Datawidthbybyte*/HI_U16u16Reserved;typedefIVE_DATA_StypedefIVE_DATA_Stypedefstruct{HI_U32u32PhyAddr;HI_U8*pu8VirAddr;HI_U32u32Size;typedefIVE_MEM_INFO_StypedefIVE_MEM_INFO_S

typedefunion{HI_S8s8Val;HI_U8typedefstruct{HI_U16u16X;HI_U16typedefstruct{ /*X /*Y

typedefstruct{HI_U16u16X;HI_U16HI_U16u16Width;typedefenum{IVE_DMA_MODE_DIRECT_COPY=0x0,IVE_DMA_MODE_INTERVAL_COPY=0x1,IVE_DMA_MODE_SET_3BYTE=0x2,IVE_DMA_MODE_SET_8BYTE=0x3,typedefstruct{HI_U64u64Val;HI_U8u8ElemSize;取值范圍：{2,3,4,8,16}。取值范圍：[1,u8HorSegSize-1]u8HorSegSizeu8ElemSize大取值范圍：[1,min{65535/srcStride,srcHeight}]typedefstruct{HI_S8as8Mask[25]; /*Templateparameterfiltercoefficient*/HI_U8u8Norm; /*Normalizationparameter,byrightshift*/取值范圍：[0,13]typedefenum{/*CSC:YUV2RGB,videotransfermode,RGBvaluerange[16,235]*/IVE_CSC_MODE_VIDEO_BT601_YUV2RGB=0x0,/*CSC:YUV2RGB,videotransfermode,RGBvaluerange[16,235]*/IVE_CSC_MODE_VIDEO_BT709_YUV2RGB=0x1,/*CSC:YUV2RGB,picturetransfermode,RGBvaluerange[0,255]*/IVE_CSC_MODE_PIC_BT601_YUV2RGB=0x2,/*CSC:YUV2RGB,picturetransfermode,RGBvaluerange[0,255]*/IVE_CSC_MODE_PIC_BT709_YUV2RGB=0x3,/*CSC:YUV2HSV,picturetransfermode,HSVvaluerange[0,255]*/IVE_CSC_MODE_PIC_BT601_YUV2HSV=0x4,/*CSC:YUV2HSV,picturetransfermode,HSVvaluerange[0,255]*/IVE_CSC_MODE_PIC_BT709_YUV2HSV=0x5,/*CSC:YUV2LAB,picturetransfermode,Labvaluerange[0,255]*/IVE_CSC_MODE_PIC_BT601_YUV2LAB=0x6,/*CSC:YUV2LAB,picturetransfermode,Labvaluerange[0,255]*/IVE_CSC_MODE_PIC_BT709_YUV2LAB=0x7,/*CSC:RGB2YUV,videotransfermode,YUVvaluerange[0,255]*/IVE_CSC_MODE_VIDEO_BT601_RGB2YUV=0x8,/*CSC:RGB2YUV,videotransfermode,YUVvaluerange[0,255]*/IVE_CSC_MODE_VIDEO_BT709_RGB2YUV=0x9,/*CSC:RGB2YUV,picturetransfermode,Y:[16,235],U\V:[16,240]*/IVE_CSC_MODE_PIC_BT601_RGB2YUV=0xa,/*CSC:RGB2YUV,picturetransfermode,Y:[16,235],U\V:[16,240]*/IVE_CSC_MODE_PIC_BT709_RGB2YUV=0xb,BT601YUV2RGBBT709YUV2RGBBT601YUV2RGBBT709YUV2RGBBT601YUV2HSVBT709YUV2HSVBT601YUV2LABBT709YUV2LABBT601RGB2YUVBT709RGB2YUVBT601RGB2YUVBT709RGB2YUVtypedefstruct{ enMode;/*Workingtypedefstruct{IVE_CSC_MODE_EenMode;/*CSCworking /*Templateparameterfiltercoefficient*/ /*Normalizationparameter,byrightshift*/取值范圍：[0,13]typedefenum{IVE_SOBEL_OUT_CTRL_BOTH=0x0,/*Outputhorizontalandvertical*/IVE_SOBEL_OUT_CTRL_HOR=0x1,/*Outputhorizontal*/IVE_SOBEL_OUT_CTRL_VER=0x2,/*Outputvertical*/typedefstruct{IVE_SOBEL_OUT_CTRL_EenOutCtrl;/*Outputformat*/HI_S8as8Mask[25]; typedefenum{IVE_MAG_AND_ANG_OUT_CTRL_MAG=0x0,IVE_MAG_AND_ANG_OUT_CTRL_MAG_AND_ANG=0x1,typedefstruct{HI_U16u16Thr;HI_S8 /*Templatetypedefstruct{HI_U8au8Mask[25];/*Thetemplateparametervaluemustbe0or取值范圍：0255typedefstruct{HI_U8au8Mask[25];/*Thetemplateparametervaluemustbe0or取值范圍：0255typedefenum{ =0x0,/*srcVal<=lowThr,dstVal=minVal;srcVal>lowThr,dstVal=maxVal.*/ =0x1,/*srcVal<=lowThr,dstVal=srcVal;srcVal>lowThr,dstVal=maxVal.*/ =0x2,/*srcVal<=lowThr,dstVal=minVal;srcVal>lowThr,dstVal=srcVal.*/IVE_THRESH_MODE_MIN_MID_MAX=0x3,/*srcVal<=lowThr,dstVal=minVal;lowThr<srcVal<=highThr,dstVal=midVal;srcVal>highThr,dstVal=maxVal.*/IVE_THRESH_MODE_ORI_MID_MAX=0x4,/*srcVal<=lowThr,dstVal=srcVal;lowThr<srcVal<=highThr,dstVal=midVal;srcVal>highThr,dstVal=maxVal.*/IVE_THRESH_MODE_MIN_MID_ORI=0x5,/*srcVal<=lowThr,dstVal=minVal;lowThr<srcVal<=highThr,dstVal=midVal;srcVal>highThr,dstVal=srcVal.*/IVE_THRESH_MODE_MIN_ORI_MAX=0x6,/*srcVal<=lowThr,dstVal=minVal;lowThr<srcVal<=highThr,dstVal=srcVal;srcVal>highThr,dstVal=maxVal.*/IVE_THRESH_MODE_ORI_MID_ORI=0x7,/*srcVal<=lowThr,dstVal=srcVal;lowThr<srcVal<=highThr,dstVal=midVal;srcVal>highThr,dstVal=srcVal.*/srcVallowThr,dstValminVal;srcVallowThr,dstValmaxValsrcVal≤lowThr,dstValsrcVal;srcVallowThr,dstValmaxValsrcVal≤lowThr,dstValminVal;srcVallowThr,dstValsrcValsrcVal≤lowThr,dstVal=minVal;<srcVal≤highThr,dstVal=midVal;srcValhighThr,dstValmaxValsrcVal≤lowThr,dstVal=srcVal;lowThr<srcVal≤highThr,dstVal=midVal;srcValhighThr,dstValmaxValsrcVal≤lowThr,dstVal=minVal;lowThr<srcVal≤highThr,dstVal=midVal;srcValhighThr,dstValsrcValsrcVal≤lowThr,dstVal=minVal;lowThr<srcVal≤highThr,dstVal=srcValhighThr,dstValmaxValsrcVal≤lowThr,dstVal=srcVal;lowThr<srcVal≤highThr,dstVal=midVal;srcValhighThr,dstValsrcValtypedefstruct{HI_U8u8LowThr; /*user-definedthreshold,0<=u8LowThr<=255*/HI_U8u8HighThr; /*user-definedthreshold,ifenMode<IVE_THRESH_MODE_MIN_MID_MAX,u8HighThrisnotused,elseHI_U8u8MinVal; /*Minimumvaluewhentri-levelthresholding*/HI_U8u8MidVal; /*Middlevaluewhentri-levelthresholding,ifenMode<2,u32MidValisnotused;HI_U8 /*Maxmumvaluewhentri-leveltypedefenum{ =0x0, /*Absolutevalueofthedifference*/IVE_SUB_MODE_SHIFT=0x1,/*Theoutputresultisobtainedbyshiftingtheresultonedigitrighttoreservethesignedbit.*/typedefstruct{typedefenum{IVE_INTEG_OUT_CTRL_COMBINE=IVE_INTEG_OUT_CTRL_SUM=0x1,IVE_INTEG_OUT_CTRL_SQSUM=0x2,typedefstruct{typedefenum{====srcVal≤dstVal=lowThr<srcValdstVal=srcVal>dstVal=srcVal≤dstVal=lowThr<srcValdstVal=srcVal>dstVal=srcVal≤dstVal=lowThr<srcValdstVal=srcVal>dstVal=srcVal≤dstVal=lowThr<srcValdstVal=srcVal>dstVal=typedefstruct{HI_S16s16LowThr; HI_S16 IVE_8BIT_Uun8MinVal;/*Minimumvaluewhentri-levelthresholding*/IVE_8BIT_Uun8MidVal;/*Middlevaluewhentri-levelthresholding*/IVE_8BIT_Uun8MaxVal;/*Maxmumvaluewhentri-levelthresholding*/typedefenum{IVE_THRESH_U16_MODE_U16_TO_U8_MIN_MID_MAX=0x0,IVE_THRESH_U16_MODE_U16_TO_U8_MIN_ORI_MAX=0x1,srcVal≤dstVal=lowThr<srcValdstVal=srcVal>dstVal=srcVal≤dstVal=lowThr<srcValdstVal=srcVal>dstVal=typedefstruct{HI_U16u16LowThr;HI_U8HI_U8HI_U8typedefenum{====絕對值得到S8數(shù)據(jù)。移后截斷到U8數(shù)據(jù)。typedefstruct{HI_U16u16Denominator;HI_U8HI_S8取值范圍：[max{1,u8Numerator},u8Numerator≤u16Denominatortypedefenum{IVE_ORD_STAT_FILTER_MODE_MEDIAN=0x0,IVE_ORD_STAT_FILTER_MODE_MAX=0x1,IVE_ORD_STAT_FILTER_MODE_MIN=0x2,typedefstruct{typedefstruct{HI_U8typedefstruct{HI_U8typedefstruct{HI_U16typedefstruct{HI_S16typedefenum{IVE_MAP_MODE_U8=0x0,IVE_MAP_MODE_S16=0x1,IVE_MAP_MODE_U16=0x2,U8C1U8C1MapU8C1U16C1MapU8C1S16C1Maptypedefstruct{IVE_MAP_MODE_EMaptypedefstruct{HI_U8au8Map[IVE_MAP_NUM];typedefstruct{IVE_MEM_INFO_Stypedefstruct{HI_U0Q16u