像素级图像融合技术研究

PCAAbstractImagefusionmeanstosynthesizemultiplesourcepicturesandgetmoreaccurate,morecomprehensiveandmorereliableinformationaboutsamesceneorobject.Fusedimageshouldbeconvenientforthefollowingimageanalysis,recognizing,targetdetectingandtracing.Ittakesfulladvantageofredundantorcomplementaryinformationfromsourcepictures,andnotbeidenticaltocommonimageenhancement.Itisanewtechnologyintheareaofcomputervisionandimagecomprehension.Imagefusiontechnologyisgeneratedfrommilitaryarea,suchasmissileguide,autonomousrobot,unmannedscoutflightandsoon.Atthesametimeimagefusiontechnologyisappliedinawidevarietyoffieldssuchasmedicaldiagnosis,remotesensingandindustrymanufacture.Inthisdissertation,wefocusonthemethodofimagefusionandevaluationofitsquality.Theconcept,purpose,applicationofimagefusionarealsoinvolved.Theroutinefusionmethodsareintroducedindetail,suchassimplefusionmethod(pixelaverage,maximalorminimalpixelselection),themultiresolutionimagefusiontechniquesbasedonmultiscalepyramiddecomposition,andtheimagefusionmethodbasedonwavelettransform,anddevelopamethodtodeterminecoefficientsinpixelaveragealgorithmwithprinciplecomponentanalysis(PCA).Likewise,evaluationforfusionimageisvitaltofusionsystem.Somequalitativeandquantitativecriterionsarealsointroducedindetail.Atlast,afterstudyingofimageformationmodelandmodifyingthemodel,anovelimagefusionalgorithmisproposedwecaneducethefusedimagefromthemodelbasedonnon-multi-scaledecomposition,withthehelpfuzzymathandEMalgorithm.Aseriesofexperimentsonimagefusionaregiveninthisdissertation.Theexperimentalandcalculationresultsshowthatthefusionalgorithmweproposeiseffectual.Keywords:imagefusionpyramiddecompositionwavelettransformEMAlgorithmPCAfuzzymathevaluationcriteria111.121.23451.3671.41.5821[44-45];2.1AB,M×N,FAB{}),(),,(),(nmBnmAMaxnmF=2-1mn1,2,…,M;nn1,2,…,N;AB(m,n)ABF(m,n)92.2{}),(),,(),(nmBnmAMinnmF=mn1,2,…,M;nn1,2,…,N;AB(m,n)ABF(m,n)2.3),(),(),(21nmBnmAnmFww+=mn1,2,…,M;nn1,2,…,N;1w12w2121=+ww5.021==ww,Mgi(m,n):),(),(),(212121nnnnfnngiih+=i=1,2,…,M10),(21nnih(n1,n2)),(21nnfM),(21nng∑==MiinngMnng12121),(1),({}),(),(2121nnfnngE=2)2,1(2)2,1(1nnnngMhss={}),(21nngEg2)2,1(nngsgn1,n22)2,1(nnhshn1,n2n1,n2)2,1()2,1(1nnnngMhss=M111),(),(),(21221121nnBnnAnnFRRRww+=),(),(),(21221121nnBnnAnnFGGGww+=),(),(),(21221121nnBnnAnnFBBBww+=RGBPCA(Principalcomponentanalysis:[46-48].PCA2.4PrincipalComponentAnalysisPCAKarhunen-LoeveK-LK-L2.4.1Hotelling[67]KarhunenLoeveHotellingKarhunen-Loeve(K-L)Holtelling12FN×NfN2×12212221212111],,[],,,,,,,[NQfffffffffffTQTNNNN===LLLL{}fEf=h{}TfffTfffRffEKhhhh---=(({}TfffER=fó2FaiëiQiKifL,2,1,aaii==l2-10]aaa[Q21L=A2-11210Λ=ΛAfK2-12⎟⎟⎟⎟⎟⎠⎞⎜⎜⎜⎜⎜⎝⎛=ΛQlll0021Of-çfK-L)-(fAfhTg=g13{}{}(){}{}Λ===--==-==AKAggEggEKfEAgEfTTTqqT))((0gfghhhhKgf213ggfAgfh+=ë1ë1…ëQ.gëimmQf,maiAmQmffmmgAfˆh+=QQ×=]000aaa[AQ21mLL2.4.2K-LK-L1XXC:mn=N×Nó2i,j)()(1,10,2,iljnlilijixxxxn--=∑-=sixi⎟⎟⎟⎟⎟⎟⎠⎞⎜⎜⎜⎜⎜⎜⎝⎛=⎟⎟⎟⎟⎟⎟⎠⎞⎜⎜⎜⎜⎜⎜⎝⎛=mnmjmjnijinjmnmjmjnijinjCxxxxxxxxxXsssssssssLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL111111111111;Cë0=-CIlëii=1,2,…,m,∑==mii1ii/llw14ùi),(),(1nmAnmFimii∑==w2.52-1(a)(b),2-1(c)2-1(d),2-1(e)PCA2-1(c)2-1(d)2-1(e)ab15(c)dePCA2-116172-22-2(a)(b),2-2(c)2-2(d)2-1(e)PCA2-2(e)PCA2.6181933.1[66]3.1.1(:Pyramid)BurtAdelson20[14,21-26][14,24,25]/[21,22,26],BurtAdelson(Laplacian)G0G)lGl:1-1Gl-1w(m,n):∑∑-=-=-++=22221)2,2(),(mnllnjmiGnmwGlilRjCiNl≤≤≤0,0,0(3-1):N—;Cl—1;Rl—1:w(mn)—5x5()w(m,n):(1):21)()(),(nwmwnmw=,)2,2(],2,2[-∈-∈nm(3-2)(2):∑-==221)(nnw(3-3)(3):w(n)=w(-n)(3-4)(4):w(-2)+w(2)+w(0)=w(-1)+w(1)(3-5)[27]:w(0)=3/8,w(1)=w(-1)=1/4,w(2)=w(-2)=1/16(1)w(m,n)⎥⎥⎥⎥⎥⎥⎦⎤⎢⎢⎢⎢⎢⎢⎣⎡=146414162416462436246416241641464142561wReduce(3-1))(Re1-=llGduceGG0,G1,…,GNGGN.N+lw(m,n)()2w(m,n)w(m,n)3.1.256×256Lena,0-3(4).(0).1/4.,22,,,GlGl*:Gl*:Gl-1Expand,:)(*llGExpandG=(3-1)Expand:∑∑-=-=++=2222**)2,2(),(4mnjinjmiGnmwGlilRjCiNl≤≤≤0,0,0(3-8):⎪⎩⎪⎨⎧++⎟⎠⎞⎜⎝⎛++=⎟⎠⎞⎜⎝⎛++,02,2,2,22,2*njminjmiGnjmiGliExpandReduce*lG1-lG*lG1-lG1G1-lGlG1-lG*lG1-lG*lG1-lG⎩⎨⎧==≤-=+NlGLPNlGExpandGLPNNlll,0),(1N—;LPl230:256561:128282:6443:3223-1(Lena0-3)0LP1LPNLP243.2Lena.256×256Lena,0-3(4).,Lena(3.1),Lena.0:256561:128282:6443:3223-2(Lena0-3)25(3-10)⎩⎨⎧≤≤+===+NlGExpandLPGNlLPGlllNN0,)(,1(3-11),Go[]444444344444421ExpandkNkNGExpandExpandExpandG)](...[,=[]444444344444421ExpandklklLPExpandExpandExpandLP)](...[,=(3-11)∑-=+=10,,0NlllNNLPGGNNGLP=NNNNGLP,,=(3-12)∑==NlllLPG0,0(3-13)ExpandG0.3.3GLPExpandReduce43.426G3ReduceExpandLP3G2LP2ReduceExpandG1LP1ReduceExpandG0LP0+-+-+-27G3ExpandLP3G2LP2ExpandG1LP1ExpandG0LP0++++++3.1.2((Laplacian)3.5A,BF:1LaplacianLaplacian;2Laplacian;3Laplacian(),Laplacian28,,,,,CampbellRobson[28]Wilson[29],,,,,.Y;X.,.,.Laplacian,.3-53.1.329[30-33],3.6.AB:1)2)3)4)F3.6303.7AB:F3-7.3×35×57×7.AlE,BlE,[]2',')','()','('),(mmnnLPmnwmnElKmJnl++=∑∈∈),(mnEl31lLP)','('mnwlL),(),()','()','()','('2),(,,,,',',mnEmnEmmnnLPmmnnLPmnwmnMBlAlBlAlKmJnABl+++++=∑∈∈AlE,BlE,TmnMABl),(,⎩⎨⎧≤≤=≥=)0(,),(),(),,(),(),(),(),,(),(,,,,,,,,NlmnEmnEmnLPmnLPmnEmnEmnLPmnLPBlAlBlFlBlAlAlFlTmnMABl≥),(,⎩⎨⎧+=≥+=,),(),(),,(),(),(),(),(),(),(),,(),(),(),(),(,,,max,,min,,