SegmentationandBoundaryDetectionUsingMultiscale利用多尺分割和邊界檢測(cè)

SegmentationandBoundaryDetectionUsingMultiscale利用多尺分割和邊界檢測(cè)第1頁(yè)/共64頁(yè)LocalUncertainty第2頁(yè)/共64頁(yè)GlobalCertainty第3頁(yè)/共64頁(yè)LocalUncertainty第4頁(yè)/共64頁(yè)GlobalCertainty第5頁(yè)/共64頁(yè)CoarseMeasurementsforTexture第6頁(yè)/共64頁(yè)AChickenandEggProblemProblem:CoarsemeasurementsmixneighboringstatisticsSolution:supportofmeasurementsisdeterminedasthesegmentationprocessproceeds第7頁(yè)/共64頁(yè)

Normalized-cutsmeasureingraphsCompletehierarchyinlineartimeUsemultiscalemeasuresofintensity,texture,shape,andboundaryintegritySegmentationbyWeightedAggregation第8頁(yè)/共64頁(yè)Normalized-cutsmeasureingraphs

CompletehierarchyinlineartimeUsemultiscalemeasuresofintensity,texture,shape,andboundaryintegritySegmentationbyWeightedAggregation第9頁(yè)/共64頁(yè)SegmentationbyWeightedAggregationNormalized-cutsmeasureingraphsCompletehierarchyinlineartime

Usemultiscalemeasuresofintensity,texture,shapeandboundaryintegrity第10頁(yè)/共64頁(yè)ThePixelGraphCouplingsReflectintensitysimilarityLowcontrast–strongcouplingHighcontrast–weakcoupling第11頁(yè)/共64頁(yè)HierarchicalGraph第12頁(yè)/共64頁(yè)Hierarchy

inSWA第13頁(yè)/共64頁(yè)Normalized-CutMeasure第14頁(yè)/共64頁(yè)Normalized-CutMeasure第15頁(yè)/共64頁(yè)Normalized-CutMeasure第16頁(yè)/共64頁(yè)Normalized-CutMeasureMinimize:第17頁(yè)/共64頁(yè)Normalized-CutMeasureHigh-energycutMinimize:第18頁(yè)/共64頁(yè)Normalized-CutMeasureLow-energycutMinimize:第19頁(yè)/共64頁(yè)RecursiveCoarsening第20頁(yè)/共64頁(yè)RecursiveCoarseningRepresentativesubset第21頁(yè)/共64頁(yè)RecursiveCoarseningForasalientsegment:,sparseinterpolationmatrix第22頁(yè)/共64頁(yè)WeightedAggregationaggregateaggregate第23頁(yè)/共64頁(yè)SegmentDetection第24頁(yè)/共64頁(yè)SWALinearin#ofpoints(afewdozenoperationsperpoint)DetectsthesalientsegmentsHierarchicalstructure第25頁(yè)/共64頁(yè)Coarse-ScaleMeasurementsAverageintensitiesofaggregatesMultiscaleintensity-variancesofaggregatesMultiscaleshape-momentsofaggregatesBoundaryalignmentbetweenaggregates第26頁(yè)/共64頁(yè)Adaptivevs.RigidMeasurementsAveragingOuralgorithm-SWAGeometricOriginal第27頁(yè)/共64頁(yè)Ouralgorithm-SWAAdaptivevs.RigidMeasurementsInterpolationGeometricOriginal第28頁(yè)/共64頁(yè)RecursiveMeasurements:Intensityaggregateintensityofpixeli

averageintensityofaggregate第29頁(yè)/共64頁(yè)UseAveragestoModifytheGraph第30頁(yè)/共64頁(yè)UseAveragestoModifytheGraph第31頁(yè)/共64頁(yè)TextureExamples第32頁(yè)/共64頁(yè)IsotropicandOrientedFiltersTextonsbyK-MeansMaliketalIJCV2001Abrieftutorial第33頁(yè)/共64頁(yè)IsotropicTextureinSWAIntensityVarianceIsotropicTextureofaggregate–averageofvariancesinallscales第34頁(yè)/共64頁(yè)IsotropicTextureinSWAIntensityVarianceIsotropicTextureofaggregate–averageofvariancesinallscales第35頁(yè)/共64頁(yè)IsotropicTextureinSWAIntensityVarianceIsotropicTextureofaggregate–averageofvariancesinallscales第36頁(yè)/共64頁(yè)OrientedTextureinSWAShapeMomentsOrientedTextureofaggregate–orientation,widthandlengthinallscalescenterofmasswidthlengthorientationwithMeiravGalun第37頁(yè)/共64頁(yè)Gestalt–PerceptualGroupingAbriefTutorialSharon,Brandt,BasriPAMI2000:ShashuaandUllmanICCV1988:Groupcurvesby:ProximityCo-linearity第38頁(yè)/共64頁(yè)BoundaryIntegrityinSWA第39頁(yè)/共64頁(yè)SharpentheAggregatesTop-downSharpening:

ExpandcoreSharpenboundaries第40頁(yè)/共64頁(yè)Hierarchy

inSWA第41頁(yè)/共64頁(yè)ExperimentsOurSWAalgorithm(CVPR’00+CVPR’01)

run-time:5-10seconds.Normalizedcuts(ShiandMalik,PAMI’00;Maliketal.,IJCV’01)

run-time:about10-15minutes.

SoftwarecourtesyofDoronTal,UCBerkeley.imagesonapentiumIII1000MHzPC:第42頁(yè)/共64頁(yè)IsotropicTexture-HorseIOurAlgorithm(SWA)NormalizedCuts第43頁(yè)/共64頁(yè)IsotropicTexture-HorseIIOurAlgorithm(SWA)NormalizedCuts第44頁(yè)/共64頁(yè)IsotropicTexture-TigerNormalizedCutsOurAlgorithm(SWA)第45頁(yè)/共64頁(yè)IsotropicTexture-ButterflyOurAlgorithm(SWA)NormalizedCuts第46頁(yè)/共64頁(yè)IsotropicTexture-LeopardOurAlgorithm(SWA)第47頁(yè)/共64頁(yè)IsotropicTexture-DalmatianDogOurAlgorithm(SWA)第48頁(yè)/共64頁(yè)IsotropicTexture-SquirrelOurAlgorithm(SWA)NormalizedCuts第49頁(yè)/共64頁(yè)FullTexture-SquirrelOurAlgorithm(SWA)NormalizedCutswithMeiravGalun第50頁(yè)/共64頁(yè)FullTexture-CompositionOurAlgorithm(SWA)withMeiravGalun第51頁(yè)/共64頁(yè)FullTexture–LionCubOurAlgorithm(SWA)withMeiravGalun第52頁(yè)/共64頁(yè)FullTexture–PolarBearOurAlgorithm(SWA)withMeiravGalun第53頁(yè)/共64頁(yè)FullTexture–PenguinOurAlgorithm(SWA)withMeiravGalun第54頁(yè)/共64頁(yè)FullTexture–LeopardOurAlgorithm(SWA)withMeiravGalun第55頁(yè)/共64頁(yè)FullTexture-ZebraOurAlgorithm(SWA)withMeiravGalun第56頁(yè)/共64頁(yè)SegmentationbyWeightedAggregationEfficientapproximationtoNcut-likemeasuresRecursivecomputationofmultiscalemeasurementsNoveladaptivepyramidrepresentingtheimage第57頁(yè)/共64頁(yè)MatchingExperiment(ChenBrestel)第58頁(yè)/共64頁(yè)MatchingExperiment(ChenBrestel)第59頁(yè)/共64頁(yè)MatchingExperiment(ChenBrestel)第60頁(yè)/共64頁(yè)Experiments–ClusteringSilho