Cloudera-Hadoop上的智能分布式k-均值算法.(IJEME-V8-N4-6)

I.J.EducationandManagementEngineering,2018,4,61-70PublishedOnlineJuly2018inMECS()DOI:10.5815/ijeme.2018.04.06Availableonlineat:29January2018;Accepted:16April2018;Published:08July2018AbstractThe21stcenturyevolvedwithtsunamiofdatagenerationbythehumancivilizationthathasdeliverednewwordslikeBigDatatotheworldofvocabulary.Digitizationprocesshasalmostovertakenallthemajorsectorsandithasplayedapivotalroleofdominanceasforasvirtualdigitalworldisconcerned.Thisinturnhaslandedusinmostdebatedterm“BigData”inthepresentdecade.BigDatahasmadethetraditionalrelationaldatabases(RDMS)handicappedintermsoftheirhugesizeandspeedofitscreation.Thehungertomanageandprocessthisgiganticcomplexheterogeneousdata,hasagainfollowedtheageoldruleof“NecessityisthemotherofInvention”,andcameupwithideaofHadoopMapReduceforthesame.ThegivenworkusesK-MeansclusteringalgorithmonabenchmarkMRIdatasetfromOASISdatabase,inordertoclusterthedatabasedupontheirvisualsimilarity,usingWEKA.UntilathresholdsizeitworkedoutandafterthatcompelledWEKAtopromptanemergencymessage“outofmemory”ondisplay.AMap/ReduceversionofK-meansisimplementedontopofHadoopusingR,soastocurethisproblem.ThegivenalgorithmisevaluatedusingSpeedup,ScaleupandSizeupparametersanditneatlyperformedbetterasthesizeoftheinputdatagetsincreased.IndexTerms:Bigdata,Healthcareinformatics,MRI(MagneticImagingResonance),Clustering.©2018PublishedbyMECSPublisher.Selectionand/orpeerreviewunderresponsibilityoftheResearchAssociationofModernEducationandComputerScience.1.IntroductionWiththeimprovingevolutionsinthescienceandrelatedresearch,humanityhasalwaysbeenattheriskofvulnerablediseasesthreateningthehumanwellbeing.Recentally,thefieldrelatedtobraindiseases/disordersgotilluminatedwhichwasalmostignoredbecauseofthelackofknowledgeandinformation.Forquenchingthirstofthesame,scientistswiththeirtiereffortscomeupwithmorereliableandsophisticatedtoolsaimingat*Correspondingauthor.Tel.:[phone]E-mailaddress:[e-mail],[e-mail],[e-mail]62AnIntelligentDistributedK-meansAlgorithmoverCloudera/Hadoopeasyandprecisediagnosisoftherelatedproblems.Magneticresonanceimaging(MRI),fMRI(FunctionalMagneticresonanceimaging(MRI)),CT(ComputedTomography)Scans,EEG(Electroencephalography)etc.aresuchtechniquesknowntoeveryonenowadays.Forfabricatingindepthimagesoftheinsideofthebody,MRIscanequippedwithwavesandstrongmagneticfieldsisworthuseofwhichcontainslargeamplespacetolaydownapatientinsidethetubeduringthescan[1].NearlyanypartofthebodycanbescrutinisedbyanMRIscan,includingtheliver,bloodvessels,brainandspinalcord,bonesandjoints,breast,heart,internalorgans,suchaswomborprostategland.VariousnomenclatureofMRI’sdoesexistdependingonwhichpartofbodytheMRIiscarriedon.SomeofthemfunctionalinmodernclinicalinvestigationareCardiacMRI,ChestMRI,KneeMRI,MagneticResonance(MR)Defecography[2],MagneticResonance(MR)-GuidedBreastBiopsy,MagneticResonanceCholangiopancreatography(MRCP),MagneticResonanceImaging(MRI)ofSpine,MagneticResonanceImaging(MRI)ofHead,MagneticResonanceImaging(MRI)ofDynamicPelvicFloor,MagneticResonanceFunctional(fMRI)ofBrain,MRAngiography(MRA),MREnterography,MRIoftheBody(Chest,Abdomen,Pelvis),MRIofMusculoskeletalSystem,MRIoftheProstate,ShoulderMRIetc.[3].Metabolicchangestakingplaceinsidethebrainaremeasuredbyfunctionalmagneticresonanceimaging(fMRI)[3].Inspectionofthebrain’sanatomy,governbrainpartsliableforconductingcriticalfunctions,weighingeffectsofstrokeordiseasearetheoutcomesfromthefMRI.Odditiesindoorsthebrainthatremaininvisiblewithotherimagingtechniquesareunearthedbyit.Inadditioninexplainingbrainanatomy,MRIaidsNeurosurgeonsalsoinassessingintegrityofthespinalcordaftertrauma.Itservesinthescenariosalsowhenproblemsassociatedwiththevertebraeorintervertebraldiscsofthespineareboredinmind.Shapeandstructureoftheheartandaorta(soastodetectaneurysmsortears)alsopartofitsofferings.OutcomesofanMRIscancanaidindiagnoseconditions,plantreatmentsandweighingthesuccessofpriordealing[4].AccuracyofdiseaseuncoveringthroughoutthebodyisatthecoreofMRItechniquesandfrequentlycomestorescueafterformertestingfailsindeliveringabundantevidenceforsanctioningapatient'sdiagnosis.WhileBleedingorswellinginheadsignalstraumatothebrain,otherdeviationsregularlyminedembracebraintumors,stroke,aneurysmsaswellastumorsorinflammationofthespine.Inadditioninenlighteningabouttheinformationonglandsandorganswithintheabdomen,informationaboutsofttissues,jointsstructureandbonesofthebodyisalsoofferedbyit.ThesefruitfulservicescaninturnassistindeferringsurgeryormoreexactlyfocusedafterexpressingresultsofanMRIscan[5].Remainingpaperisfashionedas:Chapter2ndthrowsatorchontherelatedworkdoneinthepastinthesamedirection.Chapter3rdconcentratesonthedescriptionoftheMRIdatasetfromOASISdatabase,usedinthisstudy.Italsothrowsabrieflightonthemethodol