自动化系统评估

自動化系統評估EvaluationofAutomationSystems張裕幸F.W.LancasterandBethSandore,TechnologyandManagementinLibraryandInformationserverices:Chapter14EvaluationofautomatedSystems,1997,196-225.•Evaluationoftheperformanceofanautomatedsystemcanprovideseveralusefultypesofmanagementinformationon(1)whetherneworupdatedsystemsmeetcontractrequirements;(2)whetherthesystemislivinguptotheperformanceandoutputstandardsofitsusercommunity;(3)thepointatwhichanewsystemorsystemrefinementsareneeded;(4)possiblefutureresourceconsumption.•評估自動化系統的效益可以由下列幾種有用的管理資訊予以獲得：(1)新系統或更新系統是否符合合約需求;(2)系統產出或效益是否有達到使用者(群)的要求標準;(3)明確指出新系統或系統強化的需求;(4)未來可能的資源消耗。1•--------------------------------------•1.第四項資訊即考慮到未來潛藏性的成本支出，與TCO的觀念相符。•Itisobviousthatacomputersystemcanbeevaluatedaccordingtodifferenttypesofcriteria–easeofuse,cost,reliability,integratibility,andsoon.•電腦系統的評估可以依據不同的標準，如「容易使用」、「成本」、「穩定性」以及「整合性」等等。•Inhersurveyof54majorresearchlibrariesinNorthAmerica,Johnson(1991)discoveredthateaseofusebypatronswasamajorconsiderationintheselectionofanewsystem.–abovecostand,perhapssurprisingly,easeofusebystaff.Herfoundthatthesesamelibrariesconsideredimprovementofuserservicesasthemajorobjectiveofautomationandimprovementservicetousersasthemajoraccomplishmentofautomation.•經過評估北美54個主要的圖書館，Johnson(1991)發現使用者感覺「容易使用」是選擇系統的主要考量。2而她亦發現改善使用者服務是自動化系統的主要目標，亦是自動化的使命。•Peters(1988)identifiesthreetypesofsystemsevaluation:(1)functional–todeterminewhetherasystem’sfeaturesmeetthelibrary’sneeds;(2)economic–todeterminetheaffordabilityofasystem;and(3)performance–torevealwhetherthesystemcapacitycanmeetpresentoranticipatedfuturedemands.•Peters定義系統評估三個型式：功能性—決定系統特性是否符合圖書館需求；經濟—決定系統的支出(時間與金錢等)；效益—系統是否能夠符合現今或未來的需求。CriteriaValue123Easeofusebypatrons(顧客感覺好用)77.814.87.4Availabilityofapplicationmodulesandsubsystems(應用模組或子系統之可用性—符合使用需求)77.818.57.4Completenessofmodulesandsubsystems(模組或子系統完整性)68.522.29.3Costofsystem(系統成本)68.529.61.9Costofhardware(硬體成本)61.133.35.6Needforlocalprogrammingstall(MIS人員的需求)59.329.611.1Servicereputationofvendor(軟體廠商的保證-e.g.售後服務)53.737.09.3Easyofusebystaff(職員或幕僚感覺好用)48.151.90.0Comparableinstalledsited(軟體的客戶參考)44.540.714.8Previousexperiencewithvendor(軟體廠商的導入經驗)25.929.644.5Traininganddocumentationprovided(教育訓練及文件提供)22.266.711.1Biasagainstvendor(對軟體廠商的徧見)5.625.968.5Key:1.=Seriouslyconsidered(審慎考慮)2.=Consideredtosomeextent(僅考慮某些範圍)3.=Notconsideredatall(從不考慮)•Thereareobviouslymanypossiblewaysinwhichapproachestotheevaluationofautomatedsystemscanbecategorized.Forthepurposesofthischapter,twomajorapproachesareidentified:•Evaluationwithoutuserinvolvementorwithlessthanfulluserinvolvement.(userfree)•Evaluationwithfulluserinvolvement.(userinvolved)•評估自動化系統有許多方法，但可歸納成兩類：1.没有使用者參與的評估方法；2.使用者完全參與的評估方法。3•-----------------------------------•Thinking—TAM模型屬於上述兩種評估方法中第2種型式。•User-FreeEvaluation:Thiscategoryofevaluationfocusesonsystemfeaturesratherthanonhowtheseareexploitedbyaparticulargroupofusers.•無使用者參與評估：這類型的評估著重於系統特性而不是特定使用者的試用經驗。這類評估可用於系統的選擇、系統的接受性評估以及系統強化或替換的決策評估。•Oneusefultoolthatcanbeusedintheselectionofsystemsisachecklisttodeterminethefeaturespresentinaparticularsystemor,moreparticularly,tocomparethecharacteristicsoftwoormoresystems.•這類的評估通常會使用Checklist工具，以呈現特定系統的特性或比較兩個系統之間的特色。•Apointvaluemaybeassignedtoeachfeature,andadifferentialweightingschememaybeestablishedtoplaceemphasisonfeaturesthatareconsideredmoreimportantthanothers.Inothercases,featuresareassignedanequalratingof1or0.systemscorescanbederivedfromthegrids,withsubtotalstoindicatesystemstrengthsinparticularareas,andtotalscorestoindicateoverallperformance.•在Checklist中,可針對不同的特色指定權值以強調重要的系統特性。系統評分可以由垂直加總導出，子項加總分數為該系統某特定區項的系統強度，整體加總可以顯示出整體的效益。QuestionsABCDEFGHIJKLDOBISGeacNOTISPALSDRAHOMeHOMe1.Isthereadequatelogoninstruction(i.e.explainwhichterminaltypesaresupported)2.ArethecontentsandcoverageoftheOPACckearktexokaubed?3.Arethekeyequivalenciesexplainedforremoteuser’skeyboard?NANANANANANANA4.Isthereadequatedlogoffinstruction?5.Isthescreendisplayalwaysclean?(i.e.,nogarbagecharacters)6.(a)Isremoteaccessunrestrictedintermsoftimeofday?(b)Doesthesystemtelltheuserifthereisatimelimittoremotesessions?(c)Doesthesystemgiveawarningmessageofautomaticlogoffifthereisnouserinput?7.DoestheremoteuserhaveaccesstothesomeOPACasthosewhousededicatedterminalsinthelibrary?8.Doesthesytemindicatewheretheremoteusercangetadditionalhelp?Score(Maximum10)654755666887Note:“NA”means“notapplicable”•Thechecklistmethodofevaluationisusefulforseveralreasons.Inthecaseofasinglesystemreview,ithelpsonetoarriveatalistofdesirablefeatures,andtoidentifythestrengthsandweaknessesofaparticularsystem.Inthecaseofamultiplesystemreview,acomparativechecklistcanhelptoverifytheexistenceoffeaturesacrosssystemsandthustoidentifycomparativestrengthsandweaknesses.•在進行系統評估時Checklist是相當有用的工具，對單一系統評估，它可以協助整理需求清單，同時指出特定系統的優缺與弱點。對多個系統的比較上，它協助定義不同系統間的特色差異，並找出強勢與弱點。•Theuseofachecklistensuresthatthesamequestionsaboutsystemfeaturesareposedconsistentlyacrosssystems.•Checklist的使用確保問題在不同系統間可以在一致性的標準下進行比較。•Cherryetal.(1994)employ4edachecklistt