社会符号学研究中的多模态化-胡壮麟

20071社会符号学研究中的多模态化胡壮麟索绪尔对语言符号学的建立和对普通符号学的展望有其不可磨灭的贡献,但他的有些观点在符号学研究者中有不同反响代表英美传统的皮尔斯发展了符号范畴,但他忽视了作为社会成员的人,因此仍不能摆脱形式主义的研究方法随后的社会符号学发端于韩礼德的语言是社会符号的理论,关注的是特定于某一文化某一社团的符号实践这一理论推动了多模态表达的研究,从而形成了多模态符号学本文首先讨论多模态符号学和多媒体符号学的区别;进一步介绍具有媒体和模态双重特性的计算机符号学;对一些具体问题分别作了论述,如作为符号系统的符号资源以屏幕代替书本的多模态符号的设计以及由话语参与者实现的连贯最后指出,在人类进入社会符号学的多模态化的新世纪,对多模态识读能力的培养应引起重视社会符号学;多模态化;体符号学;计算机符号学;多模态识读能力2004,,,:如今,我们一方面认识到语言是全部符号事实中的一个特殊系统,对语言学的研究推动了对符号学的研究对符号学的认识加深了我们对语言的认识另一方面又开拓了我们对其他符号系统的研究这就是说,符号学有广阔的目标,它的理论旨在探索意义的生成任何意义,不仅是书面语的意义,诸如视觉听觉嗅觉味觉触觉,以至抽象的模型结构主体意识都应纳入它的视线之内,(Saussure1974),,,,,,(Saussure1974,Fiske1982,Beaugrande1991,Guske1998),,,,1,,,(Martin&Ringham2000,2004:122),,,,,,,,,,,(Halliday1978),,(),,,()(),(Lemke2005),(semiosis),,Lemke,,,,,:,,,(Beaugrande1991:2-27)(multimodality)(multimediality),,modalitymode(///),modality(),modalverb()modal(),modelmode,modemedium(/),,,,,(Scollon&Levine2004),,,,,,,,,2,/,,()(,),Kress(2001):,,,,,,,,,,,Kress(2001)1978(Bernsen2002)Holsonova(1999),,,,,,,()Holsonova:(1),(2),,,,(3)????(4)?(5),(eyetrackers)(verbalprotocols)(6),(7),,,,:??,?(1)-(4),(5)-(7),,,,,,,;;,,,(Lemke2005),3,(Scollon&Levine2004),,,,,Scollon&Levine(2004),:,,,,,,,,,,,,,,60,,,,,,,Andersen1990,:,,Andersen,,,,,,,Andersen,eta.l(1993),,,,,,,,,,,4,,,,?:,,;,,,;,,Andersen(1),;(2),,;(3),,,Anderson,,,Kress(2004),,,(semioticresource),(),(Lemke1993)(semioticformations),,,,Lemke(1993),,,,(actiongenre),,,(),(),,,;,,,,;,,Kress(2001)(),,,,,(Halliday1985,Kress1997)5Thibault(2004):(1);(2),+,,,Baldry(2000),,,,CNN,,,,,,,,,;,(Kress2004)Kress(2004),(),/,,,,,,,,:,???,?,,(NewLondonGroup2000),:,,,,,,,,,,,,6,:,,,,,(Williamson2005),,Kress(2001):(1):,;(2):,,,,;(3),??,,,(),,,,,,,,,,,,:,,,,(),,(Multiliteracy),,,,,,(Williamson2005),,;,,,,7Spiliotopoulos(2005),,,,,(Spiliotopoulos2005,Algren2005),(Andersen2005,Johnson2005,Joy2005,Miranda2005):(1)(2),,,(),,(3)(4),,,,(5)(6),,(7)()(8),,(9),,,multiliteracies,(),,,,,,Simpson(2003),2003:,,,,,,,,,(Levine&Scollon2004)2004,Algren,Mark2005WhatisMultiliteracy?MultiliteraciesforCollaborativeLearningEnvironment.:SemioticApproachestoConstructionandAssessmentof8ComputerSystems.CambridgeUniversityPress,Cambridge.Andersen,P.Bogh2005WhatisMultiliteracy?MultiliteraciesforCollaborativeLearningEnvironment.:TheDiscourseofFundamentalWorks.Harlow:Longman.Bernsen,N.O.2002MultimodalityinLanguageandSpeechSystems-FromTheorytoDesignSupportToo,linB.B.Granstrom,D.House,I.Karlsson(eds.):MultimodalityinLanguageandSpeechSystems.Dordrecht:KluwerAcademicPublishers.Fiske,John1982IntroductiontoCommunicationStudies.2ndedn.London:Routledge.Guske,Iris1998CommunicationStudies:CommunicationCodes.ToWhatExtentisHallidayanSocialSemioticTheoryCompatiblewithSaussuresProgrammeforSociology?ZurckzurStartseite.Halliday,M.A.K.1978LanguageasaSocialSemiotic.London:EdwardArnold.Halliday,M.A.K.1985AnIntroductiontoFunctionalGrammar.London:EdwardArnold.Holsanova,J.1999Olikaperspektivpasprak,bildochderassamspe.lMetodologiskareflexioner,(Differentperspectivesonmultimodality.Methodologicalconsiderations)inIngerHaska&CarinSandqvist(eds.):AllaTidersSprak.LundastudierinordisksprakvetenskapA55.LundUniversityPress,Lund.Johnson,Staci2005WhatisMultiliteracy?MultiliteraciesforCollaborativeLearningEnvironent.://veltevens.blok.com/general/home//.Kress,G.R.1997BeforeWriting:RethinkingthePathstoLiteracy.Routledge:London.Kress,G.R.2001Multimodality.ApaperpresentedattheInternationalLiteracyConference,CapeTown,13-17November.Kress,G.R.2004ReadingImages:Multimodality,RepresentationandNewMedia.ApaperpresentedatExpertForumforKnowledgePresentation.Levine,Philip&Scollon,Ron2004DiscourseandTechnology:MultimodalDiscourseAnalysis.GeorgetownUniversityPress.LemkeOnlineOffice.Lemke,J.L.1993Discourse,DynamicsandSocialChange,inLanguageasCulturalDynamics:SpecialIssueofCulturalDynamics(Halliday,IssueEditor).Lemke,J.L.2005ImportantTheoriesforResearchTopicsontheWebsite.J.L.LemkeOnlineOffice.Martin,Bronwen&FelizitasRingham2000DictionaryofSemiotics.LondonandNewYork:Cassel.lMiranda,Nobella2005WhatisMultiliteracy?MultiliteraciesforCollaborativeLearningEnvironent.:DesigningSocialFutures,inBillCopeandMaryKalantzis.Saussure,Ferdinandde1974CourseinGeneralLinguistics.Glasgow:Fontana.Scollon,Ron&Levine,Philip2004MultimodalDiscourseAnalysisastheConfluenceofDiscourseandTechnology.WashingtonDC.:GeorgetownUniversityPress.Simpson,J.E.B.2003BALL/CUPSeminaronMultimodalityandAppliedLinguistics.London,Reading,UnitedKingdom,18/July/2003-19/July/2003.Spiliotopoulos,Vakua2005DevelopingMultiliteracyinAdul