社会符号学研究中的多模态化

20071,,,,,;;,,,;;;;2004,,,:,,,,,,,,(Saussure1974),,,,,,(Saussure1974,Fiske1982,Beaugrande1991,Guske1998),,,,1,,,(Martin&Ringham2000,2004:122),,,,,,,,,,,(Halliday1978),,(),,,()(),(Lemke2005),(semio2sis),,Lemke,,,,,:,,,(Beaugrande1991:2-27)(multimodality)(multimediality),,modalitymode(///),modality(),modalverb()modal(),modelmode,modemedium(/),,,,,(Scollon&Levine2004),,,,,,,,,2,/,,()(,),Kress(2001):,,,,,,,,,,,Kress(2001)1978(Bernsen2002)Hol2sonova(1999),,,,,,,()Hol2sonova:(1),(2),,,,(3)????(4)?(5),(eye2trackers)(verbalprotocols)(6),(7),,,,:??,?(1)-(4),(5)-(7),,,,,,,;;,,,(Lemke2005),3,(Scollon&Levine2004),,,,,Scollon&Levine(2004),:,,,,,,,,,,,,,,60,,,,,,,Andersen1990,:,,Andersen,,,,,,,Andersen,etal.(1993),,,,,,,,,,,4,,,,?:,,;,,,;,,Andersen(1),;(2),,;(3),,,Anderson,,,Kress(2004),,,(semioticresource),(),(Lemke1993)(semioticformations),,,,Lemke(1993),,,,(actiongenre),,,(),(),,,;,,,,;,,Kress(2001)(),,,,,(Halliday1985,Kress1997)5Thibault(2004):(1);(2),+,,,Baldry(2000),,,,CNN,,,,,,,,,;,(Kress2004)Kress(2004),(),/,,,,,,,,:,???,?,,(NewLondonGroup2000),:,,,,,,,,,,,,6,:,,,,,(Williamson2005),,Kress(2001):(1):,;(2):,,,,;(3),??,,,(),,,,,,,,,,,,:,,,,(),,(Multiliteracy),,,,,,(William2son2005),,;,,,,7Spiliotopoulos(2005),,,,,(Spiliotopoulos2005,Algren2005),(Andersen2005,Johnson2005,Joy2005,Miranda2005):(1)(2),,,(),,(3)(4),,,,(5)(6),,(7)()(8),,(9),,,multiliteracies,(),,,,,,Simpson(2003),2003:,,,,,,,,,(Levine&Scollon2004)2004,Algren,Mark2005WhatisMultiliteracy?MultiliteraciesforCollaborativeLearningEnvironment.:SemioticApproachestoConstructionandAssessmentof8ComputerSystems.CambridgeUniversityPress,Cambridge.Andersen,P.Bogh2005WhatisMultiliteracy?MultiliteraciesforCollaborativeLearningEnvironment.:TheDiscourseofFundamentalWorks.Harlow:Longman.Bernsen,N.O.2002MultimodalityinLanguageandSpeechSystems-FromTheorytoDesignSupportTool,inB.B.Granstrom,D.House,I.Karlsson(eds.):MultimodalityinLanguageandSpeechSystems.Dordrecht:Kluw2erAcademicPublishers.Fiske,John1982IntroductiontoCommunicationStudies.2ndedn.London:Routledge.Guske,Iris1998CommunicationStudies:CommunicationCodes.ToWhatExtentisHallidayanSocialSemioticTheoryCompatiblewithSaussuresProgrammeforSociology?ZurckzurStartseite.Halliday,M.A.K.1978LanguageasaSocialSemiotic.London:EdwardArnold.Halliday,M.A.K.1985AnIntroductiontoFunctionalGrammar.London:EdwardArnold.Holsanova,J.1999Olikaperspektivpasprak,bildochderassamspel.Metodologiskareflexioner,(Differentper2spectivesonmultimodality.Methodologicalconsiderations)inIngerHaska&CarinSandqvist(eds.):AllaTidersSprak.LundastudierinordisksprakvetenskapA55.LundUniversityPress,Lund.Johnson,Staci2005WhatisMultiliteracy?MultiliteraciesforCollaborativeLearningEnvironent.://veltevens.blok.com/general/home//.Kress,G.R.1997BeforeWriting:RethinkingthePathstoLiteracy.Routledge:London.Kress,G.R.2001Multimodality.ApaperpresentedattheInternationalLiteracyConference,CapeTown,13-17November.Kress,G.R.2004ReadingImages:Multimodality,RepresentationandNewMedia.ApaperpresentedatExpertForumforKnowledgePresentation.Levine,Philip&Scollon,Ron2004DiscourseandTechnology:MultimodalDiscourseAnalysis.GeorgetownUniver2sityPress.LemkeOnlineOffice.Lemke,J.L.1993Discourse,DynamicsandSocialChange,inLanguageasCulturalDynamics:SpecialIssueofCulturalDynamics(Halliday,IssueEditor).Lemke,J.L.2005ImportantTheoriesforResearchTopicsontheWebsite.J.L.LemkeOnlineOffice.Martin,Bronwen&FelizitasRingham2000DictionaryofSemiotics.LondonandNewYork:Cassell.Miranda,Nobella2005WhatisMultiliteracy?MultiliteraciesforCollaborativeLearningEnvironent.:DesigningSocialFutures,inBillCopeandMaryKalantzis.Saussure,Ferdinandde1974CourseinGeneralLinguistics.Glasgow:Fontana.Scollon,Ron&Levine,Philip2004MultimodalDiscourseAnalysisastheConfluenceofDiscourseandTechnology.WashingtonDC.:GeorgetownUniversityPress.Simpson,J.E.B.2003BALL/CUPSeminaronMultimodalityandAppliedLinguistics.London,Reading,UnitedKingdom,18/July/2003-19/July/2003.Spiliotopoulos,Vakua2005DevelopingMultiliteracyinAdultESLLearnersUsingOn2lineForums,InternationalJournaloftheHumanities.Thibault,Paul2004BodyDynamicsandtheMultimodalIntegrationofMeaningacrossSpace2timeScales,Apaper9presentedatthe9thInternationalPragmaticsConferenceWilliamson,Ben2005WhatAreMultimodality,MultisemioticsandMultiliteracies?-ABriefGuidetoSomeJar2gon.NESTAFuturelab.Online.MultimodalizationinSocialSemioticsAbstractSaussureslinguisticsemioticshasbeenanimmensecontributiontothedevelop2mentofgeneralsemiotics,buthasmetchallengesfromsomer