周六英語教育測量與評價-基本課件20133intro

WhataretheConditionsofExcellenceinEducation?StudentInvolvementHighExpectationsAssessment&Feedback英語教育測量與評價基本概念

EducationalAssessmentSummativeAssessmentFormativeAssessmentAlternativeAssessmentClassroom-BasedEvaluationinSecondLanguageEducation

byFredGeneseeandJohnaA.Upsyhur1Preface:IntroductiontoEvaluation;PARTI:GETTINGSTARTED;2TheContextofSecondLanguageEvaluation;3AFrameworkforEvaluation;4CollectingInformation;PARTII:EVALUATINGWITHOUTTESTS;5ObservationintheClassroom;6PortfoliosandConferences;7Journals,Questionnaires,andInterviews;PARTIII:EvaluatingWithTests;8Testing;9Objectives-referencedTesting;10DevisingTestTasks;11AssemblingandScoringTests;12InterpretingTestScores;13StandardizedTests;14SummaryandIntegrationTheterm‘a(chǎn)ssessment’referstoallthoseactivitiesundertakenbyteachers,andbytheirstudentsinassessingthemselves,whichprovideinformationtobeusedasfeedbacktomodifytheteachingandlearningactivitiesinwhichtheyareengaged.Educatorshavedifferentiatedassessmentaccordingtoitspurpose:Assessmentforlearning,Assessmentaslearning,Assessmentoflearning;Diagnosticassessment,Formativeassessment,Summativeassessment;SummativeassessmentTraditionalAssessmentMethods:EvaluatingwithTestsTakesplaceattheendofapredeterminedperiodofinstruction(forexample,mid-term,final)Ratesthestudentinrelationtoanexternalstandardofcorrectness(howmanyrightanswersaregiven)IstheapproachtakenbymosttraditionalandstandardizedtestsFormativeassessmentTakesplaceonanongoingbasisasinstructionisproceedingRatesthestudentintermsoffunctionalabilitytocommunicate,usingcriteriathatthestudenthashelpedtoidentifyHelpsstudentsrecognizewaysofimprovingtheirlearningIstheapproachtakenbyalternativeassessmentmethodsAlternativeAssessment

Whenthegoaloflanguageinstructionisthedevelopmentofcommunicativecompetence,instructorscansupplement(or,insomecases,replace)traditionaltestswithalternativeassessmentmethodsthatprovidemoreaccuratemeasuresofprogresstowardcommunicationproficiencygoals.Thiscanbedonebycombiningformativeandsummativetypesofassessment.Dr.JamesE.Alatis

DeanEmeritus,SchoolofLanguagesandLinguistics,GeorgetownUniversity

“AlternativeAssessment”尚未收入詞典，目前無既定譯法:“多重選擇的評價方式”？/選擇性評價/另類評價=formativeassessment?Featuresofalternativeassessment:Assessmentisbasedonauthentictasksthatdemonstratelearners'abilitytoplishcommunicationgoalsInstructorandlearnersfocusoncommunication,notonrightandwronganswersLearnershelptosetthecriteriaforsuccessfulcompletionofcommunicationtasksLearnershaveopportunitiestoassessthemselvesandtheirpeersAlternativeassessmentusesactivitiesthatrevealwhatstudentscandowithlanguage,emphasizingtheirstrengthsinsteadoftheirweaknesses.Alternativeassessmentinstrumentsarenotonlydesignedandstructureddifferentlyfromtraditionaltests,butarealsogradedorscoreddifferently.Becausealternativeassessmentisperformancebased,ithelpsinstructorsemphasizethatthepointoflanguagelearningiscommunicationformeaningfulpurposes.Alternativeassessmentmethodsworkwellinlearner-centeredclassroomsbecausetheyarebasedontheideathatstudentscanevaluatetheirownlearningandlearnfromtheevaluationprocess.Thesemethodsgivelearnersopportunitiestoreflectonboththeirlinguisticdevelopmentandtheirlearningprocesses(whathelpsthemlearnandwhatmighthelpthemlearnbetter).Alternativeassessmentthusgivesinstructorsawaytoconnectassessmentwithreviewoflearningstrategies.Thefollowingcriteriadefineauthenticassessmentactivities:TheyarebuiltaroundtopicsorissuesofinteresttothestudentsTheyreplicatereal-worldcommunicationcontextsandsituationsTheyinvolvemulti-stagetasksandrealproblemsthatrequirecreativeuseoflanguageratherthansimplerepetitionTheyrequirelearnerstoproduceaqualityproductorperformanceTheirevaluationcriteriaandstandardsareknowntothestudentTheyinvolveinteractionbetweenassessor(instructor,peers,self)andpersonassessedTheyallowforself-evaluationandself-correctionastheyproceedAlternativeassessmentisgroupedintothreeareas:observation;portfoliosandconferences;journals,questionnaires,andinterviews.Classroom-basedevaluationinsecondlanguageeducationbyFredGenesee&JohnA.Upshur(1996)，/test/news-topic.htm多元評價-多元評價理論

學(xué)習(xí)者的能力是多方面的,每個學(xué)習(xí)者都有各自優(yōu)勢.學(xué)生在意義建構(gòu)過程活動中,表現(xiàn)出來的能力不是單一維度的數(shù)值反映,而是對多維度、綜合能力的體現(xiàn),因此對學(xué)生學(xué)習(xí)評價應(yīng)該是多方面的.多元評價理論體現(xiàn)了主體多元化,內(nèi)容多維化,方法多樣化,促進(jìn)學(xué)生全面發(fā)展.評價主體多元化評價主體是指那些參與教育評價活動并按照一定的標(biāo)準(zhǔn)對評價客體進(jìn)行價值判斷的個人或團(tuán)體評價主體多元化主要體現(xiàn)在:參與評價活動的人除了教師外,還可以包括專職的評價機(jī)構(gòu)、教育決策機(jī)構(gòu)、學(xué)校管理人員、學(xué)生家長、學(xué)生群體和個體以及學(xué)校以外的其他有關(guān)人員[3].充分發(fā)揮評價主體的作用,使評價結(jié)果更為客觀,激發(fā)學(xué)生的學(xué)習(xí)積極性.評價內(nèi)容多維化美國心理學(xué)家加德納的多元智能理論認(rèn)為人至少有7種智能:語言智能、人際關(guān)系智能、音樂智能、自我認(rèn)識智能、身體運動智能、空間智能、邏輯數(shù)學(xué)智能[4-5].在這7種智能中每個人都各有所長,不能單獨從一個方面去評價學(xué)生技能的高低,而應(yīng)綜合各方面內(nèi)容對學(xué)生進(jìn)行評價.后來他又在其模型中加入第八種智能——自然智能評價方法多樣化依據(jù)評價主體不同,可采用自我評價和他人評價.自我評價是學(xué)習(xí)者按照一定的評價目的與標(biāo)準(zhǔn),對自身的工作、學(xué)習(xí)、品德等方面的表現(xiàn)進(jìn)行價值判斷;他評是指學(xué)習(xí)者以外的人所進(jìn)行的評價.自我評價能充分調(diào)動學(xué)生學(xué)習(xí)積極性,而他人評價可信度較高,具有一定權(quán)威性.依據(jù)評價內(nèi)容不同,可采用量化評價和質(zhì)性評價.量化評價是指運用數(shù)學(xué)、統(tǒng)計學(xué)工具,收集、處理評價對象的資料,通過數(shù)量化的分析和計算,進(jìn)而對評價對象做出價值判斷的評價方法,一般包括標(biāo)準(zhǔn)化測驗、常模測驗等;質(zhì)性評價是指確定評價對象主流是否積極、方向是否正確而對某些細(xì)節(jié)和小的利弊得失采取模糊評價的方法,一般包括課堂的行為記錄、項目調(diào)查、書面報告、作業(yè)、學(xué)習(xí)態(tài)度等方法.依據(jù)評價手段不同,可采用人工評價和計算機(jī)評價.Moreaboutassessments

Assessmentforlearningcomprisestwophases—initialordiagnosticassessmentandformativeassessmentassessmentcanbebasedonavarietyofinformationsources(e.g.,portfolios,worksinprogress,teacherobservation,conversation)verbalorwrittenfeedbacktothestudentisprimarilydescriptiveandemphasizesstrengths,identifieschallenges,andpointstonextstepsasteacherscheckonunderstandingtheyadjusttheirinstructiontokeepstudentsontracknogradesorscoresaregiven-record-keepingisprimarilyanecdotalanddescriptiveoccursthroughoutthelearningprocess,fromtheoutsetofthecourseofstudytothetimeofsummativeassessmentMoreaboutassessments

AssessmentaslearningAssessmentaslearningbeginsasstudentseawareofthegoalsofinstructionandthecriteriaforperformanceinvolvesgoal-setting,monitoringprogress,andreflectingonresultsimpliesstudentownershipandresponsibilityformovinghisorherthinkingforward(metacognition)occursthroughoutthelearningprocessMoreaboutassessments

AssessmentoflearningAssessmentoflearningassessmentthatispaniedbyanumberorlettergrade(summative)comparesonestudent’sachievementwithstandardsresultscanbecommunicatedtothestudentandparentsoccursattheendofthelearningunitFromWikipedia,thefreeencyclopediaMoreaboutassessments

DiagnosticassessmentDiagnosticassessment(nowreferredtomoreoftenas"pre-assessment")assessmentmadetodeterminewhatastudentdoesanddoesnotknowaboutatopicassessmentmadetodetermineastudent'slearningstyleorpreferencesusedtodeterminehowwellastudentcanperformacertainsetofskillsrelatedtoaparticularsubjectorgroupofsubjectsoccursatthebeginningofaunitofstudyusedtoinforminstruction:makesuptheinitialphaseofassessmentMoreaboutassessments

Formativevs.SummativeassessmentFormativeassessmentassessmentmadetodetermineastudent’sknowledgeandskills,includinglearninggapsastheyprogressthroughaunitofstudyusedtoinforminstructionandguidelearningoccursduringthecourseofaunitofstudymakesupthesubsequentphaseofassessmentforlearningSummativeassessmentassessmentthatismadeattheendofaunitofstudytodeterminethelevelofunderstandingthestudenthasachievedincludesamarkorgradeagainstanexpectedstandardTHEBIG5PRINCIPLESOF

ASSESSMENTFORLEARNING1.Theprovisionofeffectivefeedbacktostudents.2.Theactiveinvolvementofstudentsintheirownlearning.3.Adjustingteachingtotakeaccountoftheresultsofassessment.4.Recognitionoftheprofoundinfluenceassessmenthasonthemotivationandselfesteemofpupils,bothofwhicharecriticalinfluencesonlearning.5.Theneedforstudentstobeabletoassessthemselvesandunderstandhowtoimprove.

TheUkAssessmentReformGroup(1999)

SomeBasicterminology

Test,Measurement,andEvaluation

Thetestisthesetofquestions,measurementistheassigningofnumberstothetestresultaccordingtoaspecificrule(countingcorrectanswers),andevaluation(thesystematicgatheringofinformationinordertomakeadecision)addsthevaluejudgment(goodlearningprogress).☆Source:MeasurementandEvaluationinTeaching,NormanE.Gronlund,1990Test,Measurement,andEvaluationIITestisaninstrumentusedineducationalassessmenttodeterminehowwellorbadastudenthasmasteredlearningobjectivesinparticularsubjecttaught,whilemeasurementisgradingthetestscorestodeterminethestudent’sstrengthandweaknessthroughawardsofmarksintheformissymbolswithcorrespondingpercentages,thenevaluationisthejudgmentalassessmentastowhetheractivityisattainingtheintendedoutcomesornotsotodeterminethewayforward.Test,Measurement,andEvaluationIIITest:Aninstrument

手段orsystematicprocedureformeasuringasampleofbehavior.(Answersthequestion“Howwelldoestheindividualperform---eitherincomparisonwithothersorincomparisonwithadomainofperformancetask?”)Measurement:Theprocessofobtaininganumericaldescriptionofthedegreetowhichanindividualprocessesaparticularcharacteristic.(answersthequestion“Howmuch?”)Evaluation:thesystematicprocessofcollecting,analyzing,andinterpretinginformationtodeterminetheextenttowhichlearnersareachievinginstructionalobjectives.(Answersthequestion“Howgood?”)Measurement,

Assessment&EvaluationMeasurementistheprocessofgatheringdata,

evaluationistheprocessofmakingjudgmentaboutthosedata.Assessmentisinformationgatheredbytheteacherandstudenttodriveinstruction,whileevaluationiswhenateacherusessomeinstrument(suchastheCMToranend-of-unittest)torateastudentsothatthisinformationcanbeusedtocompareorsortstudents.

Assessmentisforthestudentandtheteacherintheactoflearningwhileevaluationisusuallyforothers.

thedifferencebetweenassessmentandevaluation---anotherperspectiveAssessmentanswersthequestionofwhat.Ifyoutakethingsatfacevalue,whatisgoingon?

Forexample"assessingthesituation"wouldmeanyoulookatthingslike

-whereareyou(ifyoucantellimmediately)

-whatareyoursurroundings

-whatcolourarethewalls

-howbigisthespace

-whatobjectsarethere

-isthereanyoneelsethere

-doesitlookfamiliar

Peopleliketousethewordsinterchangeablysometimes."Employeeassessment"and"Employeeevaluation"areprettymuchexactlythesamething.

Evaluation

answersdeeperquestions(especiallywhyandhow)andaddressesthingsthattakeanalyticthinking.Thesearethingsyouhavetofigureout.Thistypicallytakesplaceafteryouhavealreadyassessedthings.

"evaluatingthesituation"wouldmeanyoufigureoutthingslike;

-whereyouare(fromclues)

-whyareyouthereinthefirstplace

-howcanyouimprovethesituation

-howcanyouuseobjectsaroundyou

-whatisgood/badaboutyourposition

-wherecanyougonext

Therearelotsofoverlapsbetweenthetwowords,but"what"vs"howandwhy"canbeagoodwaytothinkaboutit.

Assessmentvs.TestTest:Asingleexamination/setofquestionstowhichthestudentrespondedandtheresultsofthese.

Assessment:Asummaryoftests,learningresults,lessonscarriedoutalongwithotheractivitiesthatrelatetoastudent.Assessmentsmeasurestudentachievement(knowledge,skills,andabilities)intheLearningStandards;atestisonemethodofassessment,oftenusedasasummativemeasure.

Assessmentisoftenusedinterchangeablywithtesting,butalsousedmorebroadlytopassthegatheringoflanguagedataforthepurposeofevaluationthroughassessmentofthelearners,thewholeteachingoperationincludingcurriculum,methods,resources,plansandstaffing人員供給.Source:AlanDavies,DictionaryofLanguageTesting,CambridgeUniversityPress,1999DistinctionbetweenAssessmentEvaluation,MeasurementandTest---moreTest:Amethodtodetermineastudent'sabilitytocompletecertaintasksordemonstratemasteryofaskillorknowledgeofcontent.Sometypeswouldbemultiplechoicetests,oraweeklyspellingtest.

Whileitiscommonlyused

interchangeably

withassessment,orevenevaluation,itcanbedistinguishedbythefactthatatestisoneformofanassessment.Assessment:Theprocessofgatheringinformationtomonitorprogressandmakeeducationaldecisionsif

necessary.Asnotedinmydefinitionoftest,anassessmentmayincludeatest,butalsoincludesmethodssuchasobservations,interviews,behaviormonitoring,etc.Evaluation:

Proceduresusedtodeterminewhetherthesubject(i.e.student)meetsapresetcriteria,suchasqualifyingforspecialeducationservices.Thisusesassessment(rememberthatanassessmentmaybeatest)tomakeadeterminationofqualificationinaccordancewithapredeterminedcriteria.Measurement,beyonditsgeneraldefinition（theprocessofgatheringdata）,referstothesetofproceduresandtheprinciplesforhowtousetheproceduresineducationaltestsandassessments.

Someofthebasicprinciplesofmeasurementineducationalevaluationswouldberawscores,percentileranks,derivedscores,standardscores,etc.Reference:AssessingLearnerswithSpecialNeeds:6THED.ByTerryOvertonRelationshipsamongmeasurement,testsandevaluation

---MoreauthoritativeArea1:Anexampleofevaluationthatdoesn’tinvolveeithertestsormeasuresistheuseofqualitativedescriptionsofstudentperformancefordiagnosinglearningproblems;Area2:Anexampleofnone-testmeasureforevaluationisateacherrankingusedforassigninggrades;Area3:Anexampleofatestusedforpurposeofevaluationistheuseofachievementtesttodeterminestudentprogress;Area4:AnexampleofteststhatarenotusedforevaluationistheuseofaproficiencytestasacriterioninSLAresearch;Area5:Anexampleofanone-testmeasurethatisnotusedforevaluation;fromBachman,

FundamentalConsiderationsinLanguageTesting,P23-

EVALUATION

MEASUREMENT

TEST

12345Relationshipsamongmeasurement,testsandevaluation

解讀---劉潤清（區(qū)域1）有的評價不一定用到測試或測量，這種評價屬于質(zhì)量評價，或叫定性評價，如指出學(xué)生在學(xué)習(xí)方面存在的問題；（區(qū)域2）有時在作出評價時只需測量而無需測試，如對學(xué)生的口頭表達(dá)能力定出級別；（區(qū)域3）只通過測試對學(xué)生的成績作出評價；（區(qū)域4）有時，測試只是作為科研的工具或手段，而不是用來作出評價，如作為研究工具的水平測試；（區(qū)域5）不用測試便可進(jìn)行測量的情況。如在研究來自不同國家的學(xué)生的二語習(xí)得時，按母語情況編號分類；Notallmeasuresaretests,notalltestsareevaluative,andnotallevaluationinvolveseithermeasurementortest.

總之，并非所有的測量都是測試，并非所有的測試都屬于評價，而且并非所有的評價活動都涉及到是測試或測量。

Examinationvs.TestExaminationisoftenusedsynonymouslywith‘test’.Thetermexaminationismorelikelytobeusedforsyllabus-relatedassessment.Onthebasisoftheassessmentformat:objective,discrete-pointtypesofassessmentaremorelikelytobetermed‘test’;subjectiveassessmentsareoftentermed‘examination’.

AnotherapproachtothedifferentiationsMeasurementinLanguageTeaching:RespondingtoresearchpurposesAssessmentinLanguageTeaching:RespondingtoeducativepurposesEvaluationinLanguageTeaching:RespondingtoprogrampurposesAssessment,measurement,andEvaluationinTBLT:EssentialrolesTBLTinsituMeasurementTheory,ResearchAssessmentImple-mentationEvaluationSociety,ValueEMPIRICALPRACTICEMeasurementinTBLT:RespondingtoresearchpurposesWhatismeasurement?…trustworthydefinition,elicitation,observation,analysis,andinterpretationofresearchconstructs…MeasurementinTBLT:RespondingtoresearchpurposesMeasurementshould…Illuminatetask-basedlearning…L2ask,overtasksNoticing,integrating,automatizingProficiency,motivation,aptitudeTiming,sequencing,embeddingTBIFonF,modeling,feedbackReliablereportingofTBLvariablesSynthesisofhowTBLworksDefineclearlearningesIdentifyspecificlearningprocessesClarifylearnerindividualdifferencesIndicateeffectsofcontextfeaturesArticulateinstructionalprocessesEnablecommunicationoffindingsFosteraccumulationofknowledgeInshort…TBLTTheory/researchConstructsLearnervariablesSettingvariablesLearningprocessInstructionprocessLearningesPracticeEmpiricalMeasurementMeasurementinTBLT:RespondingtoresearchpurposesHowdoesTBLTwork,forwhom,when,why?AssessmentinTBLT:RespondingtoeducativepurposesWhatisassessment?…theuseoftestsandotherproceduresforgatheringtrustwort