A Study on the Quality of Achievement Test Paper of Junior English英語專業(yè)畢業(yè)論文

1、a study on the quality of achievement test paper of junior english內容：abstract: based on the theory of bachman & palmers english language testing theory, this paper aims at analyzing the quality of achievement test papers of grade8 junior english from the perspective of test validity and reliability.

2、 then, it will make a further detail analysis about reading comprehension and propose some suggestions to improve this part.keywords: junior english testing, test validity, reliability1. introductionenglish language testing is one of the major parts in english teaching and a measurement of education

3、, which assesses the language ability and knowledge according to the result. thus, english tests have been considered as an assessment mechanism that stimulates the students to achieve more in english and obtain higher scores as well as help the teacher better evaluate the students achievements in e

4、nglish. the author chooses the terminal test papers of junior english as its object of study and probes into analyzing the test validity and reliability of the test paper. the detail analyses are displayed as follows.2. analysis of the quality of test paperwhen designing a test, the quality of test

5、is one of the most important issues that the teacher must pay more attention to. according to bachman & palmer (1999), the criteria for evaluating the quality of a test mainly include the five aspects such as reliability, validity, authenticity, interactiveness and impact. these five aspects are clo

6、sely related to junior english teaching, and is also the key point of this paper. in this paper, the author is intended to analyze the validity and reliability of this terminal achievement test paper for grade8 junior english.2.1. content of the test paperthe whole test consists of five parts: liste

7、ning comprehension, which occupies 20% of the total score. listening comprehension consists of three parts, sentence listening, dialogue listening and passage listening; multiple choice question, which occupies 15% of the total score; cloze, 10%; reading comprehension, 30%; task-based reading, 10%;

8、and the last part, writing, which occupies 15% of the total score.2.2. reliability estimatereliability is the extent to which test scores are consistent: a quality assessing whether candidates can get the same results on different dates (assuming there is no change in their ability). reliability is

9、a property of the test as a measuring instrument, but is also relative to the candidates taking the test: a test may be reliable with one population, but not with another. and next the author will make estimation about this test paper utilizing the instrument-spss.the following is the descriptive st

10、atistics of the results of the terminal junior test paper.graph1 統(tǒng)計量lcmcqclozerctbrwritingtsn有效40404040404040缺失0000000均值13.909.954.3025.004.505.8863.50中值14.009.504.0028.005.006.0066.50眾數1793286待添加的隱藏文字內容1867標準差3.4772.8642.2896.4213.2263.61814.915方差12.0928.2035.24141.23110.41013.087222.462偏度-.605-.71

11、2.164-1.840-.005.045-.916偏度的標準誤.374.374.374.374.374.374.374峰度-.532.302-1.1052.720-1.203-.903.728峰度的標準誤.733.733.733.733.733.733.733極小值63160024極大值1915830101387where: lc=listening comprehension, mcq=multiple choice question, rc=reading comprehension, tbr=task-based reading, ts=total score.and the follo

12、wing one is the normal distribution of the students total scores:graph2from the value of skewness and kurtosis, and the normal distribution of the total score, it can be discovered that the test scores are normally distributed. from the graph, it can be seen that the skewness is -0.916 and kurtosis

13、0.728, according to the english language testing theory, values for skewness and kurtosis of between -2 and+2 indicate a reasonable normal distribution. that is to say, the data of this paper is reliable. and the standard deviation of this test paper is 14.915, which indicates that the discriminatio

14、n of students scores is big. therefore, we can say that the test results are reliable and can reflect test takers language ability and are also the basis for guarantee the whole test papers validity. however, the mean of the fourth part (reading comprehension) is 25point, whose total score is 30 poi

15、nt, and the highest score is 30 point, the lowest one is 6 point. it is because most of the students are familiar with the material of the selected articles in the fourth part. the kurtosis of rc is 2.720, it is a positive kurtosis and indicates that this part is a little easy, and the discriminatio

16、n of students score is small. the detail analysis of this part will be analyzed later. 2.3. validity analysis briefly, the validity of a test is the extent to which it measures what it is supposed to measure and nothing else. every test, whether it is a short, informal classroom test or a public exa

17、mination, should be as valid as the constructor can make it (heaton, 2000). there are several measures examining validity of a test such as face validity, content validity, concurrent validity, predicative validity, response validity and construct validity.the following graph shows the correlation c

18、oefficients among different parts as well as between each part and the total score of this test paper. graph3相關性lcmcqclozerctbrwritingtslcpearson 相關性1.453*.291.485*.644*.476*.829*顯著性（雙側）.003.069.002.000.002.000n40404040404040mcqpearson 相關性.453*1.284.346*.158-.105.497*顯著性（雙側）.003.076.029.330.521.001n

19、40404040404040clozepearson 相關性.291.2841.391*.181-.020.475*顯著性（雙側）.069.076.013.265.902.002n40404040404040rcpearson 相關性.485*.346*.391*1.248.363*.813*顯著性（雙側）.002.029.013.124.021.000n40404040404040tbrpearson 相關性.644*.158.181.2481.515*.656*顯著性（雙側）.000.330.265.124.001.000n40404040404040writingpearson 相關性.

20、476*-.105-.020.363*.515*1.600*顯著性（雙側）.002.521.902.021.001.000n40404040404040tspearson 相關性.829*.497*.475*.813*.656*.600*1顯著性（雙側）.000.001.002.000.000.000n40404040404040*. 在 .01 水平（雙側）上顯著相關。*. 在 0.05 水平（雙側）上顯著相關。according to ferguson (2006), the correlation coefficients between each part and total scor

21、e should be higher than 0.7 and the correlation between parts should be 0.30.6. the above graph shows that the part-total correlation coefficients of the test paper is not very satisfactory, only the correlation coefficients between reading comprehension or listening comprehension and the total scor

22、e are above 0.7. what more, the correlation coefficients between parts is not satisfied with the standard of 0.3-0.6, which indicates that the construct validity of this test paper is very low. 3. detail analysis about reading comprehensionthis part consists of three passages, the first passage is j

23、ust an introduction about the american museum of national history, the second one is a brief introduction about tea, and the third one is about the celebrity li shizhen. the total score of this part is 30 point, which occupies 30% of the total score. 3.1. data collectionin this paper, the author has

24、 selected 40 students as its object of study, which can guarantee the validity of the data in order that the further analysis can be carried out on the basis of these dates.graph4rc頻率百分比有效百分比累積百分比有效625.05.05.01012.52.57.51637.57.515.02025.05.020.02212.52.522.52412.52.525.026717.517.542.5281435.035.0

25、77.530922.522.5100.0合計40100.0100.03.2. reliability analysisthe following graph is the descriptive statistics of the results of the part of reading comprehension. graph5統(tǒng)計量rcn有效40缺失0均值25.00中值28.00眾數28標準差6.421方差41.231偏度-1.840偏度的標準誤.374峰度2.720峰度的標準誤.733極小值6極大值30from the above graph, it can be easily se

26、en that, the medium, mode and mean is 28.00, 28, and 25.00. according to the above introduction, it is known to us all that the total score of reading comprehension is 30 point, therefore, the medium, mode and mean is very high. the skewnes of this part is -1.840 and the kurtosis 2.720. however, onl

27、y if the values of skewness and kurtosis are between -2 and +2, which can indicate a normal distribution. whats more, the standard deviation is 6.421 indicating that the discrimination of students score is low. and it can also be inferred from the following graph6- the normal distribution of reading

28、 comprehension.graph6there are four variants of normal distribution, in terms of skewness, it can be classified into positively skewed distribution and negatively skewed distribution. the former one indicates that there are more scores below the mean and the test or the part is difficult, the latter

29、 one indicates that there are more scores above the mean and the test or the part is easy. and another two types are classified in terms of kurtosis, it can be classified into negative kurtosis and positive kurtosis. the former one indicates that the discrimination of students score is big while the

30、 latter one indicates that the discrimination of students score is small. from the graph4, graph5 and graph6, it is clearly seen that 75% of the scores of rc part is above the mean 25.00, the skewness is -1.840, approximating to -2 and the normal distribution is a negatively skewed one. all the evid

31、ences indicate that the reading comprehension part is easy; the discrimination of students score in this part is small.3.3. the detail analysis of reading comprehensionthis part consists of three passages. lets take one of the passages for example:passage athe american museum of national historyaddr

32、ess: central park westside 70th st., new yorktelephone number: 212222-3500traffic: you can get there by bus, subway or car.parking: there is a small parking lot (停車場). you have to pay $7.75 per day, but it is often full. parking in the neighborhood is also limited (有限的).open hours: 10:00am - 5:45pm

33、(sunday, monday, and tuesday)10:00am - 9:00 pm (wednesday, thursday, friday and saturday)the museum is open every day of the year except christmas day and thanksgiving day.ticket price: $3.20 for grown-ups, one-fourth (四分之一) for children, and free on friday and saturday evening from 5:00 pm to 9:00

34、pm.46. the american museum of national history is in_.a. florida b. washington c. boston d. new york47. you can reach the american museum of national history_a. by bus, train, or air b. by bus, subway, or car c. by bus, train, or ship d. by bus, subway, or shipit is clearly seen that this passage is

35、 easy, and the students can easily obtain some important and useful information directly from this passage. for example, the stem no.46 is just a question searching for the address of the american museum of national history. it is easy for students to find the answer in the first line of this passag

36、e. whats more, the design of the four options is very easy. it is the same case with the stem no. 47.and the following two passages in this part are also easy to understand. thats the reason why the kurtosis of this part exceeded the normal range of kurtosis (-22).in order to raise the validity of t

37、his part and improve the quality of junior english test paper, some suggestions are proposed in this paper as follows:in terms of selecting article, this part should include diversified kinds of articles, such as some easy economic, political articles and literary works. on one hand, it can reflect

38、the requirements of the test and on the other hand, it can raise the discrimination degree of this part. consequently, it can test most of the students real english proficiency.whats more, when designing the options of every stem, first, some of the stems should not always be direct but can be technically designed; second, the options must include some distractions, and the distractions must be reasonable. thus, it can rais