性能測(cè)試用例模版

1、測(cè)試用例模板測(cè)試用例仃est case)用例名稱用例編號(hào)重要程度用例設(shè)計(jì)人代碼負(fù)責(zé)人測(cè)試人測(cè)試時(shí)間En glish versi onTitleCase ID LevelDesig ner DeveloperTester Time測(cè)試場(chǎng)景描述(Case seen ario)場(chǎng)景描述子場(chǎng)景(可選)子場(chǎng)景1例如，返回10條記錄子場(chǎng)景2例如，返回100條記錄測(cè)試流程(Test ing process)描述被測(cè)試應(yīng)用場(chǎng)景的商業(yè)流程，流程必須在實(shí)際測(cè)試中發(fā)揮良好的導(dǎo)航作用，使不熟悉該系統(tǒng)的使用者能夠?qū)ι虡I(yè)流程有清晰的了解。(被測(cè)的商業(yè)流程應(yīng)該事先通過檢測(cè)，以確保功能的順利運(yùn)行。應(yīng)用程序代碼在測(cè)試階段應(yīng)該被

2、 凍結(jié))1 .2 .3 .測(cè)試條件和要求(Requireme nts)環(huán)境要求硬件要求：WEB服務(wù)器-配置1.2 (詳細(xì)配置信息見測(cè)試計(jì)劃文檔，或附錄 )軟件要求：補(bǔ)丁要求：網(wǎng)絡(luò)要求：性能基線和衡量指標(biāo)(Testi ng basel ine & metrics)前提（測(cè)試結(jié)果有效的先決條件 ）1. 例如：無內(nèi)存泄漏；HTTP錯(cuò)誤個(gè)數(shù)為02. 數(shù)據(jù)庫數(shù)據(jù)要求例如：流水表已有20萬條記錄3. 并發(fā)連接數(shù)要求4. 測(cè)試周期或測(cè)試次數(shù)性能基線1. 例如：每秒鐘完成XXX筆交易2.3.監(jiān)視參數(shù)（詳情見附錄）1. 例如：Performanee Monitor: Private Byte2.3.性能

3、計(jì)算方式1. 例如：數(shù)據(jù)庫交易表增加紀(jì)錄數(shù)/總時(shí)間（秒）2.3.測(cè)試數(shù)據(jù)和腳本（Testing data, Scripts）測(cè)試數(shù)據(jù)準(zhǔn)備包括登陸賬號(hào)組，輸入數(shù)據(jù)；可以事先保存在某個(gè)文本文件中測(cè)試數(shù)據(jù)庫數(shù)據(jù)庫、表、存儲(chǔ)過程、視圖、用戶帳號(hào)、相關(guān)數(shù)據(jù)測(cè)試腳本根據(jù)測(cè)試工具編寫相應(yīng)腳本或編寫手工測(cè)試腳本for Example1LBrowser1. Navigate to the home page of the On li ne Shopp ing site.2. Click“ Help. ”3. Click“ FAQ. ”4. Click “ Shopping” on FAQ.5. Click “

4、Shopping/Our Products” on the main menu.6. Click “ Product Search. ”7. Click “ Special Offers.”8. Click “ Store Finder. ”9. Click Cen tral Scotia nd to view shop addresses.10. Click“Edinburgh”to see details.11. Click“After Sales.”12. Click“Basket. ”13. Navigate to the home page of the On li ne Shopp

5、 ing site.14. Click on Advert at bottom of page.測(cè)試手段仃 est ing in strume nt)例如：編寫自動(dòng)測(cè)試工具或使用專用測(cè)試工具。備注(Remarks)附錄A -應(yīng)用軟件性能數(shù)據(jù)分類4.1應(yīng)用軟件性能數(shù)據(jù)概述在企業(yè)級(jí)應(yīng)用的負(fù)載測(cè)試過程中，測(cè)試工具通過部署一整套性能監(jiān)視器， 來收集和顯示各個(gè)架構(gòu) 層次、服務(wù)器和組件上的性能數(shù)據(jù)，包括網(wǎng)絡(luò)、操作系統(tǒng)、應(yīng)用服務(wù)器、中間件、應(yīng)用程序、.NET 服務(wù)器、Web服務(wù)器和數(shù)據(jù)庫服務(wù)器。在進(jìn)行負(fù)載測(cè)試時(shí)，這些數(shù)據(jù)用來精確測(cè)量系統(tǒng)各個(gè)方 面的性能，從而用戶可以快速、簡(jiǎn)便地定位問題和瓶頸的來源。最終，這

6、些數(shù)據(jù)用來生成各種文 檔和圖表，并判斷出應(yīng)用程序的性能是否滿足業(yè)務(wù)的需要。4.2應(yīng)用軟件常用性能數(shù)據(jù)描述1. Number of Con curre nt Users (NCU)并發(fā)用戶數(shù)-在指定時(shí)刻，系統(tǒng)觀察到的并發(fā)用戶連接數(shù)。2. Request Per Seco nd (RPS)每秒處理請(qǐng)求數(shù)-指示服務(wù)器平均每秒鐘能處理的用戶事務(wù)請(qǐng)求數(shù)量。3. Resp onse Time響應(yīng)時(shí)間-指從客戶發(fā)出一個(gè)事務(wù)請(qǐng)求到收到處理結(jié)果的最后一個(gè)字節(jié)的時(shí)間長(zhǎng)度。4. Time to First Byte (TTFB)客戶端收到響應(yīng)的第一個(gè)字節(jié)的平均毫秒數(shù)。5. Time to Last Byte (TT

7、LB)客戶端收到響應(yīng)的最后一個(gè)字節(jié)的平均毫秒數(shù)。6. Thi nk Time思考時(shí)間-用戶在發(fā)送下一個(gè)請(qǐng)求前花在瀏覽頁面上的時(shí)間。7. Hits per Sec ond每秒點(diǎn)擊次數(shù)8. Throughput吞吐量-以kilobyte為單位，客戶每秒接收的數(shù)據(jù)總量。9. Pages per Second每秒下載頁數(shù)-每秒內(nèi)從Web服務(wù)器上下載到客戶端的 Web頁面數(shù)量。10. User-defi ne Data Poin t (supported by LoadRu nner)用戶自定義性能指標(biāo) -由LoadRunner支持的自定義性能指標(biāo)，比如：TransactionResp onse Tim

8、e, Tran sacti on Per Second Passed, Failed。11. %Processor Time:CPU平均利用率12. %User Time:用戶態(tài)CPU平均利用率13. % Privileged Time:核心態(tài) CPU平均利用率14. Processor Queue Len gth:處理器隊(duì)列中的線程數(shù)15. Co ntext Switches per Seco nd:每秒線程切換次數(shù)16. I nterrupts/Sec:每秒中斷數(shù)17. Page Faults / sec:每秒內(nèi)存換頁數(shù)18. Memory, Available Bytes:平均剩余的可用

9、內(nèi)存19. Private Bytes:進(jìn)程分配內(nèi)存數(shù)20. Process, Han dle Cou nt:進(jìn)程使用系統(tǒng)句柄數(shù)21. Memory, Pool Paged Bytes:可交換到硬盤的系統(tǒng)物理內(nèi)存byte 數(shù)。22. Memory, Pool Non-paged Bytes:不可交換到硬盤的系統(tǒng)物理內(nèi)存byte數(shù)23. Network In terface, bytes total/sec:網(wǎng)絡(luò)帶寬利用率24. Network In terface, Output Queue Len gth:網(wǎng)絡(luò)適配器輸岀隊(duì)列長(zhǎng)度物理磁盤利用率25. Physical Disk, %Disk

10、Time:物理磁盤平均磁盤I/O隊(duì)列長(zhǎng)度物理磁盤當(dāng)前磁盤I/O隊(duì)列長(zhǎng)度物理磁盤每秒讀/寫操作次數(shù)調(diào)用級(jí)別驗(yàn)證成功頻率調(diào)用級(jí)別驗(yàn)證失敗的頻率26. Physical Disk, Avg Disk Queue Len gth:27. Physical Disk, Current Disk Queue Length:28. Physical Disk, Disk Read/Sec, Disk Write/Sec:29. COM+ Authe nticate (by LoadRu nn er):COM+30. COM+ Authe nticate Failed (by LoadRu nn er):CO

11、M+COM+ Activation (by LoadRu nn er):COM+COM+ Failed (by LoadRu nn er):COM+COM+ Thread Start (by LoadRu nn er):STACOM+ Thread Termi nate (by LoadRu nn er):STATran saction Duratio n (by LoadRu nn er):COM+Tran saction Start (by LoadRu nn er):COM+Tran sacti on Prepared (by LoadRu nn er):COM+Tran saction

12、 Aborted (by LoadRu nn er):COM+Tran saction Commited (by LoadRu nn er):COM+Object LifeTime(by LoadRu nn er):COM+Object Create (by LoadRu nn er):創(chuàng)建應(yīng)用激活頻率應(yīng)用關(guān)閉頻率的線程啟動(dòng)的比率的線程中止的比率事務(wù)的平均周期事務(wù)啟動(dòng)比率事務(wù)進(jìn)入準(zhǔn)備階段的比率事務(wù)回滾的比率事務(wù)提交的比率組件平均生命期COM+組件實(shí)例的比率2.53.5

13、7.58.Object Destroy (by LoadRu nn er):釋放COM+組件實(shí)例的比率對(duì)象激活的比率對(duì)象失活的比率Object Activate (by LoadRu nn er):COM+ JIT-activedObject Deactivate (by LoadRu nn er):COM+ JIT-activedDisable Commit (by LoadRu nn er):COM+ 對(duì)象處于DisableCommit 狀態(tài)的比率對(duì)象處于Enable 狀態(tài)的比率En able Commit (by LoadRu nn er):COM+Set Comple

14、te (by LoadRu nn er):COM+ 對(duì)象處于SetComplete 狀態(tài)的比率Set Abort (by LoadRu nn er)COM+對(duì)象處于SetAbort 狀態(tài)的比率COM+ Method Duratio n (by LoadRu nn er):COM+方法調(diào)用平均持續(xù)時(shí)間COM+ Method Freque ncy (by LoadRu nn er):COM+方法調(diào)用頻率COM+ Method Failed (by LoadRu nn er):COM+方法失敗的頻率COM+ Method Exception (by LoadRu nn er):COM+方法拋出異常的

15、頻率Active Server Page, Request per Sec on d:ASP每秒執(zhí)行請(qǐng)求數(shù)Active Server Page, Request Queue:ASP請(qǐng)求隊(duì)列長(zhǎng)度Active Server Page, Requests Execute Time:ASP平均請(qǐng)求執(zhí)行時(shí)間Active Server Page, Requests Wait Time:ASP平均請(qǐng)求等待時(shí)間Active Server Page, Sessi on Curre nt:當(dāng)前活動(dòng)Sessi on 計(jì)數(shù).NET CLR Data, SqlClient, Current # Pooled Conne

16、ction:當(dāng)前被連接池緩存的數(shù)據(jù)庫連接59. .NET CLR Data, SqlClie nt, Curre nt # Pooled and Non-pooled Conn ection當(dāng)前所有的數(shù)據(jù)庫連接，緩存和未緩存的60. .NET CLR Memory, Gen 0、1、2 heap size:.NET 中0、1、2代虛擬堆的大小61. .NET CLR Memory, # bytes in all Heaps:.NET中托管內(nèi)存的總數(shù)ASP.NET Applicatio n, Requests Executi ng:ASP.NET8.69.7

17、2.83.84.ASP.NET, Applicatio n Restarts:ASP.NETASP.NET, Work Process Restarts:ASP.NETASP.NET, Request Executi on Time:ASP.NETASP.NET, Request Wait Time:ASP.NETASP.NET, Requests Queued:ASP.NETASP.NET Applicati on, Requests/Sec:ASP.NETASP.NET Applicati on Sessi ons A

18、ctive:ASP.NETWeb Service, Get Requests per Sec on d:HTTPWeb Service, Post Requests per Seco nd:HTTP中應(yīng)用重新啟動(dòng)的次數(shù)中工作進(jìn)程重新啟動(dòng)的次數(shù)平均請(qǐng)求執(zhí)行時(shí)間毫秒數(shù)平均請(qǐng)求等待時(shí)間毫秒數(shù)平均請(qǐng)求隊(duì)列長(zhǎng)度某特定應(yīng)用每秒鐘處理的請(qǐng)求數(shù)某特定應(yīng)用正在執(zhí)行的請(qǐng)求數(shù) 某特定應(yīng)用中活動(dòng)的Session 數(shù)的GET方法每秒請(qǐng)求數(shù)的POST方法每秒請(qǐng)求數(shù)Distributed Transaction Coordinator, Transactions/Sec每秒的分布式事務(wù)數(shù)Distributed Tran s

19、acti on Coord in ator, Committed Tran sacti ons提交的分布式事務(wù)總數(shù)Distributed Tran sacti on Coord in ator, Aborted Tran sacti ons回滾的分布式事務(wù)總數(shù)Distributed Tran sacti on Coord in ator, Active Tran sacti ons當(dāng)前活動(dòng)的分布式事務(wù)數(shù)Distributed Tran sacti on Coord in ator, Resp onse Time-Average分布式事務(wù)從開始到提交的平均時(shí)間間隔SQL Server, Cach

20、e Man ager, Cache Hit Ratio:SQL Server的緩存區(qū)命中率SQL Server, Cache Man ager, Cache Used Counts per Sec ondSQL Server每秒內(nèi)使用的緩存對(duì)象數(shù)SQL Server, Locks, Exclusive/Shared & Users blockedSQL Server每秒內(nèi)用戶由于表級(jí)鎖被阻塞數(shù)SQL Server, % Procedure Cache Used & % Procedure Cache ActiveSQL Server存儲(chǔ)過程緩存使用率SQL Server, Tr

21、a nsactio n/Sec:SQL Server每秒的事務(wù)數(shù)SQL Server, Gen eral statistics, User Conn ecti onsSQL Server當(dāng)前用戶連接數(shù)SQL Profiler, Audit Logi n/LogoutSQL Profiler 中跟蹤用戶登入/登岀數(shù)SQL Profiler, Stored Procedure, RPC CompletedSQL Profiler中跟蹤存儲(chǔ)過程的調(diào)用85. SQL Profiler, TSQL, Batch Completed:SQL Profiler中跟蹤 TSQL 語句的調(diào)用86. SQL Pr

22、ofiler, SQL Tran sactio n:SQL Profiler中跟蹤事務(wù)的提交。4.3應(yīng)用軟件性能數(shù)據(jù)分類企業(yè)應(yīng)用程序可以根據(jù)系統(tǒng)架構(gòu)分成以下類型Client/Server -客戶機(jī)/服務(wù)器架構(gòu)ll基于瀏覽器/Web服務(wù)器的三層架構(gòu)基于中間件應(yīng)用服務(wù)器的三層架構(gòu)ll基于 Web服務(wù)器和中間件的多層架構(gòu)以上架構(gòu)都由客戶機(jī)、Web服務(wù)器、中間層應(yīng)用服務(wù)器、數(shù)據(jù)庫服務(wù)器組成。通過針對(duì)不同層次的性能指標(biāo)監(jiān)測(cè)，可以分析岀整體架構(gòu)的性能指標(biāo)和性能瓶頸。1 .數(shù)據(jù)庫服務(wù)器的性能指標(biāo)監(jiān)測(cè)l Processor, %Processor TimeProcessor, %User TimelProce

23、ssor, %l Privileged TimeProcessor, Processor Queue Len gthlSystem, Con textl Switches per SecondMemory, Page Faults/seclMemory, Availablel BytesMemory, Pool Paged ByteslNetwork In terface, bytes total/secll Network In terface, Output Queue Len gthPhysical Disk, %Disk Timell Physical Disk, Current Di

24、sk Queue LengthPhysical Disk, Avg Disk Queuel Len gthPhysical Disk, Disk Read/Sec, Disk Write/SeclSQL Server,l Gen eral statistics, User Conn ecti onsSQL Server, Tran sacti on/SeclSQLl Server, Cache Man ager, Cache Hit RatioSQL Server, Cache Manager, Cachel Used Counts per SecondSQL Server, Locks, E

25、xclusive/Sharedl & Users blockedSQL Server, % Procedure Cache Usedl & % Procedure Cache ActiveSQL Profiler, Audit Login/LogoutlSQL Profiler, Storedl Procedure, RPC CompletedSQL Profiler, TSQL, Batch CompletedlSQLl Profiler, SQL Tran saction2 . Web服務(wù)器的性能指標(biāo)監(jiān)測(cè)Processor, %Processorl TimeProcesso

26、r, %User TimelProcessor, % Privileged Timell Processor, Processor Queue Len gthSystem, Con text Switches per Secondll Process, Private BytesMemory, Page Faults/seclMemory, Availablel BytesMemory, Pool Paged ByteslNetwork In terface, bytes total/secll Network In terface, Output Queue Len gthPhysical

27、Disk, %Disk Timell Physical Disk, Avg Disk Queue Len gthNumber of Concurrent Users (NCU)ll Request Per Seco nd (RPS)Resp onse TimelTime to First Byte (TTFB)ll Time to Last Byte (TTLB)Thi nk TimelWeb Service, Get Requests perl SecondWeb Service, Post Requests per SecondlActive Server Page,l Request p

28、er Sec ondActive Server Page, Request QueuelActive Serverl Page, Requests Execute TimeActive Server Page, Requests Wait Timell Active Server Page, Sessi on Curre nt3 .基于ASP.NET的Web服務(wù)器或Web Service服務(wù)器性能指標(biāo)監(jiān)測(cè)Processor, %Processor TimelProcessor, %User Timell Processor, % Privileged TimeProcessor, Proces

29、sor Queue Len gthlSystemCon text Switches per SecondProcess, Private ByteslMemory, Pagel Faults/secMemory, Available ByteslMemory, Pool Paged Bytesll Network In terface, bytes total/secNetwork In terface, Output Queuel Len gthPhysical Disk, %Disk TimelPhysical Disk, Avg Disk Queuel Len gthNumber of

30、Concurrent Users (NCU)lRequest Per Seco nd (RPS)ll Resp onse TimeTime to First Byte (TTFB)lTime to Last Byte (TTLB)ll Thi nk TimeWeb Service, Get Requests per SecondlWeb Service, Postl Requests per SecondASP.NET, Application RestartslASP.NET, Workl Process RestartsASP.NET, Request Execution TimelASP

31、.NET, Request Waitl TimeASP.NET, Requests QueuedlASP.NET Applicatio n, Requests/Secll ASP.NET Application, Requests ExecutingASP.NET Applicati on Sessio nsl Active4 .中間層應(yīng)用服務(wù)器的性能指標(biāo)監(jiān)測(cè)Processor, %Processor TimelProcessor,l %User TimeProcessor, % Privileged TimelProcessor, Processor Queuel Len gthSystem

32、, Con text Switches per SecondlProcess, Private Bytesll Memory, Page Faults/secMemory, Available ByteslMemory, Pool Pagedl BytesNetwork In terface, bytes total/seclNetwork In terface, Outputl Queue Len gthPhysical Disk, %Disk TimelPhysical Disk, Avg Disk Queuel Len gthCOM+ Authe nticate (by LoadRu n

33、ner)lCOM+ Authenticate Failed (byl LoadRunner)COM+ Activation (by LoadRu nner)lCOM+ Failed (byl LoadRu nner)COM+ Thread Start (by LoadRu nner)lCOM+ Thread Terminatel (by LoadRunner)Tran sacti on Durati on (by LoadRu nn er)lTran sacti on Startl (by LoadRu nn er)Tran sacti on Prepared (by LoadRu nn er

34、)lTran sacti onl Aborted (by LoadRu nn er)Tran sacti on Commited (by LoadRu nn er)lObjectl LifeTime(by LoadRu nn er)Object Create (by LoadRu nn er)lObject Destroyl (by LoadRu nner)Object Activate (by LoadRu nn er)lObject Deactivate (byl LoadRu nner)Disable Commit (by LoadRu nn er)lEn able Commit (byl LoadRu nner)Set Complete (by LoadRu nn er)lSet Abort (byl LoadRu nner)COM+ Method