Performance Testing Terminology
Performance Test
Author
venkatesh
Date
2012-05-09 02:44
Views
10340996
Business Transaction: It refers to a sequence of request-response and the related information exchange between the client and the server in order to accomplish a business requirement. For example, an online banking customer transferring money from one account to other is a business transaction.
Test Scenario: It refers to a high critical business transaction or high traffic workflow identified for the performance testing. Normally all the business transactions cannot be tested for its performance. The Paretto analysis helps to identify those specific 20% transactions which is often exercised by the end users rather than testing the remaining 80% non-critical transactions.
Think Time: It refers to the time taken by the user for thinking or clicking on any of the web page links, buttons, etc while navigating through the web site. Think time is a very important parameter which needs to be set while scripting the scenarios using the performance testing tools. The business analysts of the application or web site management team or sometimes even the end user survey might give a realistic picture about the think time requirements of a transaction.
Virtual User: The Performance testing tool simulates the real user traffic by creating virtual users during the performance test. A virtual user is configured in the performance test tool to run the script simulating the real user behavior. Though in real time, users access the application from a unique IP address, more than one virtual user can be configured to access the application from
the same IP address.
Simultaneous User load: The simultaneous users have the active session on the server at any point of time wherein each user will be executing different transactions. For example, if we say 100 simultaneous users load, then there will be 100 active sessions opened up in the server, wherein each user will be performing different set of transactions – one logging in, another
viewing reports, another navigating to the next page, etc. The simultaneous user load of a web site would be always greater than the concurrent user load of a web site.
Concurrent User load: The concurrent users connect to the server and perform the same operation at any point of time. For example, if we say 100 concurrent user load, all 100 users would be logging in at the same point of time, view the reports at the same point of time, etc. For example, an online banking web site might have 10,000 – 20,000 simultaneous user load, but
1000 to 1500 concurrent user load.
Performance Requirements/Goals: It refers to the quantitative way of putting forth the criteria for claiming the system performance is good. The performance requirements of an application are often expressed in response time, hits per second, transactions per second, etc. The performance requirements of the System Under Test (SUT) need to be quantitatively expressed in the performance test plan.
Workload: It refers to the user load subjected by a web application under real time user access or during the performance test and the way the users are distributed between various transaction flows. Normally, the web server log files of a web site can be analyzed to learn about the workload of the site (if the web site is already in production). For web sites which are yet to go
alive for the first time, a workload model needs to be developed based on the discussion with business analysts, application experts, etc. It is very important to know the workload of the application before conducting the performance test. Conducting the performance test for a system without proper analysis on the workload might lead to misleading results.
User Abandonment: It refers to the situation wherein the end users exit from the web site because of the slow performance of the site. The user abandonment rate varies from web site to web site. A low priority web site might experience a high user abandonment rate compared to the payroll web site. Analysis on the abandonment rate of the site needs to be done before
concluding on the load on the site.
Baseline Test: It refers to the test conducted to measure the application performance for 1 virtual user load. The baseline test is often conducted to collect the metrics about the system performance for 1 user load and thereby it could be used for comparing the system performance at a high load condition. It also helps to check the validity of the test script.
Benchmark Test: It refers to the test conducted to measure the application performance for a low load condition. Normally for a benchmark test, 15 -20% of the target load can be considered. The objective of the benchmark test is to validate the correctness of the test scripts and to check the readiness of the system before subjecting it to a high load. It helps to know whether various
components of the system collaborate as per the design and meet the performance test SLA for 20% of target load.
Hit: It refers to the server request for accessing a web page or a file or an image from a web server. For example, if a web page contains 5 images, then a user visit to that page creates 6 hits on the web server (5 hits for fetching each of the images and 1 hit for fetching the web page).
Test Scenario: It refers to a high critical business transaction or high traffic workflow identified for the performance testing. Normally all the business transactions cannot be tested for its performance. The Paretto analysis helps to identify those specific 20% transactions which is often exercised by the end users rather than testing the remaining 80% non-critical transactions.
Think Time: It refers to the time taken by the user for thinking or clicking on any of the web page links, buttons, etc while navigating through the web site. Think time is a very important parameter which needs to be set while scripting the scenarios using the performance testing tools. The business analysts of the application or web site management team or sometimes even the end user survey might give a realistic picture about the think time requirements of a transaction.
Virtual User: The Performance testing tool simulates the real user traffic by creating virtual users during the performance test. A virtual user is configured in the performance test tool to run the script simulating the real user behavior. Though in real time, users access the application from a unique IP address, more than one virtual user can be configured to access the application from
the same IP address.
Simultaneous User load: The simultaneous users have the active session on the server at any point of time wherein each user will be executing different transactions. For example, if we say 100 simultaneous users load, then there will be 100 active sessions opened up in the server, wherein each user will be performing different set of transactions – one logging in, another
viewing reports, another navigating to the next page, etc. The simultaneous user load of a web site would be always greater than the concurrent user load of a web site.
Concurrent User load: The concurrent users connect to the server and perform the same operation at any point of time. For example, if we say 100 concurrent user load, all 100 users would be logging in at the same point of time, view the reports at the same point of time, etc. For example, an online banking web site might have 10,000 – 20,000 simultaneous user load, but
1000 to 1500 concurrent user load.
Performance Requirements/Goals: It refers to the quantitative way of putting forth the criteria for claiming the system performance is good. The performance requirements of an application are often expressed in response time, hits per second, transactions per second, etc. The performance requirements of the System Under Test (SUT) need to be quantitatively expressed in the performance test plan.
Workload: It refers to the user load subjected by a web application under real time user access or during the performance test and the way the users are distributed between various transaction flows. Normally, the web server log files of a web site can be analyzed to learn about the workload of the site (if the web site is already in production). For web sites which are yet to go
alive for the first time, a workload model needs to be developed based on the discussion with business analysts, application experts, etc. It is very important to know the workload of the application before conducting the performance test. Conducting the performance test for a system without proper analysis on the workload might lead to misleading results.
User Abandonment: It refers to the situation wherein the end users exit from the web site because of the slow performance of the site. The user abandonment rate varies from web site to web site. A low priority web site might experience a high user abandonment rate compared to the payroll web site. Analysis on the abandonment rate of the site needs to be done before
concluding on the load on the site.
Baseline Test: It refers to the test conducted to measure the application performance for 1 virtual user load. The baseline test is often conducted to collect the metrics about the system performance for 1 user load and thereby it could be used for comparing the system performance at a high load condition. It also helps to check the validity of the test script.
Benchmark Test: It refers to the test conducted to measure the application performance for a low load condition. Normally for a benchmark test, 15 -20% of the target load can be considered. The objective of the benchmark test is to validate the correctness of the test scripts and to check the readiness of the system before subjecting it to a high load. It helps to know whether various
components of the system collaborate as per the design and meet the performance test SLA for 20% of target load.
Hit: It refers to the server request for accessing a web page or a file or an image from a web server. For example, if a web page contains 5 images, then a user visit to that page creates 6 hits on the web server (5 hits for fetching each of the images and 1 hit for fetching the web page).
Total 20,613
- All
- Agile Testing
- Bug/Defect
- Certification
- Conferences
- Database Testing
- Functional Test
- Integration Testing
- Interview
- Java Testing
- Magazine
- Manual Testing
- Methodology
- Mobile Testing
- Network Testing
- Performance Test
- Requirement
- Review
- Risk Management
- Security Testing
- Software Testing
- Standard
- System Testing
- Test Automation
- Test Case
- Test Data
- Test Environment
- Test Estimation
- Test Management
- Tester Career
- Testing News
- Test Plan
- Unit Testing
- Video Tutorial
- Web Testing
- Webinar
Number | Title | Author | Date | Votes | Views |
20613 |
SileniusStor is specialized in reselling Cheap Aquafadas software online.
Softwareces
|
2022.09.15
|
Votes 0
|
Views 9019861
|
Softwareces | 2022.09.15 | 0 | 9019861 |
20612 |
CSStore is specialized in reselling Cheap Steinberg software online.
Softwareces
|
2022.09.04
|
Votes 0
|
Views 8998891
|
Softwareces | 2022.09.04 | 0 | 8998891 |
20611 |
Software Tester Community Website
ItSeTsQtBer
|
2021.04.11
|
Votes 0
|
Views 9927086
|
ItSeTsQtBer | 2021.04.11 | 0 | 9927086 |
20610 |
SoapUI Certification Course Content
Steveskok
|
2021.02.08
|
Votes 0
|
Views 9837256
|
Steveskok | 2021.02.08 | 0 | 9837256 |
20609 |
JavaScript Course Content
Steveskok
|
2021.02.08
|
Votes 0
|
Views 9906697
|
Steveskok | 2021.02.08 | 0 | 9906697 |
20608 |
Why most mobile testing is not continuous?
(TestExpert)
|
2021.02.04
|
Votes 0
|
Views 10188292
|
(TestExpert) | 2021.02.04 | 0 | 10188292 |
20607 |
8 Common Mistakes When Planning and Documenting Your Tests
(TestExpert)
|
2021.02.04
|
Votes 0
|
Views 9977452
|
(TestExpert) | 2021.02.04 | 0 | 9977452 |
20606 |
Types of Performance Testing
Jamessmith
|
2021.01.17
|
Votes 0
|
Views 9530512
|
Jamessmith | 2021.01.17 | 0 | 9530512 |
20605 |
How to Build E2E Test Cases (1)
tanthanh
|
2020.05.28
|
Votes 0
|
Views 9814395
|
tanthanh | 2020.05.28 | 0 | 9814395 |
20604 |
[White Paper] Delivering better software using Test Automation
tanthanh
|
2020.05.28
|
Votes 0
|
Views 9233598
|
tanthanh | 2020.05.28 | 0 | 9233598 |
20603 |
[Whitepaper] How to choose the right API Testing Solution
tanthanh
|
2020.05.28
|
Votes 0
|
Views 9658802
|
tanthanh | 2020.05.28 | 0 | 9658802 |
20602 |
[Whitepaper] How to choose the right API Testing Solution
tanthanh
|
2020.05.28
|
Votes 0
|
Views 9580702
|
tanthanh | 2020.05.28 | 0 | 9580702 |
20601 |
TestOps Introduction
VTB
|
2020.03.23
|
Votes 0
|
Views 9647262
|
VTB | 2020.03.23 | 0 | 9647262 |
20600 |
TestOps Implementation Case Study
VTB
|
2020.03.23
|
Votes 0
|
Views 9952103
|
VTB | 2020.03.23 | 0 | 9952103 |
20599 |
Selenium Automation Tester Certification Sample Exam Set 3
(TestExpert)
|
2020.02.03
|
Votes 0
|
Views 9724586
|
(TestExpert) | 2020.02.03 | 0 | 9724586 |
20598 |
Selenium Automation Tester Certification Sample Exam Set 2
(TestExpert)
|
2020.02.03
|
Votes 0
|
Views 9734271
|
(TestExpert) | 2020.02.03 | 0 | 9734271 |
20597 |
Selenium Automation Tester Certification : Sample Exam Set 1
(TestExpert)
|
2020.02.03
|
Votes 0
|
Views 9534693
|
(TestExpert) | 2020.02.03 | 0 | 9534693 |
20596 |
What is agile testing? why is agile testing? and what is the benefits? (20)
oishichip
|
2019.12.26
|
Votes 0
|
Views 10180451
|
oishichip | 2019.12.26 | 0 | 10180451 |
20595 |
Crowd Testing — Vantagens para testadores, plataformas e clientes [pt-br]
soikmd2
|
2019.12.14
|
Votes 0
|
Views 9955475
|
soikmd2 | 2019.12.14 | 0 | 9955475 |
20594 |
Software Testing Industry Report (Turkey) 2018-2019 (2)
ItSeTsQtB
|
2019.08.08
|
Votes 0
|
Views 10032625
|
ItSeTsQtB | 2019.08.08 | 0 | 10032625 |
20593 |
How to bypass security in integration tests in ASP.Net Core
ItSeTsQtB
|
2019.08.08
|
Votes 0
|
Views 10461804
|
ItSeTsQtB | 2019.08.08 | 0 | 10461804 |
20592 |
For agile testing, fail fast with test impact analysis
ItSeTsQtB
|
2019.08.08
|
Votes 0
|
Views 9690168
|
ItSeTsQtB | 2019.08.08 | 0 | 9690168 |
20591 |
Career Path in Software Testing
^Software^
|
2019.07.28
|
Votes 0
|
Views 9867704
|
^Software^ | 2019.07.28 | 0 | 9867704 |
20590 |
Challenges in Big Data Testing
^Software^
|
2019.07.22
|
Votes 0
|
Views 9867048
|
^Software^ | 2019.07.22 | 0 | 9867048 |
20589 |
Essential Necessities In Big Data Testing
^Software^
|
2019.07.22
|
Votes 0
|
Views 9827214
|
^Software^ | 2019.07.22 | 0 | 9827214 |
20588 |
5 Test Data Generation Techniques
^Software^
|
2019.07.22
|
Votes 0
|
Views 10141459
|
^Software^ | 2019.07.22 | 0 | 10141459 |
20587 |
CI and CD for ETL (Extract-Transform-Load) testing.
^Software^
|
2019.07.22
|
Votes 0
|
Views 9827639
|
^Software^ | 2019.07.22 | 0 | 9827639 |
20586 |
Quest for Quality Conference : 5-6 Nov 2019 at Dublin, Ireland
VTB
|
2019.07.08
|
Votes 0
|
Views 9579126
|
VTB | 2019.07.08 | 0 | 9579126 |
20585 |
TestBash Essentials Conference 2019
VTB
|
2019.07.08
|
Votes 0
|
Views 9726952
|
VTB | 2019.07.08 | 0 | 9726952 |
20584 |
UKSTAR Conference : 11-03-2019
VTB
|
2019.07.08
|
Votes 0
|
Views 9711373
|
VTB | 2019.07.08 | 0 | 9711373 |
20583 |
Testing in Context Conference Australia (TiCCA) 2019
VTB
|
2019.07.08
|
Votes 0
|
Views 9895433
|
VTB | 2019.07.08 | 0 | 9895433 |
20582 |
European Testing Conference 2019
VTB
|
2019.07.08
|
Votes 0
|
Views 9751866
|
VTB | 2019.07.08 | 0 | 9751866 |
20581 |
Automation Guild Online Conference 2019
VTB
|
2019.07.08
|
Votes 0
|
Views 10097036
|
VTB | 2019.07.08 | 0 | 10097036 |
20580 |
Software Quality Days 2019 : 15 Jan 2019 (1)
VTB
|
2019.07.08
|
Votes 0
|
Views 9887023
|
VTB | 2019.07.08 | 0 | 9887023 |
20579 |
Skills required to become a Software Tester (1)
IT-Tester
|
2019.07.08
|
Votes 0
|
Views 9607559
|
IT-Tester | 2019.07.08 | 0 | 9607559 |
20578 |
Automated Unit Testing with Randoop, JWalk and µJava versus Manual JUnit Testing
IT-Tester
|
2019.07.08
|
Votes 0
|
Views 9626865
|
IT-Tester | 2019.07.08 | 0 | 9626865 |
20577 |
Scrum Testing Guide Book (2)
IT-Tester
|
2019.06.26
|
Votes 0
|
Views 9376990
|
IT-Tester | 2019.06.26 | 0 | 9376990 |
20576 |
Acceptance Testing Definition in Testing vs Scrum
IT-Tester
|
2019.06.26
|
Votes 0
|
Views 9530336
|
IT-Tester | 2019.06.26 | 0 | 9530336 |
20575 |
User Acceptance Testing Checklist
VTB
|
2019.06.20
|
Votes 0
|
Views 9627975
|
VTB | 2019.06.20 | 0 | 9627975 |
20574 |
Firewalls and Types (1)
VTB
|
2018.11.14
|
Votes 0
|
Views 9546203
|
VTB | 2018.11.14 | 0 | 9546203 |
20573 |
Senior Test Engineer (1)
VTB
|
2018.11.05
|
Votes 0
|
Views 9821833
|
VTB | 2018.11.05 | 0 | 9821833 |
20572 |
Junior Test Analyst
kornadian2
|
2018.11.04
|
Votes 0
|
Views 9736645
|
kornadian2 | 2018.11.04 | 0 | 9736645 |
20571 |
Senior Test Engineer
kornadian2
|
2018.11.04
|
Votes 0
|
Views 9843058
|
kornadian2 | 2018.11.04 | 0 | 9843058 |
20570 |
Programme Test Manager, 12m, Immed Start, $NEG
kornadian2
|
2018.11.04
|
Votes 0
|
Views 10019733
|
kornadian2 | 2018.11.04 | 0 | 10019733 |
20569 |
Junior Test Analyst
kornadian2
|
2018.11.04
|
Votes 0
|
Views 9766069
|
kornadian2 | 2018.11.04 | 0 | 9766069 |
20568 |
Dev & Test Manager
kornadian2
|
2018.11.04
|
Votes 0
|
Views 9755687
|
kornadian2 | 2018.11.04 | 0 | 9755687 |
20567 |
Senior Test Analyst (Performance Tester)
kornadian2
|
2018.11.04
|
Votes 0
|
Views 9649104
|
kornadian2 | 2018.11.04 | 0 | 9649104 |
20566 |
QA Automation Test Analyst
kornadian2
|
2018.11.04
|
Votes 0
|
Views 9738700
|
kornadian2 | 2018.11.04 | 0 | 9738700 |
20565 |
Software/Field Testing Engineer
kornadian2
|
2018.11.04
|
Votes 0
|
Views 9500552
|
kornadian2 | 2018.11.04 | 0 | 9500552 |
20564 |
Compliance Technician (Tester)
kornadian2
|
2018.11.04
|
Votes 0
|
Views 9730835
|
kornadian2 | 2018.11.04 | 0 | 9730835 |
Thank you.
Thank u
Good terminology. Very helpful