New Year Special Sale - Limited Time 70% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: mxmas70

Home > iSQI > Performance Testing > CTFL-PT

CTFL-PT ISTQB Certified Tester Foundation Level-Performance Testing Question and Answers

Question # 4

You have been asked to test the performance of a software and system update to a North American mobile trivia quiz game application The quiz app is available on major app stores serving English-speaking users.The number of concurrent users planned for is 5 million Winning quiz participants are promised a share of an allocated cash prize Once participants start playing, their quiz sessions must not be lost especially if all previous questions were answered correctly. The application owner wants to ensure that 99% of quiz sessions are maintained (up to 4.95 million sessions) until the last answer has been successfully recorded.

You performed 100 test runs that provided 5 million virtual concurrent users.You have measurements of participant concurrency at the last question for each test run In your analysis, you order all the concurrency test results by measured concurrency value from best to worst.You determine 85%. 90%. 95% and 100% values by selecting the 85th. 90th. 95th and 100th (last and worst) measured values by counting list positions starting from the best value going towards the worst until you reach the desired list position (ex. 85). Keep in mind, the results in lower list positions are as good or better than the results chosen for reporting.

After analyzing the results of the performance tests, you present the following results

85% 4.92 million valid concurrent users

90% 4.90 million valid concurrent users

95%: 4.0 millionvalid concurrent users

100%. 3.8 million valid concurrent users

Based on these results, what should you report to thestakeholders?

A.

The performance tests clearly have failed to produce a realistic and compatible load.The results should confirm the test oracle in that the 99% of five million participants concurrency objective has been achieved.If the performance test plan had worked correctly, the reported values should have been 85% 4.95, 90% 4.95, 95% 4 95 and 100% 4.95 million valid concurrent users.

B.

These results clearly show that the system update successfully supports 99% of five million participants

C.

Four samples from the first fifteen ordered test results are presented. The system update performed much worse than what is presented here. The system update has failed to meet the 99% of five million participants concurrency objective.

D.

If we pick 85 out of 100 test runs as the minimum level of reliability, thesystem update does not reliabilitymeet the 99% of five million participants concurrency target,However not all results are as bad as these

Full Access
Question # 5

You have been asked to test the performance of a software and system update to a North American mobile trivia quiz game application.The quiz app is available on major app stores serving English-speaking users.The number of concurrent users planned for is 5 million. Winning quiz participants are promised a share of an allocated cash prize Once participants start playing, their quiz sessions must not be lost especially if all previous questions were answered correctly. The application owner wants to ensure that 99% of quiz sessions are maintained (up to 4.95 million sessions) until the last answer has been successfully recorded

Before your team begins testing, the team needs to present the performance test plan to technical stakeholders

Which of the following sets of plan attributes would you recommend be included in this presentation?

i.Sales has indicated that quiz events for Sponsor A offering $65,000. Sponsor B offering $45,500. Sponsor C offering $25,000

will be taking place during the first week of performance testing.

ii. Simultaneous session tests are focused on the backend. and are not end-to-end. Variability in user behavior, mobile devicesand mobile communications introduces session drop opportunities outside application control. Using load generators located

in 5 high availability data centers in North America will ensure session drops are most likely caused by application issues, thus allowing us to isolatethe root cause of any concurrency issues that arise

iii.Test scripts based on replaying recorded communication will take 30 hours each to write and test due to the extensive parameterization required to

respond to quiz questions Development has agreed to share client code that can be scripted to authenticate and respond to quiz questions

automatically. The fully programmed script will likely take 18 hours each to write

and test Fully programmed scripts will utilize the identical communications stack of the actual client avoiding missed communication nuances.

iv The U S Federal Trade Commission has recently sued SmartyBogusFauxApp and OutSmartMeexample com over promises of prizes andunreliability

v The upgrade being tested was paid for by the latest round of venture funding Supporting 5 million users is requirement thatwas a condition of their funding.

i. ii include iii. iv, v exclude

ii, iii include i, iv, v exclude

ii, v include i, ii, iv exclude

iii. iv, v include i, ii exclude

Full Access
Question # 6

How does a performance test script determine the duration of a request?

A.

Starting a counter when the result is received and stopping the counter when the request is made

B.

Entering an interrupt service routine when the request is made and returning when the result is received.

C.

Forking a child of itself and then blocking when the request is made and resuming operations when the result is received

D.

Starting a timer when the request is made and stopping the timer when a result for the request is received.

Full Access