Please post your Web Driver questions in official Web Driver forum

Monday, December 8, 2008

Conducting Test using Remote Agent.


SP Agent is the machine which is used to generate virtual user load. We have
load test being carried in our project which is to be simulated from client
environment This is to avoid the network delays as users of this app would be
in client environment load should be simulated form client environment. (In fact
we observed difference in response time as high as 10 sec when we compared
two test run. One using offshore Agent and other using onsite Agent.)

For this we got a machine in Client and we would connect to this machine
through vpn. Hence this would be used as Agent while we would control
execution of test from offshore. To be able to do this we got two ports 19200
and 19202 opened on this machine from client environment . Opening of these
two ports got us going with performance test.

How to avoid think time / wait time from being accumulated in Custom Timers.

In Silk Performer custom Timers are used to generate response time around
transactions. It is usually inserted in the script generated by SP recorder. In
a typical script it looks as following -

==========================================================
MeasureStart("1020_ RANK_PREFERENCE"); // Custom Timer - Start for Rank
Prefpage

WebUrl("https://test-qa.test.edu/testtesting/images/arrow.png");
**** Few more functions***
**************************
**** Few more functions***

MeasureStop("1020_ RANK_PREFERENCE"); // Custom Timer - stop for
Rank Pref page
==========================================================

With the inclusion of Think Timer (wait time kept deliberately to simulate
real user behaviour as a typical user waits on a page before performing
any action) script would look as following -

===========================================================
MeasureStart("1020_ RANK_PREFERENCE"); // Custom Timer - Start for Rank
Pref page

WebUrl("https://test-qa.test.edu/testtesting/images/arrow.png");

ThinkTime(154.56); // Think timer inserted in middle of Measure Start and
Stop timers.

**** Few more functions***
**************************
**** Few more functions***

MeasureStop("1020_ RANK_PREFERENCE"); // Custom Timer - stop for Rank
Pref page
============================================================

Having think time in middle of Start and Stop timers would cause think time to
be added to the overall response time which eventually would give a false
impression about the response time of page.
To avoid think time from being added to custom timer one needs to stop timing
measurement before Think Time and must resume it after it. This is as following
-

==============================================================
MeasureStart("1020_ RANK_PREFERENCE"); // Custom Timer - Start for Rank Pref
page

WebUrl("https://test-qa.test.edu/testtesting/images/arrow.png");

MeasurePause("1020_ RANK_PREFERENCE"); // Pause the time measurement
ThinkTime(154.56); // Think Time
MeasureResume("1020_ RANK_PREFERENCE"); // Resume the time measurement

**** Few more functions***
**************************
**** Few more functions***

MeasureStop("1020_ RANK_PREFERENCE"); // Custom Timer - stop for Rank
Pref page
=============================================================

This how think time can be stooped from getting added to custom timers.

fwait-Parameter:
When browser-level Web traffic is recorded using the Recorder, a wait time is
included at the end of recorded functions to tell the replay engine how long to
wait before executing the next function in the script. In WebURL function it
look as -

==============================================================
WebUrl("http://www.shopit.com/ad.gif", 17.2); // Here 17.2 is fwait parameter.
==============================================================
The wait time times simulate:

* The time the browser needs to parse out links of embedded documents (e.g.
images, etc).
* A users thinking time.

This wait time is ignored in Stress Test mode.

But again this wait gets added to custom timers and results in overall high
response time. If WebUrl function is just a call to image then it can be
manually removed from the script, But if its need is indispensable then it can
be replaced with equivalent Think Timer as -

===========================================================
WebUrl("http://www.shopit.com/ad.gif"); // WebURL function with out fwait.
ThinkTime(17.2); // Think time to simulate the wait period
===========================================================

Here again time measurement should be stopped before Think Time and should be
resumed just after it as illustrated above.
Fork me on GitHub