473,564 Members | 2,758 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Application Center Test - Any good?

Hi

I have a requirement to use the Application Center Test
(part of Visual Studio.Net Enterprise architect) program,
to simulate loading on my Web servers. Does anyone know
if it is any good? I have gotten it to work and it seems
to do the job.

I have a requirement to run multiple tests from many
computers simultaneously. The manual seems to hint that
there may be an 'enterpricse version' that does this.

I also need to call the system via COM - I can get the
COM objects to create, and a test to load OK, but get a
permission error trying to run a test. Is there any
secret to doing this?

Kind Regards

Anthony
Jul 21 '05 #1
2 2783
Anthony Abbot wrote:
Hi

I have a requirement to use the Application Center Test
... Does anyone know if it is any good? I have gotten
it to work and it seems to do the job. I was on a team that spent a year developing capacity tests on a rather
complex application using ACT. After a year of poor results we invested in
Mercury Interactive Load Runner. IME, in capacity planning, you get what
you pay for. ACT is a start at a capacity-planning solution. Activities
can be recorded and then played back. A single machine can simulate the
activity of several machines.

Now, after you have that, you need a few more features that ACT lacks.
First, you need a way to manage parameterizatio n. Since the base is
VBScript or JScript, it's easy enough to splice in a variable to a stream,
all you have to do is program it. So when you have say, 100 different
points that you want to parameterize, all you have to do is write code that
splices in values at 100 different points. If the parameterizatio n is
context-sensitive; dependent on application state, all you have to do is
develop a state machine for the client to manage those dependencies, and a
parser to read the response from the application. To write a state machine
to manage such, all you need to do is understand the application under test
to fine details so that for any intersting input you can predict the form
of output you should parse... Remember to code for unexpected behavior.
Be a master of exception handling and error trapping.

Then you can begin to develop the reporting functionality. ACT reports are
a start. The reports are in an XML format. The schema that the reports
use is one that requires nothing more that there be a root element named, I
think, <report>. There is an implied schema that I am sure will be easy
for you to figure out. If you are interested in trends across tests, or
comparisons that are not present in the reporting tool, or generating
documents rather than using the interface provided, all you have to do is
write an XSLT or something that will read reports generated by ACT and
transform them to what you want. You might even consider a mecahnism to
move report data to an RDBMS for more flexibility. An XSL transform can
output SQL as easily as it can output HTML. All you have to do is develop
a relational schema that adequately captures the information that ACT can
generate. All you need to do there is find a good DBE and then a
reasonable DBA to manage that resource.

I hope you see my point. Using ACT you will invest as much effort writing
the testing framework as developing the application under test, if you
aren't careful. Much of the work you do will be developing an application
test framework, not testing the application, and most organizations will
become impatient waiting for numbers. Since there will be such a large
body of code behind the tests, clients can as easily suspect the quality of
the test, you will need a QA process for the tests that rivals the QA
process for the application.

It may be that when you look at the price of a Load Runner virtual user
(some $hundreds per) it is enough to make the organization balk. And I am
not suggesting the LR is a perfect application. It is still a lot of work
to make good capacity plans even with good tools. IME, the price of a
mature tool with good support, like LR, versus the price of ACT (free) and
the cost of developing the infrastructure for results (at least a year of
development and the cost of meeting requirements for high-quality test
software) there's not as much difference as it might appear at first.

I have a requirement to run multiple tests from many
computers simultaneously. The manual seems to hint that
there may be an 'enterpricse version' that does this.
One of the reasons we kept with ACT so long was we also saw this hint. When
we pressed M$ for a date on this alleged version, we found that the team
who built ACT was scattered over the width and breadth of the campus, that
plans for furhter development of the product were on hold indefinitely, and
that support for even the existing single-machine version was below our
expectations.
I also need to call the system via COM - I can get the
COM objects to create, and a test to load OK, but get a
permission error trying to run a test. Is there any
secret to doing this?

It's been awhile since I tried ACT and COM, and I only kind of remember, you
have to know the account that ACT is running and adjust that account to
have the rights to execute, not the human logged on to the machine.

HTH
--
An HWND is a terrible thing to waste.
Jul 21 '05 #2
Anthony Abbot wrote:
Hi

I have a requirement to use the Application Center Test
... Does anyone know if it is any good? I have gotten
it to work and it seems to do the job. I was on a team that spent a year developing capacity tests on a rather
complex application using ACT. After a year of poor results we invested in
Mercury Interactive Load Runner. IME, in capacity planning, you get what
you pay for. ACT is a start at a capacity-planning solution. Activities
can be recorded and then played back. A single machine can simulate the
activity of several machines.

Now, after you have that, you need a few more features that ACT lacks.
First, you need a way to manage parameterizatio n. Since the base is
VBScript or JScript, it's easy enough to splice in a variable to a stream,
all you have to do is program it. So when you have say, 100 different
points that you want to parameterize, all you have to do is write code that
splices in values at 100 different points. If the parameterizatio n is
context-sensitive; dependent on application state, all you have to do is
develop a state machine for the client to manage those dependencies, and a
parser to read the response from the application. To write a state machine
to manage such, all you need to do is understand the application under test
to fine details so that for any intersting input you can predict the form
of output you should parse... Remember to code for unexpected behavior.
Be a master of exception handling and error trapping.

Then you can begin to develop the reporting functionality. ACT reports are
a start. The reports are in an XML format. The schema that the reports
use is one that requires nothing more that there be a root element named, I
think, <report>. There is an implied schema that I am sure will be easy
for you to figure out. If you are interested in trends across tests, or
comparisons that are not present in the reporting tool, or generating
documents rather than using the interface provided, all you have to do is
write an XSLT or something that will read reports generated by ACT and
transform them to what you want. You might even consider a mecahnism to
move report data to an RDBMS for more flexibility. An XSL transform can
output SQL as easily as it can output HTML. All you have to do is develop
a relational schema that adequately captures the information that ACT can
generate. All you need to do there is find a good DBE and then a
reasonable DBA to manage that resource.

I hope you see my point. Using ACT you will invest as much effort writing
the testing framework as developing the application under test, if you
aren't careful. Much of the work you do will be developing an application
test framework, not testing the application, and most organizations will
become impatient waiting for numbers. Since there will be such a large
body of code behind the tests, clients can as easily suspect the quality of
the test, you will need a QA process for the tests that rivals the QA
process for the application.

It may be that when you look at the price of a Load Runner virtual user
(some $hundreds per) it is enough to make the organization balk. And I am
not suggesting the LR is a perfect application. It is still a lot of work
to make good capacity plans even with good tools. IME, the price of a
mature tool with good support, like LR, versus the price of ACT (free) and
the cost of developing the infrastructure for results (at least a year of
development and the cost of meeting requirements for high-quality test
software) there's not as much difference as it might appear at first.

I have a requirement to run multiple tests from many
computers simultaneously. The manual seems to hint that
there may be an 'enterpricse version' that does this.
One of the reasons we kept with ACT so long was we also saw this hint. When
we pressed M$ for a date on this alleged version, we found that the team
who built ACT was scattered over the width and breadth of the campus, that
plans for furhter development of the product were on hold indefinitely, and
that support for even the existing single-machine version was below our
expectations.
I also need to call the system via COM - I can get the
COM objects to create, and a test to load OK, but get a
permission error trying to run a test. Is there any
secret to doing this?

It's been awhile since I tried ACT and COM, and I only kind of remember, you
have to know the account that ACT is running and adjust that account to
have the rights to execute, not the human logged on to the machine.

HTH
--
An HWND is a terrible thing to waste.
Jul 21 '05 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
2208
by: Chris Gatto | last post by:
Hello, My organization is currently considering the purchase of a new intranet application server and we are looking for opinions from those who have been down this road before. In brief the server must support the following: - 600+ users using various ASP.Net based applications, only 2 currently but growing over time as old legacy apps...
0
2124
by: cpavon | last post by:
Hello everyone, I am fairly new to MACT, I am currently trying to parse the oResponse.Body to retrive a dynamic values...store in an array and then randomly post those values. Does anyone have any sample code on how to parse the oResponse.Body? This is what I have so far but I cannot seem to get the value I'm trying to pick up.
1
347
by: Anthony Abbot | last post by:
Hi I have a requirement to use the Application Center Test (part of Visual Studio.Net Enterprise architect) program, to simulate loading on my Web servers. Does anyone know if it is any good? I have gotten it to work and it seems to do the job. I have a requirement to run multiple tests from many computers simultaneously. The manual...
0
1034
by: PrettySneaky | last post by:
I have at the moment written two webservice prototypes and I am trying do some stress testing with Microsoft application center test. My web page communicates with the the webservice like this: 1. Call a register method and receives a string which is a Guid value 2. Call a read values method that takes the Guid string as parameter 3. Call...
2
1419
by: mobiletornado | last post by:
I am using visual studio .net 2003 enterprize architect. My application test center is version 1.0.536 I am runnign window xp home edition. I have stated a new test. I chose to record a new test in the new test wizard. chosen script language is vbscript. when pressing start record a new internet explorer window open. I go to any url adn...
0
2620
by: Prometric Test center | last post by:
Bangalore's Best Prometric Test center (like Microsoft, Sun Microsystems, Dell, HP) Hi, Greetings from Everonn!!!! Are you looking for the good Prometric (like Microsoft, Sun Microsystems, Dell, and HP) Test center, where you can take test whenever you want...?
0
4722
by: Prometric Test center | last post by:
Bangalore's Best Prometric Test center (like Microsoft, Sun Microsystems, Exin - ITIL, Dell, HP) Hi, Greetings from Everonn!!!! Are you looking for the good Prometric (like Microsoft, Sun Microsystems, Dell, and HP) Test center, where you can take test whenever you want...?
0
1604
by: Prometric Test center | last post by:
Best Prometric Test center in Bangalore (like Microsoft, Sun Microsystems, Exin - ITIL, Dell, HP) Hi, Greetings from Everonn!!!! Are you looking for the good Prometric (like Microsoft, Sun Microsystems, Dell, and HP) Test center, where you can take test whenever you want...?
0
1779
by: Prometric Test center | last post by:
Best Prometric Test center in Bangalore (like Microsoft, Sun Microsystems, CISCO, Exin - ITIL, Dell, HP) Hi, Greetings from Everonn!!!! Are you looking for the good Prometric (like Microsoft, Sun Microsystems, CISCO, Dell, and HP) Test center, where you can take test whenever you want...?
0
7583
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language...
0
8106
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that...
1
7642
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For...
1
5484
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes...
0
5213
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert...
0
3643
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in...
0
3626
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
2082
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
0
924
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.