473,320 Members | 2,097 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,320 software developers and data experts.

Application Center Test - Any good?

Hi

I have a requirement to use the Application Center Test
(part of Visual Studio.Net Enterprise architect) program,
to simulate loading on my Web servers. Does anyone know
if it is any good? I have gotten it to work and it seems
to do the job.

I have a requirement to run multiple tests from many
computers simultaneously. The manual seems to hint that
there may be an 'enterpricse version' that does this.

I also need to call the system via COM - I can get the
COM objects to create, and a test to load OK, but get a
permission error trying to run a test. Is there any
secret to doing this?

Kind Regards

Anthony
Jul 21 '05 #1
2 2754
Anthony Abbot wrote:
Hi

I have a requirement to use the Application Center Test
... Does anyone know if it is any good? I have gotten
it to work and it seems to do the job. I was on a team that spent a year developing capacity tests on a rather
complex application using ACT. After a year of poor results we invested in
Mercury Interactive Load Runner. IME, in capacity planning, you get what
you pay for. ACT is a start at a capacity-planning solution. Activities
can be recorded and then played back. A single machine can simulate the
activity of several machines.

Now, after you have that, you need a few more features that ACT lacks.
First, you need a way to manage parameterization. Since the base is
VBScript or JScript, it's easy enough to splice in a variable to a stream,
all you have to do is program it. So when you have say, 100 different
points that you want to parameterize, all you have to do is write code that
splices in values at 100 different points. If the parameterization is
context-sensitive; dependent on application state, all you have to do is
develop a state machine for the client to manage those dependencies, and a
parser to read the response from the application. To write a state machine
to manage such, all you need to do is understand the application under test
to fine details so that for any intersting input you can predict the form
of output you should parse... Remember to code for unexpected behavior.
Be a master of exception handling and error trapping.

Then you can begin to develop the reporting functionality. ACT reports are
a start. The reports are in an XML format. The schema that the reports
use is one that requires nothing more that there be a root element named, I
think, <report>. There is an implied schema that I am sure will be easy
for you to figure out. If you are interested in trends across tests, or
comparisons that are not present in the reporting tool, or generating
documents rather than using the interface provided, all you have to do is
write an XSLT or something that will read reports generated by ACT and
transform them to what you want. You might even consider a mecahnism to
move report data to an RDBMS for more flexibility. An XSL transform can
output SQL as easily as it can output HTML. All you have to do is develop
a relational schema that adequately captures the information that ACT can
generate. All you need to do there is find a good DBE and then a
reasonable DBA to manage that resource.

I hope you see my point. Using ACT you will invest as much effort writing
the testing framework as developing the application under test, if you
aren't careful. Much of the work you do will be developing an application
test framework, not testing the application, and most organizations will
become impatient waiting for numbers. Since there will be such a large
body of code behind the tests, clients can as easily suspect the quality of
the test, you will need a QA process for the tests that rivals the QA
process for the application.

It may be that when you look at the price of a Load Runner virtual user
(some $hundreds per) it is enough to make the organization balk. And I am
not suggesting the LR is a perfect application. It is still a lot of work
to make good capacity plans even with good tools. IME, the price of a
mature tool with good support, like LR, versus the price of ACT (free) and
the cost of developing the infrastructure for results (at least a year of
development and the cost of meeting requirements for high-quality test
software) there's not as much difference as it might appear at first.

I have a requirement to run multiple tests from many
computers simultaneously. The manual seems to hint that
there may be an 'enterpricse version' that does this.
One of the reasons we kept with ACT so long was we also saw this hint. When
we pressed M$ for a date on this alleged version, we found that the team
who built ACT was scattered over the width and breadth of the campus, that
plans for furhter development of the product were on hold indefinitely, and
that support for even the existing single-machine version was below our
expectations.
I also need to call the system via COM - I can get the
COM objects to create, and a test to load OK, but get a
permission error trying to run a test. Is there any
secret to doing this?

It's been awhile since I tried ACT and COM, and I only kind of remember, you
have to know the account that ACT is running and adjust that account to
have the rights to execute, not the human logged on to the machine.

HTH
--
An HWND is a terrible thing to waste.
Jul 21 '05 #2
Anthony Abbot wrote:
Hi

I have a requirement to use the Application Center Test
... Does anyone know if it is any good? I have gotten
it to work and it seems to do the job. I was on a team that spent a year developing capacity tests on a rather
complex application using ACT. After a year of poor results we invested in
Mercury Interactive Load Runner. IME, in capacity planning, you get what
you pay for. ACT is a start at a capacity-planning solution. Activities
can be recorded and then played back. A single machine can simulate the
activity of several machines.

Now, after you have that, you need a few more features that ACT lacks.
First, you need a way to manage parameterization. Since the base is
VBScript or JScript, it's easy enough to splice in a variable to a stream,
all you have to do is program it. So when you have say, 100 different
points that you want to parameterize, all you have to do is write code that
splices in values at 100 different points. If the parameterization is
context-sensitive; dependent on application state, all you have to do is
develop a state machine for the client to manage those dependencies, and a
parser to read the response from the application. To write a state machine
to manage such, all you need to do is understand the application under test
to fine details so that for any intersting input you can predict the form
of output you should parse... Remember to code for unexpected behavior.
Be a master of exception handling and error trapping.

Then you can begin to develop the reporting functionality. ACT reports are
a start. The reports are in an XML format. The schema that the reports
use is one that requires nothing more that there be a root element named, I
think, <report>. There is an implied schema that I am sure will be easy
for you to figure out. If you are interested in trends across tests, or
comparisons that are not present in the reporting tool, or generating
documents rather than using the interface provided, all you have to do is
write an XSLT or something that will read reports generated by ACT and
transform them to what you want. You might even consider a mecahnism to
move report data to an RDBMS for more flexibility. An XSL transform can
output SQL as easily as it can output HTML. All you have to do is develop
a relational schema that adequately captures the information that ACT can
generate. All you need to do there is find a good DBE and then a
reasonable DBA to manage that resource.

I hope you see my point. Using ACT you will invest as much effort writing
the testing framework as developing the application under test, if you
aren't careful. Much of the work you do will be developing an application
test framework, not testing the application, and most organizations will
become impatient waiting for numbers. Since there will be such a large
body of code behind the tests, clients can as easily suspect the quality of
the test, you will need a QA process for the tests that rivals the QA
process for the application.

It may be that when you look at the price of a Load Runner virtual user
(some $hundreds per) it is enough to make the organization balk. And I am
not suggesting the LR is a perfect application. It is still a lot of work
to make good capacity plans even with good tools. IME, the price of a
mature tool with good support, like LR, versus the price of ACT (free) and
the cost of developing the infrastructure for results (at least a year of
development and the cost of meeting requirements for high-quality test
software) there's not as much difference as it might appear at first.

I have a requirement to run multiple tests from many
computers simultaneously. The manual seems to hint that
there may be an 'enterpricse version' that does this.
One of the reasons we kept with ACT so long was we also saw this hint. When
we pressed M$ for a date on this alleged version, we found that the team
who built ACT was scattered over the width and breadth of the campus, that
plans for furhter development of the product were on hold indefinitely, and
that support for even the existing single-machine version was below our
expectations.
I also need to call the system via COM - I can get the
COM objects to create, and a test to load OK, but get a
permission error trying to run a test. Is there any
secret to doing this?

It's been awhile since I tried ACT and COM, and I only kind of remember, you
have to know the account that ACT is running and adjust that account to
have the rights to execute, not the human logged on to the machine.

HTH
--
An HWND is a terrible thing to waste.
Jul 21 '05 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
by: Chris Gatto | last post by:
Hello, My organization is currently considering the purchase of a new intranet application server and we are looking for opinions from those who have been down this road before. In brief the...
0
by: cpavon | last post by:
Hello everyone, I am fairly new to MACT, I am currently trying to parse the oResponse.Body to retrive a dynamic values...store in an array and then randomly post those values. Does anyone...
1
by: Anthony Abbot | last post by:
Hi I have a requirement to use the Application Center Test (part of Visual Studio.Net Enterprise architect) program, to simulate loading on my Web servers. Does anyone know if it is any good? I...
0
by: PrettySneaky | last post by:
I have at the moment written two webservice prototypes and I am trying do some stress testing with Microsoft application center test. My web page communicates with the the webservice like this: ...
2
by: mobiletornado | last post by:
I am using visual studio .net 2003 enterprize architect. My application test center is version 1.0.536 I am runnign window xp home edition. I have stated a new test. I chose to record a new test...
0
by: Prometric Test center | last post by:
Bangalore's Best Prometric Test center (like Microsoft, Sun Microsystems, Dell, HP) Hi, Greetings from Everonn!!!! Are you looking for the good Prometric (like Microsoft, Sun Microsystems,...
0
by: Prometric Test center | last post by:
Bangalore's Best Prometric Test center (like Microsoft, Sun Microsystems, Exin - ITIL, Dell, HP) Hi, Greetings from Everonn!!!! Are you looking for the good Prometric (like Microsoft, Sun...
0
by: Prometric Test center | last post by:
Best Prometric Test center in Bangalore (like Microsoft, Sun Microsystems, Exin - ITIL, Dell, HP) Hi, Greetings from Everonn!!!! Are you looking for the good Prometric (like Microsoft, Sun...
0
by: Prometric Test center | last post by:
Best Prometric Test center in Bangalore (like Microsoft, Sun Microsystems, CISCO, Exin - ITIL, Dell, HP) Hi, Greetings from Everonn!!!! Are you looking for the good Prometric (like...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
1
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
0
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
1
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: af34tf | last post by:
Hi Guys, I have a domain whose name is BytesLimited.com, and I want to sell it. Does anyone know about platforms that allow me to list my domain in auction for free. Thank you
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.