Follow Us

Load testing with Team Foundation Service – Launching Preview and Early Adoption Program

As announced with Visual Studio 2013 launch, cloud based load testing with Visual studio Online is in Commercial Preview. This is open to all Visual Studio Online users. You can read more about it here

All users of Team Foundation Service will be able to run load tests on the cloud starting today. This capability is free for now, and we have a limit of 15,000 virtual user minutes per Team Foundation Service account per month during the Preview period. Ex: If your load test consists of 250 concurrent virtual users, you will be able to run this test for a total of 60 minutes per month.

We encourage you to run your tests using the service and provide us feedback to help improve the service. You can learn more about usage limits in the FAQ section of the troubleshooting guide. Please note that load testing capability is in Preview and the free usage limits could change in future.

We are also announcing an Early Adoption Program if you want to run more load tests per month. To sign-up for this program, please fill the form here with your requirements and we will contact you as soon as possible. As part of the early adoption program, you also have the opportunity of providing feedback directly to the product team. Our Early Adoption Program is complete and we thank all the users who participated in Early Adoption Program and provided us valuable feedback.

So, what next? Go ahead and download Visual Studio Ultimate 2013 Preview. Run load tests using the service, and let us know what you think. If you like it, you could sign up for the early adoption program. We look forward to your feedback and hope this capability is useful for you.

Share This Post

Comments

Hello,
We are using VSTS to run testing on a cloud application. We are running into an issue where we can't get any monitoring metrics from the cloud servers to be pulled into the VSTS load test run. Has anyone else experienced this issue and if so what was your workaround?

Hello Lenny,
We currently do not support collecting monitoring metrics from your application-under-test into the load test reports, when you run load testing using the service. However, this feature is on top of our backlog and we are working on enabling it soon.
Thanks.
-Darshan

Hi,
Just like Lenny, I was searching for the support of showing the metrics of the systems under test (the Azure instances) too. Because there isn't something available yet, except for the Cerebrata tooling, I wanted to start developing something myself using the monitoring metrics of Azure.
After reading the response of Darshan here I think it's best to wait for this default funciontality to become available. Can you tell us an estimate on when this functionality will become available?
On another note, can we check what's on the backlog of the team and what's being developed at the moment? Or some other project/planning notes on which features will become available in the future?
Would be great, so we know what can be expected and don't have to spend time developing something which is already on the backlog.
Thanks in advance!

Jan,
I cant give you a date when the functionality will be available since I don't know the date at this point. However, given it is on the top of our backlog, it will be delivered in the coming months.
Your suggestion around being more transparent about our backlog is a good one. Let me see how we can action that. For now though, I had shared some items from our backlog in my talk at TechEd in June. You can watch it here (go to 0:55:40): channel9.msdn.com/…/WAD-B304
Thanks.
-Darshan

Hello,
We are trying to evaluate this tool since our customer is expecting a hit 100 K users per month on their Azure hosted site. Mostly expecting 20K users hitting their site concurrently. It will be great if you can share the following details with us
1) Cost related to the above mentioned scenario
2) About Setting of different Bandwidth for a test
Thanks

Vinoth,
1. Currently load testing is free and in Preview. You can get your capacity increased by joining the Early Adoption Program (EAP) by filling this form: connect.microsoft.com/…/Survey.aspx
Once you join the EAP, you can very much try out your scenario and let us know if you run into any problem.
2. You can simulate different bandwidths using the network emulation feature for load tests: msdn.microsoft.com/…/ms182594.aspx
However, we currently do not support network emulation for load tests run using Team Foundation Service. That feature is on our backlog and will be enabled soon.
Thanks.
-Darshan

Darshan,
Thanks for the Update. One more question. Do we need to have VS Ultimate to do the performance testing?
As per the link below it seems we needVS ultimate to do Cloud-based load testing powered by Team Foundation Service. Kindly Confirm the same
Thanks

Vinoth,
That is correct. Performance and load testing capability is only available in VS Ultimate. Therefore, you need VS Ultimate for any kind of performance/load testing – local, on-premises, or cloud-based.
Thanks.
-Darshan

Hello,
I am using VSTS 2013 ultimate for doing load tests in azure. How can i know what is my agent machine(instance) to make sure that i am able to browse my test URL from that location.
Regards
Ayyappa

@Ayappa,
You'll not have direct access to the test agent machine when you run tests on Azure. Your test agent is a virtual machine in Azure. So, as long as your application end-point is publicly accessible, it should work fine. I suggest you run a small test with minimal load and just 1 load agent to see if your tests pass. If the tests fail, the error should give you an idea of what's wrong.
Thanks.
-Darshan