Topics

Featured in Development

Peter Alvaro talks about the reasons one should engage in language design and why many of us would (or should) do something so perverse as to design a language that no one will ever use. He shares some of the extreme and sometimes obnoxious opinions that guided his design process.

Featured in AI, ML & Data Engineering

Today on The InfoQ Podcast, Wes talks with Katharine Jarmul about privacy and fairness in machine learning algorithms. Jarul discusses what’s meant by Ethical Machine Learning and some things to consider when working towards achieving fairness. Jarmul is the co-founder at KIProtect a machine learning security and privacy firm based in Germany and is one of the three keynote speakers at QCon.ai.

Featured in Culture & Methods

Organizations struggle to scale their agility. While every organization is different, common patterns explain the major challenges that most organizations face: organizational design, trying to copy others, “one-size-fits-all” scaling, scaling in siloes, and neglecting engineering practices. This article explains why, what to do about it, and how the three leading scaling frameworks compare.

WebLOAD: Commercial Load Testing Tool Recently Open Sourced

WebLOAD is a load testing tool from Radview software that tests for performance and scalability but also for verifiability (validating the correctness of return results). Test scripts are written in Javascript (with COM/Java object integration), and the tool supports multiple protocols for testing all tiers of an app such as web (REST/HTTP with Ajax support), SOAP/XML, and other protocols callable from within scripts such as FTP, SMTP, etc. Radview claims over 1600 customers and 12 years of development experience producing WebLOAD, who released v8 of it's professional version in Feb. This past April Radview released an open source community edition of WebLOAD under GPL, available at webload.org.

Chris McMahon commented that "Open source load testtools have been kinda sorta OK for some time, but performance testing is the only case where commercial alternatives are pretty much universally acknowledged to be superior to open source tools. Building good performance test tools is hard. What RadView has done has instantly changed the whole scene."

The professional edition is built on the community edition, the most notable difference between the two being that load generation on the open source version is limited to what one server can generate (but without any concurrency limits). The professional version also supports more reporting and protocol options.

WebLOAD is usually used as a standalone tool by QA teams, in the validation/verification phase of the development life-cycle, to test the System under Test (SUT) in the staging/testing environment before going into production.

In some cases, WebLOAD is used also in the production environment, to perform application monitoring, as it can provide excellent statistics about the system’s health and even send email notifications the moment a problem occurs.

Less common is to use WebLOAD earlier in the development phase – but we’ve seen it done. Generally speaking, we – as well as other testing experts – believe performance testing should start as early as possible in the development life cycle. For example, WebLOAD could be used to write unit tests for Web Services, Java and COM objects and other interfaces of the SUT. Using its command line interface, WebLOAD can execute these tests as part of an automated build process.

WebLOAD also has a command line interface that allows executing in batch mode (not from its UI). Rami explained that "a test script can be prepared in advance and then run using this command line interface from any ALM (automatic lifecycle management) or continuous integration tool, in a very similar manner to JUnit."

Rami positioning WebLOAD as being superior to the other two most commonly used open source load generation tools:

JMeter

JMeter only provides visual editing vs. Java Script editing that is available with WebLOAD, which provides much more flexibility in creating test script

JMeter is JAVA only and thus doesn’t support execution of COM objects from the test script

JMeter supports less server monitoring protocols than WebLOAD does.

JMeter doesn’t support recording of HTTPS web sites

WebLOAD’s analysis and reporting capabilities are superior to those of JMeter

OpenSTA

OpenSTA is not cross platform – it’s load engine can run only on windows

Functionality wise, the tools match, but OpenSTA is much harder to learn and use – its development environment is not intuitive and its scripting language is not standard and thus harder to learn

No new version of OpenSTA was released in the last 2 years. This project is practically dead.

An interesting feature of the professional edition is capacity planning testing features such as "test until 80% utilization i reached", Rami explained how it worked:

WebLOAD goal-oriented testing, AKA Cruise Control is based on patented technology, developed by RadView. Basically, you need to define a set of goals to WebLOAD (these goals can be combined using logical and/or conditions). These goals are constantly checked and when they are reached, the user gets a notification. The user can decide beforehand whether to stop the test when the goals are reached or should it continue.

RadView has received VC funding, it's most recent round raising $3.5 million from Israeli institutional investors. Rami said "the funds will be used to enhance WebLOAD Open Source, expand the webload.org community and bring new features to market such as multimedia and Oracle Forms support." In the future they also plan to replace the existing WebLOAD UI modules with Eclipse based modules, making the UI's also available as Eclipse plug-ins.

Re: Limited & Open Source?

Your message is awaiting moderation. Thank you for participating in the discussion.

The documentation and marketing information on Webload "open source" is very misleading. According to Radview's user forum, the WebLOAD Open Source engine works with a proprietary unified script authoring environment for recording, editing and debugging. Part of the tool is offered free under a proprietary license and no source code is available.

To answer Geoffrey's question, the thing that stops the user community from adding functionality appears to be;1) Unlike other open source projects, Radview is not motivated to have a wide base of developers (outside their control) working to improve Webload open source. They offer a commercial version, and the fact that Webload Open Source could be modified to compete with it may be a contributing factor2) The source code is changing so fast (bug fixes) that a fork of the code base at this point would not be practical.