We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
"We appreciate that the solution is free to use, as an open-source tool."
"When there's a high number of TPS I can achieve more transactions per seconds given the hyper-limitations."
"The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good."
"The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences."
"The performance of the solution is excellent."
"User-friendly and open source."
"Very user-friendly and easy to use."
"The most valuable features are the integration with Jenkins and the reporting."
"This is a product that is well ahead of its immediate competition in features and functionality."
"It is easy for a non-technical person to use and adopt."
"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
"The initial setup is pretty straightforward and easy enough to complete."
"The scalability of the product is good."
"The most important feature is the Jenkins integration; it is pretty straight forward and allows us to run nightly builds."
"I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy."
"It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
"They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available."
"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."
"The reporting is not very good."
"It should start supporting the presentation layer. It currently provides performance testing specifically at the application and API level. It can be extended to the presentation layer, which includes mainly Angular and React frameworks. It should also be easy to use and easy to train people."
"The solution needs to improve reporting. Currently, there is not enough automation involved with the feature. For example, there should be an automatic way of saving reports."
"We're like the solution to be more user-friendly."
"The plug-ins make the reports heavy and they have to be run in non-GUI mode."
"JMeter output reports can be difficult to understand without training."
"We have had some issues when it comes to stability, which is something that needs to be improved."
"It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"It would be helpful to have an automatic save feature."
"There could potentially be more reporting within the solution. We need more issue reports, for example."
"It would be helpful if they can integrate a feature for performance testing."
"The free version of the solution is not user friendly at all."
"I was using the free version of the software."
"This is an open-source product."
"When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"
"I haven't looked into it. Most of our projects are nonprofit or grant-based. Everything is public commons, so we don't really have to worry about that so much."
"We are using the free version, and if required, we can easily switch to the other version."
"In terms of open-source adoption, it is completely free."
"Katalon Studio is a free tool."
"There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well."
"We are using the free version of Katalon Studio at this point."
"I am using the free version."
"We were using the free version of this tool."
"The price is not high it's good."
"We are using the free version. We plan on getting a paid version because there is a limitation in terms of the number of users. We want to maximize it."
"Its pricing is quite reasonable. If you require their help in getting started, then there is a professional services fee on top of the product license cost."
Apache JMeter may be used to test performance both on static and dynamic resources, Web dynamic applications. It can be used to simulate a heavy load on a server, group of servers, network or object to test its strength or to analyze overall performance under different load types.
Katalon Studio is a simple and powerful automation solution built by KMS Technology for testers everywhere. The tool provides features comparable to popular commercial solutions while eliminating the hassle of building an automation framework from open sources. Best of all, we are committed to keeping Katalon Studio free.
Apache JMeter is ranked 4th in API Testing Tools with 17 reviews while Katalon Studio is ranked 7th in API Testing Tools with 14 reviews. Apache JMeter is rated 7.6, while Katalon Studio is rated 7.6. The top reviewer of Apache JMeter writes "Easy to learn, and free to use but could be more user-friendly". On the other hand, the top reviewer of Katalon Studio writes "Powerful yet easy-to-use and focuses on the end-user as well as interface testing". Apache JMeter is most compared with Postman, BlazeMeter, Micro Focus LoadRunner Professional, ReadyAPI and LoadUI Pro, whereas Katalon Studio is most compared with TestProject, Tricentis Tosca, SmartBear TestComplete, Ranorex Studio and Micro Focus UFT One. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.