We changed our name from IT Central Station: Here's why
Get our free report covering Apache, Micro Focus, Tricentis, and other competitors of Silk Performer. Updated: January 2022.
564,322 professionals have used our research since 2012.

Read reviews of Silk Performer alternatives and competitors

reviewer1329360
Performance Architect at Kohl's
Real User
Top 20
Has monitoring capabilities integrated into it to see the performance of components while the test is in the running phase
Pros and Cons
  • "NetStorm can generate high load with a single machine. Its Runlogic feature is very useful to send load to cover each and every flow of the application. NetStorm gives the feasibility of generating load with multiple load arrival models helping components to be tested based on its usage."
  • "The user interface had to be improved for the product. Its user interface should be made simple and easy to customize as per user needs."

What is our primary use case?

I have used NetStorm primarily for load generation to do load and stress tests on the desktop and mobile platforms of Kohls.com. I was able to generate high load with NetStorm which helped identify the performance bottlenecks of the applications in the project phase itself. NetStorm script can be generated on any environment and can be replayed to run load test on different environments. It has great features like Runlogic, autocorrelation, and monitoring capability associated inside it.

How has it helped my organization?

NetStorm had made Kohls.com very stable in the ATG platform as well as a cloud platform that Kohls didn't have any issues during the major holiday season like Thanksgiving, Black Friday and Cyber Monday. NetStorm had been used to test each component of our application stack to its capacity and made sure Kohls.com site is always performing fast for the customers. We do breakpoint tests of each component using NetStorm and then perform the integrated solution performance test by running load, stress, and endurance tests.

What is most valuable?

NetStorm can generate high load with a single machine. Its Runlogic feature is very useful to send load to cover each and every flow of the application. NetStorm gives the feasibility of generating load with multiple load arrival models helping components to be tested based on its usage. NetStorm has monitoring capabilities integrated into it to see the performance of components while the test is in the running phase. One more great functionality is the ability to control the load runtime by increasing or decreasing the virtual users or pausing the users to keep on repeating the transactions without exiting.

What needs improvement?

The user interface had to be improved for the product. Its user interface should be made simple and easy to customize as per user needs. Integration with APM and log monitoring tools is good and easy but the user interface of the customization also needs improvement. 

One more feature which needs improvement are the ready reports. Its reports have great features but need to be customized which is not easy for a normal user. So ready reports should be given with templates which can just be used out of the box.

For how long have I used the solution?

I have been using NetStorm for the past eight years and it is a great load generator tool.

What do I think about the stability of the solution?

NetStorm is a highly stable product. All the features of the product can be used with no issues.  

What do I think about the scalability of the solution?

NetStorm is having the capacity to scale high and generate more load using a single machine. One single NetStorm can be used to do a load or stress testing of multiple components. If you want load generation from multiple geo-locations, you can switch to the NetCloud load generator of the same organization.

How are customer service and technical support?

Customer service at Cavisson is 24 hours a day. Their support is so impressive as they respond within no time for any issue faced. They give utmost priority to the client and help us overcome the problems.

Which solution did I use previously and why did I switch?

We have used multiple load generating tools before moving to NetStorm. NetStorm gave us the flexibility to generate load to different components differently using its VUser arrival rate models. Also, features like run logic progress, scenario progress, runtime comparison gave us more in-depth of performance bottlenecks.

How was the initial setup?

NetStorm setup is pretty straightforward and easy. You just need to runt he setup file given which can take care of setting all the configurations required. 

What about the implementation team?

Implementation was done along with the Vendor team. They are experts in implementing and servicing their suite of products. The team that implemented it in Kohls is highly skilled and confident.

What was our ROI?

We use NetStorm daily for doing load or stress tests and achieve capturing the performance bottlenecks of the applications during project level testing itself.

What's my experience with pricing, setup cost, and licensing?

NetStorm setup is so easy. It can be installed on any Linux or Unix box or windows machine on-Prem or cloud. I'm not so into the pricing of the product but heard that it is competitive and less when compared to other load generating tools. A single license of NetStorm can generate a high load to test multiple components at the same time.

Which other solutions did I evaluate?

We have evaluated different tools like Load Runner, Silk Performer but NetStorm and its company's product suite gives more integrated load generating, monitoring and analyzing capability.

What other advice do I have?

It's a great load generating tool with integrated monitoring capability. The company has a highly talented client support to provide their services round the clock.

Which deployment model are you using for this solution?

Private Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Google
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Global IT Digital Test Manager at a healthcare company with 501-1,000 employees
Real User
Top 20
Good reports and analysis capabilities with a quick initial setup
Pros and Cons
  • "The reports and analysis tools are very good. They are the solution's most valuable features."
  • "It's not easy to get the data from one place or to do customizations."

What is our primary use case?

We primarily use the solution to manage our capabilities. Wherever the business goes, we need to work within the expected benchmark. In terms of the user bases we deal with, most of these are products from different locations with different types of functional flow-out. There are environmental integrations also running in the background, which a user is basically accessing while going through a particular workflow. 

We'll also handle the reporting section of our data management responsibilities utilizing this system.

What is most valuable?

The reports and analysis tools are very good. They are the solution's most valuable features.

What needs improvement?

The GUI could be improved. When we go into GUI mode, there are occasions where it will not sync with our expectations. There are crashes that happen that will stop the solution from performing. It seems we get minor glitches when we go into GUI mode.  

The data client architecture that we have isn't so great. If we are to consume the data, it won't clear because there is tech running on different agents. 

When I need to pull the reports from different agents, it's not user-friendly. The reporting can be difficult to handle. It's hard to increase it if you are working on a client's architecture.

It's not easy to get the data from one place or to do customizations. 

There are other solutions that allow users to model their load and structure with them. You can't do that on JMeter. 

On other solutions, like Silk Performer, you can do network packeting, which you can't do on JMeter. They should add this to the solution as a capability in the future.

The support management needs improvement. Support is coming from consultants; you will not be able to get on-premise support from all of their agents in one place. On Silk Performer, for example,  they have the capability where you can basically have a summarized report from different agents.

For how long have I used the solution?

Personally I've been using the solution for the last 10 years. However, in the program we are in, I've only been using this tool for six months.

What do I think about the stability of the solution?

If you want stability, you will have trouble, because the system is not uniform. You have to do a lot of modeling. 

If you're talking about mobile platforms, JMeter will not allow you to capture the performance of applications on your mobile platform. It's an area where the solution is lacking. It doesn't have the capability to allow developers to check the performance on an AP app.

What do I think about the scalability of the solution?

You can scale the solution, but you will run into issues if you want to run, say, 1,000 users.  You will have to configure multiple agents and then distribute your load. It's quite difficult to manage everything on a single agent.

How was the initial setup?

The initial setup is straightforward. We found it quite easy. For us, it wasn't complex at all. The solution is up and running quite quickly and doesn't take long at all to set up and deploy.

Which other solutions did I evaluate?

We've looked at Silk Impact and Load Balancer in the past. Each of these solutions offers a few different functionalities that aren't necessarily available on JMeter. For example, on both, there are more network features available that aren't included in JMeter and you can model your load and structure with them as well.

What other advice do I have?

If companies have mobile development, they should use JMeter. If they want to integrate it with the PA pipeline, JMeter will work well. However, there are other platforms and solutions as well.

Other options include Silk Performer and Load Impact. These two solutions have other capabilities that JMeter doesn't have. You can basically model your load and structure with them. You can't do that on this solution. On Silk Performer, you can also do network packeting, which you can't do on JMeter.

Then there are some network features available in Load Impact as well as Silk Performer that aren't in JMeter. 

I'd rate the solution eight out of ten. The solution has certain limitations, but it's still a good product. 

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Test Automation, DevOps & Performance Engineering at a financial services firm with 10,001+ employees
Real User
Top 20
Support many different protocols, but integration with the CICD pipeline should be easier
Pros and Cons
  • "The most important feature for us is that it supports a lot of protocols because we support all of them, including HTTP, FTP, mainframe, and others."
  • "The product is pretty heavy and should be more lightweight."

What is our primary use case?

We use this product to test our web application that is used for internet banking.

What is most valuable?

The most important feature for us is that it supports a lot of protocols because we support all of them, including HTTP, FTP, mainframe, and others. This means that it is very scalable.

What needs improvement?

I would like to see easier integration with our CICD pipeline.

The product is pretty heavy and should be more lightweight.

I would like to see a browser extension where we can start the development. This would be helpful because right now, this solution is good for UTM integration and performance testing, but if we want to scale then it is difficult.

For how long have I used the solution?

I have only been using LoadRunner Professional for a short time because I just joined the company, and I used to work with open-source technology.

What do I think about the scalability of the solution?

We have six or seven people using this product.

How are customer service and technical support?

As we have just begun using it, we have note let had to contact support.

How was the initial setup?

The initial setup is pretty easy. This product is Java-based and you just have to add the independent libraries and dependencies. It is more of a client-server based architecture

What's my experience with pricing, setup cost, and licensing?

This is not a cheap product.

Which other solutions did I evaluate?

I have primarily used JMeter, which is open-source and free to use.

I have also used Silk Performer, although that was a long way back.

The suitability of one solution over another is very dependant on the use case. When it comes to performance testing, it is very specific to the use case. It depends on your goal and what you want to do.

What other advice do I have?

These days, testing is not a separate activity. It's more about how fast you can quickly deliver and time to market. This is a product that I can recommend, although it depends on the use case. The first question has to be one of budget because LoadRunner is not cheap. Things differ from company to company. At the same time, not all of the free tools can perform all of the functions. It is based on requirements.

If they're a small company, such as a startup e-commerce company, then they might be better off implementing an open-source product.

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

Private Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Get our free report covering Apache, Micro Focus, Tricentis, and other competitors of Silk Performer. Updated: January 2022.
564,322 professionals have used our research since 2012.