Sauce Labs

PROS & CONS

What are the best aspects of this product?

With SauceLabs we had the opportunity to scale our automated tests for web application UI to several browsers so it was difficult because we were forced to implement browser-specific forks in our code, but it was very easy to achieve that with its unified API, instead of setting up several environments on our testing servers. We were able to catch the traffic that our app produces on Sauce Cloud machines for testing, using this nice Sauce Connect feature.

What aspects are problematic or could work better?

SauceLabs website has plenty of documentation and you have to search for a bare working example. We could not start our mobile application at SauceLabs because of their spreading of example for mobile tests throughout several pages in their documentation. Lots of parameters of Sauce Connect, Rest API are very poor documented so we wasted lot of time to find out the working code with valid values. Its support sometimes is good, sometimes is bad. Sometimes they transfer me to the Engineering team without knowing when the problem will be resolved. Other thing I dislike is that they often edit by default in case to make them more testable. It brings unexpected behavior to test, for instance, it uses Safari with 3rd party cookies and here is no way to change this, but original feature of Safari is to disable them.

What specific problems in your company were solved by this product?

We run integration and UI tests for our application and we check if it is not broken and application produces various date while run on different platforms.

Are you a current user of this product?

Yes

PROS & CONS

What are the best aspects of this product?

There are many things that I like about Sauce Labs, but what I like most is the ability to create clean vm for each test, and I am able to take the maintenance of vm out of my daily work. Also, I am able to create various OS and Browser combinations and those are very hard to do manually, so Sauce labs works great. I like the idea to install only one browser instead of installing multiple for running tests. I get my test results with videos and screenshots and everything I need is in one place. And last but not least, the customer support team is excellent, always helpful and responsive, they have helped me with every issue I have faced.

What aspects are problematic or could work better?

Oh, I don’t like to use the word “dislike” about this product, because as I said before it works perfectly well. There are things I would like to see improved. When you run single test on Sauce they run fast, but the thing is if you have several in the same time, but, it’s not a big deal. I would like to run my automations (for mobile device) on real devices vs in simulators and emulators. If they could improve the performance and make a connection with real devices there won’t be a need to host own test environment anymore.

What specific problems in your company were solved by this product?

It helps me to create test environments quickly, and that’s a big thing from sauce. Also, the other benefit is having videos and screenshots for tests.

Are you a current user of this product?

Yes

PROS & CONS

What are the best aspects of this product?

Sauce Labs is smart app that allows me to tackle all testing challenges I have. It offers many testing platforms. I use this software because of the mindset on device, easy to set up, better communication with my account team, pricing and technology. Even though their device list is not as big as the list from other vendor, I don’t have to wait for each device to run on, I can do it whenever I want on the device I want. The other thing I like is that I don’t have to pay for accessing a device and concurrency.

What aspects are problematic or could work better?

I have seen that some of my tests are not completed, but I believe they will improve this one. Also, the troubleshooting doesn’t work as it should, I cannot check why some of my tests failed. I have found that the Real Device pool is somewhat limited. I would love to see some things expanded and improved.

What specific problems in your company were solved by this product?

We use Sauce so we can be sure that we can play the videos back across other real devices.

Are you a current user of this product?

Yes

PROS & CONS

What are the best aspects of this product?

Sauce’s service is straightforward to use and is consolidated with the tests that exist. To add, the customer service is magnificent and I like when they are coordinated with the testing and DevOps industry

What aspects are problematic or could work better?

There is nothing much I do not like, except the problem with their manual VMs that are very slow to use and it would be great if they could make their design better.

What specific problems in your company were solved by this product?

The main business problem I am targeting to mention is to have an infrastructure and platform for supporting my existing and new tests automation that cover a vast of sites and my responsibility is to test them. Having a service like Sauce Labs gives me the opportunity to run my tests in the cloud fast without taxing my local setup with tests that are running all the time in the background while I work something else.

Are you a current user of this product?

Yes

PROS & CONS

What are the best aspects of this product?

Sauce labs offers many platforms for running tests, and support for all great frameworks and it works great with Jenkins. I love its flexibility because it can be used in many ways. It has dedicated UX team and they really care of their customer’s experience and they do everything to improve themselves, their engineers are very responsive and knowledgeable.

What aspects are problematic or could work better?

I don’t like that when their infrastructure code is updated no one gets notification about the update. So, I don’t update anything and I face some breaking issues or test failures. So I have to figure out what’s going on and what went wrong and where, this is time wasting process and I end up with sending customer support ticket to the Sauce Labs.

What specific problems in your company were solved by this product?

We are an e-commerce company and we make sure that the areas of our site is working 24/7 especially areas where our customers spent more time. And it is a fact that if any part of the site is down we can lose potential purchases and potential customers. With this software in 15minutes we are able to check each area of the site, without worrying about QA or engineering. This is the most important tool in our development process.

Are you a current user of this product?

Yes