TA basics: Making screenshots when scenarios fail

A picture sometimes says more than words. This is also true for test automation. Therefore it could be that you want your framework to make a screenshot when a scenario is failing to make debugging more easy. But how can you make sure your framework does this for you?

Since we're using the `lapis_lazuli` gem, this is actually already been taken care off for most scenario's, but if you're using the 'watir' gem, you need to modify your `hooks.rb` file like briefly described on this page. Let's first look at Watir and then move to LapisLazuli to see what advantages and disadvantages are between the two.

Watir screenshots

Watir by default does not make a screenshot of a failing test, so you need to write some code to make this work. Below a Watir example
Keep in mind that this only makes a screenshot at the end of the scenario. Meaning that it can happen that the screenshot is being taken a fraction later and thus missing the real issue. So let's take a look at how LL solves this.

LL screenshots

When using LapisLazuli you don't need to put anything in the `hooks.rb`, the only thing that you need to have enabled is `screenshots_height: full` in the `config.yml`. This takes care of what you otherwise manually need to code with Watir, but there is another nifty trick. LL also makes a screenshot right at the moment a `find` or `wait` command fails. So if it can't find the element you need it immediately takes the screenshot. So LL takes away the hassle of coding this and makes sure that the screenshot is taken at the moment the test failed.

The catch

But there is one catch. And that is a rare occasion where a `elm.click` is failing (e.g. when an element is overlapping the one you want to click, like the picture of this blog) and you make use of `browser.refresh` functionality in `hooks.rb` with the current version (v2.1.4) of LL. What happens is that the scenario fails (because a click was not possible), but you first go through the hooks which will refresh the browser. Meaning the screenshot is being taken after the refresh of the browser, so you don't see the actual issue which was so conveniently being captured in a screenshot for you (see this screencapture). This issue is logged on github to track here.

Workaround > Use Watir

Location: Leiden, Netherlands

Comments

Post a Comment

Popular posts from this blog

PowerShell - How to overcome Azure VM's fixed resolution limitation

Image
Intro This is the first in a series of PowerShell blogposts. I don't know a lot of PowerShell so I'm going to cover this part very short. What is PowerShell? PowerShell is a very powerful framework you can use to automate tasks. For more info, use Google or check the Wiki:  https://en.wikipedia.org/wiki/PowerShell For my current project we use Azure VM's that we use as selenium-grid (hub and nodes). And Visual Studio Online for kicking off builds. So I started to use a fair share of PowerShell in my test automation process. During the setup I came accross a couple of problems that I want to share with you all which I'll spread across a couple of posts. And we start with Azure VM's that have a fixed resolution of 1024 x 768 and how to overcome this issue/limitation. Azure VM's resolution limitation  Let's start with the problem we faced. Our website under test, requires the test machine to have at least a certain resolution ( Which is > 1024 ...
Read more

TA Basics: Website Test Automation on mobile devices via Appium server

Image
Recently I have been focussing on test automation with mobile devices. Specifically Android and iOS (no Windows phone because that platform is as good as dead at the moment). I first wanted to make a complete manual from setting up software and devices/simulators up to a small test script. But due to lack of time I'll focus on specific parts. If you have any questions reguarding the setup, feel free to contact me. So all that said, let's get to the point. The internet is full of blogposts, video's and examples of people testing mobile apps. However I don't test an app, I want to do some web test automation on mobile devices. It took me quiet some time to figure out what exactly I had to use to get it all to work as needed for my project. Setup Mac mini running OSX 10.13.4 High Sierra (Mac machine is needed for iOS simulation) Ruby version 2.5.0p0 (2017-12-25 revision 61468) [x86_64-darwin17] Appium desktop version 1.4.1 (with Appium server 1.7.2) lapis_laz...
Read more

TA: Who doesn't like proxies? Me!

Image
Are you on a company network that is using a proxy to connect to the internet? And do you want (or are you planning) to connect your tests to an external selenium-grid. Than stay tuned, before you get lost in a bunch of answers on the internet that don't resolve the issue you're facing. Source:  https://nl.wikipedia.org/wiki/Proxyserver I'm on a new project and looking into Robotframework. But then I bumped into an issue with the POC I had to make which might result in me convincing the company to switch to Ruby. Anyway long story short. They use a proxy and although the internet has all the answers, you do need to know what specific question to ask to get the correct result. And since proxies are not used that much anymore, it's hard to find the skilled people to help you out and push you in the right direction for a solution. The setup To access the internet, I need a configuration on my computer that will tell Windows to connect to a proxy server. I...
Read more