Subscribe to Methods & Tools
if you are not afraid to read more than one page to be a smarter software developer, software tester or project manager!
Subscribe to Methods & Tools
if you are not afraid to read more than one page to be a smarter software developer, software tester or project manager!
This year the Software Quality Days, one of Europeâ€™s most comprehensive events on software quality, took place from January 18 – 21, 2016 at the hotel Savoyen in Vienna. As a team of three, we represented Ranorex and made sure to tackle hot topics in test automation. Now that weâ€™re back, weâ€™d like to quickly recap this event for you.
As part of the Solution Provider Forum, I gave a talk on the â€śAdvantages of a unified approach for cross-technology testingâ€ť. With the growing importance of multi-channel services, DevOps and the IoT, I strongly believe that a particular testing approach is required to provide customers with the quality and user experience they expect: cross-platform end-to-end testing. As part of my presentation, I demonstrated how these tests can easily be created with Ranorex and how we, already, support automated testing of wearables.
Back at our booth, we couldnâ€™t wait to connect with prospect customers, answer questions, give live demonstrations and exchange thoughts on testing in general. The direct interaction with those interested in Ranorex was, as always, invaluable and the range of topics immense. While companies still relying on manual testing were fascinated to see how quickly and easily automated testing with Ranorex can improve their testing process, we were also happy to use our mobile devices and laptops to demonstrate in face-to-face interactions which automation approach best works for individual testing scenarios. A topic that sparked a lot of interest at our booth was definitely the upcoming Ranorex release, which will include remote test execution and support of Git. We also took this event to talk to potential future as well as current partners, such as imbus and Neotys, and were delighted with discussing possible integration use cases that will soon be available to our customers.
We definitely had fun at this event. While we were busy showcasing our product, we also put our Ranorex stress ballsÂ in an informal juggling competition to good use â€“ and were promptly awarded as most creative exhibitor.
The conference ended with an inspiring message from Hannes Treichel: Â Donâ€™t just try solve a problem by trying to figure out which steps youâ€™ll have to take to reach a desired solution. Instead, ask yourself: â€śHow can I get from a desired outcome back to my problem?â€ť.
Stop by for live demonstrations and expert talks at our Ranorex booth at these upcoming software testing events.
We hope youâ€™ve all had a relaxing holiday season and a fantastic start into the new year. Now itâ€™s high time to get ready for test automation again. Letâ€™s start by looking at some upcoming test automation trends we need to watch out for in 2016. Ranorex is ready for these new testing challenges!
1.Â Quality Enhancement and Cost Optimization
Todayâ€™s technology makes it easy for us to compare and review software products. As quality expectations rise, itâ€™s become an increasing challenge to meet the customersâ€™ exceeding demands. Providing the best possible software quality is always linked to increasing development and testing costs. To optimize these costs, it is important to shift from manual to automated testing environments. Yet user interface testing, a cost intensive part within the testing process, is still often done manually. Using functional test automation for this part would tremendously increase the software quality and optimize testing costs. This topic will become even more prominent in 2016.
2.Â Cross-Device and Cross-Technology Testing
When software was still a rather simple idea, testing was no magic. Testing of a standalone instance was pretty easy and isolated. Today, in a world of interconnection, things have changed. Tools often communicate with systems in the background. Everything and anything is connected to the Internet, can interact and exchange data. This process is coined with the term â€śInternet of Thingsâ€ť (IoT). As seen in the example of smart watches, the IoT is on the rise. Testing is required to cope with these new challenges. In the year 2016 it will be more important than ever for tests to be able to validate cross-device and cross-technology functionality.
3.Â Agile Testing and Continuous Integration
The practice of agile testing responds best to the challenges of 2016, where itâ€™s all about high quality software, speed and interaction. The importance of recognizing and responding to changes in the software immediately, has been proven. However, itâ€™s never been said that high-performance agile testing is easy, as software testers must be involved in every aspects of the software development process. New tests are generated continuously and added to existing automation in parallel to the software development itself. Agile development utilizes continuous integration tools such as Jenkins or TeamCity. These tools facilitate the integration of automated tests, resulting in frequent and faster software releases.
4. Cloud-Based Testing
One of the hottest trends in 2016 is cloud-based testing. When it comes to testing web applications, there is an ever increasing demand in combining cloud-based testing solutions with continuous integration. Due to the unlimited storage, quick availability and flexibility of a distributed testing environment, it is possible to reduce the execution time of software tests. This makes this combination particularly interesting. This type of testing enables companies to run automated web tests in different environments and on multiple machines without having to build their own testing infrastructure. Due to the scalability in cloud-based testing, companies can bring high-quality software faster and cost-efficiently to the market.
5.Â Integration of Test Automation into DevOps
In todayâ€™s fast moving world, clients push for faster software releases. To achieve these ambitious goals, new software testing practices are required. 2016 will see the rise of a concept called â€śDevOpsâ€ť. This term encompasses ideas of development, testing and operations and combines practices such as continuous integration and continuous delivery, fostering the rapid development of high-quality software. In order for this concept to work, the software functionality has to be resistant to changes. It further requires a high level of test automation to ensure quality and efficiency throughout the lifecycle of a software application. Thus, automated testing has to be an integral part of DevOps. In order to establish a functioning DevOps environment, test automation will be on everyoneâ€™s lips in 2016.
6. SMAC Testing
With the emergence of apps using SMAC (Social, Mobile, Analytics and Cloud) on smartphones, wearables or connected devices like televisions, the value of testing SMAC apps in 2016 has been driven to a higher level. These apps have to be tested for the following parameters: functionality on different devices and platforms, load, performance, security and usability. Therefore, the need for robust and secure cross-technology test automation strategies is higher than ever before. The ability to secure sensitive â€śSMAC dataâ€ť, such as user data in the cloud, is an essential factor when it comes to choosing a strategic testing approach.
7.Â Pair Testing
Itâ€™s a proven fact that the overall efficiency improves when testing and development teams work closely together. Quite understandably, this has become a growing trend, as it allows to quickly bridge communication gaps and further facilitates the immediate resolution of issues. Although everything but new, pair testing has recently experienced an upsurge. The advantages are seemingly endless; leaving the â€śdeveloper-tester conflictâ€ť in the past, they work together as partners, speeding up the automation of testing scenarios â€“ and with it the production of high-quality software.
Looking at these trends, we believe that a bright future of test automation is ahead of us. Prepare yourself for the emerging opportunities in the testing industry. Letâ€™s work together so that our testing skills will never be outdated!
Thank you for your participation in our Customer Experience Survey. We sincerely appreciate your valuable contribution and interest in helping us to improve. We are currently analyzing the answers and will publish the results of the survey as soon as possible.Â
The main goal of this short surveyÂ is to gather detailed information onÂ how you use Ranorex. We would like to knowÂ your opinion onÂ ourÂ software, so that we can make the Ranorex tools even better.
The first 50 participants will earn a free Ranorex Certification Exam and will be contacted soon.
You can rest assured that the information you submitÂ will be kept confidential.Â
This is the last part of a three-part blog post series covering test automation for manual testers without any programming background. This blog post deals with the opportunities that manual testers have in the automation category of “Analysis“. At the end, there is a conclusion of all three parts of the article.
Below youâ€™ll find a diagram with the three different areas for manual testers to consider when jumping into test automation: Preparation, Execution and Analysis. Within each of these categories, there are specific sections in which manual testers can make contributions right away. This blog post will cover the third category listed: “Analysis”.
Test automation error-handling is different than manual testing in many regards. For example, here are some automation conditions that may have to be dealt with:
These factors should be at the forefront of automation preparation and error-handling for the functional test analyst.
Knowing how the automation will and should react to these situations will ensure that the tests generated are robust enough for future test execution runs.
Test automation test cases are similar to a manual test case in terms of documenting the step-by-step procedures. For most test cases, code is generated in the background. One key advantage of automation is the ability to step into a test case to see where an error has occurred or what application behavior is present. The following is a three-step process to enable such detection:
Evaluate your test case and put a stopping point on a specified step. What this does is run the test up until that point; it does not proceed further until instructed to do so.Choose the â€śStepâ€ť for the breakpoint
You want to select this after careful analysis because it is dependent on the state in which you want to see your application. Knowing this step is very important in driving the subsequent step in which the application displays an unexpected behavior from what you expected.Execute the test case to the breakpoint
Once the breakpoint is hit, you have a few different options for further analysis:
Test automation reports can be very informative and can produce much more information than a manual test case would have generated. The fact that this information is produced automatically makes it great for reviewing. Such information is now available to review within the automated test case execution run:
Test automation has different requirements than those of traditional manual testing. Understanding object recognition and repositories, error-handling techniques, automation frameworks such as data-driven testing, as well as debugging and reporting are key elements in test automation that are not so prevalent with manual testing.
Knowing some of the aspects that go into the work of automation allows a manual tester to jump right in and help in the recording and playback. The industry trend has been moving more towards scriptless automation, so manual testers can make the transition easier. Familiarity with the application under test (AUT) is the largest hurdle, and most manual testers already have this covered.
All manual testers should be involved in some aspect of automation. Not only does it increase your knowledge of testing tools in the market â€“ it also increases your value on the market as a tester!
Itâ€™s 6:45 in the morning. I am leaving my plane after an 11-hour flight and visiting one of the most exciting cities in the world – Tokyo. There are 38 million people crammed into an environment that is nearly perfectly organized. The subway and trains stop precisely on the centimeter and the doors always open exactly where the lines indicate they should. An optimized city in which the â€śweâ€ť and the yearning for harmony counts much more than the â€śIâ€ť. Japanese culture values the society more than the needs of the individual. A sense of belonging, loyalty, are a key ingredients for these ancestors of the Samurai. With those values still deeply ingrained in everyday life, it is a spectacleÂ for every visitor from the West.
But I am not here as a tourist, I am here for business. In my role as Partner Manager for Ranorex, I work with our partners all around the globe who support us in bringing Ranorex to the most remote places in the world, but always with a local feel. Itâ€™s about being local in a global world. For a small company like Ranorex, this is only possible with a network of expert partners.
Japanese clients want to be able to ask their questions in Japanese and likewise to work with their tools in their mother tongue. This is why I am especially excited that we have found a partner in Japan that is helping us to localize our services, and moreover our software. Ranorex will soon be available in Japanese, allowing us to serve this key market in Asia with a localized product.
I am here to prepare our partner TechMatrix for a joint sales meeting, and more importantly for the press conference. We will be introducing our product to the audience together with our new partner.
A few days after my arrival, the jetlag mostly vanished due to the pure excitement of being in this fantastic city, and we are already at the venue of the press conference. Itâ€™s an impressive hotel with a Zen-style garden in front that is overcrowded with newlywed couples capturing the most important day in their lives in photos.
Our partner TechMatrix invited more than 100 potential clients to the event and we are all very excited. I have a translator on my side, but nonetheless I decide to do the first page in Japanese. I am reading the Japanese words, many of which do not make any sense to me as I forgot a lot of my Japanese. I am nervous, and after this first page Iâ€™m relieved that I can continue in English. The crowd claps and we continue with the core part of the presentation. I find that the Japanese audience seems to be very keenly interested, and focused on every word that the translator creates out of my sentences. Having a translator is actually a good thing because all the pauses in between give me time to formulate the next sentence in the most accurate, concise and effective way. With a translator, the message needs to be transmitted in a simple, plain wayâ€¦or it will become hidden in the clatter.
After a 40-minute presentation, the questions round starts and many interesting things are asked. The impression that I will leave this press conference with is the existence of a very strong opportunity that has just been presented to Ranorex – tremendous demand for solid, robust test automation software in Japan. I will especially remember one moment from the Q&A session when I was asked why Ranorex should be chosen over of an existing competitor. The question involved what else, aside from a lower price, can Ranorex offer if the competitorâ€™s tool already covers my technology needs? The answer was very simple: service & technical support. In the discussion, the client then confirmed that the team providing support for his current tool have even needed a whole month to respond to a simply question. The crowd murmurs in disbelieve.
All I can say here is WOW! Working together with a strong partner â€“ TechMatrix â€“ whoâ€™ll provide first class service and our superior product, I am foreseeing a bright future for Ranorex in the land of the rising sun. I am already looking forward visiting Tokyo again soon.
Europeâ€™s #1 software testing conference – EuroSTAR Conference –Â took place for the fifth time this year in the Netherlands between the 2nd and the 5th of November 2015 at MECC Maastricht. My colleague Alexander Walentin and IÂ joined many other global software testing professionals in taking part.
Here are the hot topics that were discussed most frequently at our booth:
Stay tuned to upcomingÂ software testing conferences!
TomTom is best known for being a global leader in navigation and mapping products and developing innovative products that make it easier for people to keep moving towards their goals. Since 2004 they have sold over 75 million portable navigation devices (PNDs).
For their innovative PND feature called â€śBring your own connectivityâ€ť, TomTom wanted to automate Bluetooth Interoperability (IOP) tests on iOS and Android phones. With this feature, people can connect with mobile phones via Bluetooth to get real-time traffic information on the TomTom navigation device.
The Ranorex test automation solution best met the companyâ€™s goals in terms of improving quality and efficiency through robust object identification, multiple technology support and easy integration into Jenkins continuous integration and HP ALM. With support from Ranorex, they set up a robust test framework and are now able to easily create maintainable test automation scripts.
Ranorex helped TomTom to achieve major time savings and reliable test results by automating their mobile tests.
“In the past we were manually executing our tests and it took us ten man days, but now we can execute them automatically with Ranorex within fourÂ hours.Â Ranorex saves us lot of timeÂ and provides us with reliable test results.”
Â Harpreet Singh Sethi â€“ Senior Manager, PND Product Unit at TomTom