Skip to content

Software Development News: .NET, Java, PHP, Ruby, Agile, Databases, SOA, JavaScript, Open Source

Methods & Tools

Subscribe to Methods & Tools
if you are not afraid to read more than one page to be a smarter software developer, software tester or project manager!

Ranorex.com: Latest News
Syndicate content
Updated: 59 min 24 sec ago

Integrate Automated Testing into Jenkins

Fri, 09/23/2016 - 11:00

In software engineering, continuous integration means the continuous application of quality control processes — small units of effort, applied frequently.

In this blog we’ll show you how to set up a CI job with Hudson/Jenkins that automatically builds and executes your Ranorex automation as well as automatically sends out the generated test reports for every committed change in a Subversion repository.

Advantages of Continuous Integration Testing

Continuous integration has many advantages:

  • When tests fail or bugs emerge, developers can revert the codebase to a bug-free state without wasting time for debugging
  • Developers detect and fix integration problems continuously – and thus avoid last-minute chaos at release dates
  • Early warning of broken/incompatible code
  • Early warning of conflicting changes
  • Immediate testing of all changes
  • Constant availability of a “current” build for testing, demo, or release purposes
  • Immediate feedback to developers on the quality, functionality, or system-wide impact of their written code
  • Frequent code check-ins push developers to create modular, less complex code
Infrastructure Continuous Integration Tool

You can find a download link and installation description for Hudson and Jenkins here:

In this blog post we are going to use Jenkins as CI tool. There shouldn’t be much of a difference when using Hudson.

As Jenkins or the nodes executing the CI jobs normally are started as Windows services, they do not have sufficient rights to start UI-applications.

Please make sure that Jenkins as master or its slave nodes, where the Ranorex automation should be triggered, are not started as a service.

For the Jenkins master, open the “Services” tool (which is part of the “Administrative Tools” in the control panel), choose “Jenkins” service, stop the service, and set the “Startup type” to disabled:

disable start as service

Use the following command to start Jenkins manually from the installation folder:

java -jar jenkins.war

manually start jenkins

After starting Jenkins, use this address to access the web interface:

http://localhost:8080/

To configure your Jenkins server, navigate to the Jenkins menu and select “Manage Jenkins” -> “Configure System”:

Configure System

Note: It is necessary to have the Ranorex main components – and a valid Ranorex license – installed on each machine you want to build and execute Ranorex code.

Source Code Management

As mentioned before, we are going to use a Subversion repository as base of our continuous integration process.

In this sample, we have two solutions in our repository: the application under test and as the automated Ranorex tests.

Repository

To start the application under test from your test project, simply add a new “Run Application” action to your action table in Ranorex Studio, which starts the application under test, using a relative path to the repository root:

Run Application Action

Plugins

As we want to build our code for each committed change within our SVN repository, we need a Subversion as well as a MS Build plugin for Jenkins. An additional mail plugin will make sure that a mail is sent with each build.

Install Plugins

Open the “Manage Plugins” section (“Manage Jenkins” -> “Manage Plugins”), choose the following plugins from the list of available plugins and install them if they are not installed already:

  • MSBuild Plugin
  • Email Extension Plugin
  • Subversion Plugin
Configure Plugins

The installed plugins also need to be configured. To do so

  • open the “Configure System” and configure the “Extended E-Mail Notification” plugin. To do so, set the recipients and alter the subject and content (adding the environment variable $BUILD_LOG to the content will add the whole console output of the build and the test to the sent mail),
    Configure Mails
  • configure the “E-mail Notification” plugin by setting the SMTP server.
  • and navigate to “Global Tool Configuraiton” and configure your “MSBuild” plugin by choosing the “msbuild.exe” installed on your machine.
    Configure MSBuild
Add New Job

Now, as the system is configured, we can add a new Jenkins job, which will update the checked out files from a SVN repository, build both the application under test and the Ranorex automation project, execute the application under test as well as the automation code and send a mail with the report file attached.

Start by creating a new item. Choose “Build free-style software project” as job type and enter a job name:

Add New Item

Configure Source Code Management

Next, we have to check out the source of both the application under test and our test automation project. Start with choosing Subversion as source code management tool. Then, enter the repository holding your application under test as well as your test automation project. Finally, choose “Use ‘svn update’ as much as possible” as check out strategy:

Configure SVN

With this configuration, the application under test as well as the test automation project will be checked out and updated locally.

Add Build Steps

Now, as the source code management is configured, we can start with processing the updated files.
First of all, let’s add MSBuild steps for both projects:

Add MSBuild Buildstep

Choose your configured MSBuild version and enter the path of the solution file relative to the repository root (which is the workspace folder of the Jenkins job) for both the automated and the automating project:

Added MSBuild Buildsteps

With adding these two build steps, the executables will be automatically built. Now the newly built application should be tested.
This can be accomplished by adding a new “Windows batch command” that starts the test suite executable:

Add Batch Buildstep

Added Batch Buildstep

As you can see, some command line arguments are passed to the test suite executable.

In this sample, the command line arguments “/zr”, which triggers the test suite executable to generate a zipped report file, and “/zrf:.ReportsReport-Build-%BUILD_NUMBER%.rxzlog”, which defines the name and the location of the generated zipped report file, are used.

You can find a list of all available command line arguments in the section “Running Tests without Ranorex Studio” in our user guide.
The test suite executable returns “0” on success and “-1” on failure. Based on this return value, Jenkins will mark the build as successful or failure.

Add Post-Build Action

After building and executing the application under test and the Ranorex test script, we will send an email which informs us about the success of the triggered build.
This email should include the zipped report file, mentioned before, as attachment.
To do so, add the new post-build action “Editable Email Notification”, choose the report file location defined before as attachment, and add triggers for each job status you want to be informed about. In this sample, an email will be sent if a job has failed or succeeded.

Added Mail Action

Run Job

Once you’ve completed these steps and saved your changes, check if everything works as expected by clicking “Build now”:

Build Now

After running the generated job, you will see all finished builds within the build hierarchy. Icons indicate the status of the individual builds.
You can view the zipped report files of all builds by opening them in the local workspace (“Workspace/Reports”):

Build History

As configured before, an email will be sent to the specified email address(es), including the console output in the email text as well as the generated zipped report file as attachment.

Add Repository Hook

Now we can manually trigger a build. As we are working with Subversion, it would be beneficial to trigger the script for each commit.
To do so, you can add a server side repository hook, which automatically triggers Jenkins to start a new build for each change committed, as described in the subversion plugin documentation.

Alternatively, you can activate polling of the source code management system as build trigger in your Jenkins job configuration.

As shown in following picture, you can define the interval, after which the source code management will be invoked (e.g. 5 minutes after every full hour):

Added Build Trigger

Conclusion

Following the steps above you will be able to easily setup a continuous integration process performing the automated test of the application you develop. Each commit will now trigger an automated test run. Once the test run has finished, you’ll instantly receive a mail with the Ranorex test report.

This blog was originally published in July 2012 and has been revised to reflect recent technical developments.

The post Integrate Automated Testing into Jenkins appeared first on Ranorex Blog.

Categories: Vendor

Test Your iOS 10 Apps

Thu, 09/15/2016 - 12:31

Apple’s iOS 10 update for iPhone and iPad lives up to its milestone software version number and implements major changes to your daily phone and tablet routine.

Benefit from features such as:

  • A fully redesigned lock screen
  • Siri open for developers
  • Huge changes and new features for messages
  • A redesigned Apple Music app
  • Deletable stock apps
  • A completely new Home app for HomeKit
  • and many more features.

We are delighted to announce that with our latest release, Ranorex 6.1, iOS 10 is supported.

Upgrade to the latest OS on your mobile devices now to start automating your cutting edge mobile app tests with Ranorex!

Get the latest version of Ranorex now

The post Test Your iOS 10 Apps appeared first on Ranorex Blog.

Categories: Vendor

Ranorex 6.1 Released

Thu, 09/08/2016 - 15:37

We’re happy to announce that we’ve released Ranorex 6.1! This new generation of functional test automation is now fresh and polished to make working in teams even easier! Next to remote test execution, improved test suite file format and Git integration, this software update introduces an intuitive setting storage and a progressive report preview. Let’s have a look at the benefits, shall we?

Solution Settings Ensure everyone in a team uses the same settings when working on a test automation project.

You can now save technology-specific solution settings directly in the test automation solution, while user settings can still be stored locally. This brings some rather fantastic benefits with it:

  • You can check in your settings together with the solution into a version control system. This makes it easier to share solutions with other team members and, ultimately, to work together on them.
  • Are you working on multiple test automation projects? Very likely, each is in its own test environment. Now, when you switch between solutions, you don’t have to manually adjust the settings.

Have fun sharing your settings and working together on test automation projects!

Learn more about the solution settings

Progressive Report Preview For those who’d like to take a peek in the test report during test execution.

We’ve all been there. You’d like to know how many test cases have failed, but it could take hours until the test run is complete and the full report is available. You’d need this information to react early to failed test cases – or maybe just to have a peace of mind before you go home. Trust us, we get it. So here’s what we’ve done: During test execution, test results are saved in configurable intervals. So whenever you feel like it, you can preview the report from anywhere without disrupting the test run. Enjoy!

Learn more about the progressive report preview

For a full list of new features and enhancements, please view our Release Notes. This software update is available now and included in software maintenance at no additional costs.

Learn more about Ranorex 6.1 Download Free 6.1 Trial

The post Ranorex 6.1 Released appeared first on Ranorex Blog.

Categories: Vendor

Manually Create Automated Tests

Thu, 09/01/2016 - 13:00

Ranorex is more than just a simple capture and replay tool. It is a versatile test automation software that offers a range of tools suitable for every skill level. While you don’t need any programming skills to easily create and maintain your tests with the Ranorex Recorder, you can also manually create your automated tests.

What are the benefits of manual test case creation?

  • Keep your Ranorex Object Repository structured and easily maintainable from the start.
  • Create robust test cases that uniquely identify dynamic IDs.
  • Ensure only those UI elements you want to test are available in your Ranorex Object Repository.
  • Automate complex test scenarios in code using the Ranorex Object Repository.

Workflow

Test Scenario

In this example, we’ll use the KeePass as application under test (AUT). This open source password manager application is one of our sample applications delivered with Ranorex Studio, so you can easily recreate this example.

In this blog, we’ll show you how to

  • generate a Ranorex Object Repository containing exactly those UI elements you want to address in your automated test,
  • drag and drop the resulting repository items to your action table or
  • drag and drop items directly into your user code to represent the workflow you want to test.
The Ranorex Object Repository

The Ranorex Object Repository manages the UI elements of your automated test. A repository item is automatically created in this central Ranorex Object Repository when you record or track a UI element. If you change a repository item, these changes are automatically applied in the code as well as in the recording module.

Start by opening your solution and add an empty recording module. You will notice that the central Ranorex Object Repository of your test automation project is displayed directly below the action table. You can now add UI elements to the repository using the ‘Track’ button in the Ranorex Object Repository.

Track UI Elements

Enhancing the RanoreXPath

You can alter the RanoreXPath of specific repository items to make them more robust. Simply open the path editor and click on the ‘Edit’ button next to the item. For more information about the RanoreXPath, please have a look at the user guide chapters RanoreXPath and RanoreXPath Editor. If you’d like to know how to best enhance the object recognition of your AUT using the RanoreXPath operators, check out the blog post RanoreXPath – Tips and Tricks.

Keep your repository clear and structured

If your Ranorex Object Repository contains many objects, it’s particularly important to keep it clearly structured and organized. Here are two tips:

Rename repository items

Each UI element within the repository can have a logical user-defined name. Renaming repository items and giving them logical names will make it easier to understand test automation code and report files.

Create Logical Folders

You can also create logical folders to structure and group UI elements that logically belong together. For detailed instructions on how to structure your Ranorex Object Repository, please check out our user guide chapter Adapting an Existing Repository.

Keep Repo Clear

The Recording

As your Ranorex Object Repository now contains multiple UI elements, you can add actions to the recording. Do so by either selecting ‘Add New Action’, or simply drag & drop specific repository items from the repository to the action table in the recording.

Add Action Via Menu

Add Action Via Drag Drop

If you’d like to connect data to your automated tests and use variables in the action table or the repository, have a look at the user guide chapter Data-Driven Testing.

The User Code

You can also create your actions directly in user code. Simply drag and drop the specific repository item from the Ranorex Object Repository directly into the code editor.

Add Code Via Drag Drop

In the user guide chapter Code Examples you can find further examples on how to extend modules with user specific code.

Conclusion

As you can see, you can create your automated tests manually without pressing the record button at any time. This will give you more control over the actions that should be triggered.

Download Free Trial

The post Manually Create Automated Tests appeared first on Ranorex Blog.

Categories: Vendor

RanoreXPath – Tips and Tricks

Thu, 08/25/2016 - 14:00

The RanoreXPath is a powerful identifier of UI elements for desktop, web and mobile applications and is derived from the XPath query language. In this blog we will show you a few tips & tricks on how to best use the various RanoreXPath operators to uniquely identify UI elements. You can then use these RanoreXPaths in your recording and code modules to make your automated tests more robust.

Overview

Using RanoreXPath operators

Element Browser

The Ranorex Spy displays the UI as hierarchical representation of elements in the Element Browser view. The RanoreXPath can be used to search and identify items in this UI hierarchy.

In this example, we’ll use the tool KeePass as application under test (AUT). This open source password manager application is one of our sample applications delivered with Ranorex Studio. If you have multiple applications open, Ranorex Spy will list them all. Filtering the application you want to test will increase speed and give you a better overview. To do so, track the application node of KeePass and set it as root node (context menu > ‘Set Element as Root’). Now, only the main KeePass form and its underlying elements are visible.

Ranorex Spy

General Layout of RanoreXPath

RanoreXPath expressions are similar to XPath expressions. They share both syntax and logical behavior. A RanoreXPath always consists of adapters, attributes and values:

Layout of RanoreXPath

The adapter specifies the type or application of the UI element. The attribute and values specify adapter properties.

The absolute RanoreXPath of our KeePass form looks like this:

RanoreXPath of AUT

The form is an adapter specifying the type or classification of the UI element. It is followed by the attribute value comparison, which identifies the requested element. In this example, the comparison operator is a simple equality.

If you want to know more about how the RanoreXPath works, we recommend our dedicated user guide section.

Search for multiple button elements

You can list all buttons elements that are direct children of a designated positon in your AUT. Have a look at these two examples:

1. List all buttons that are direct children of the KeePass toolbar:

To do so, simply set the toolbar as root node and type ./button into the RanoreXPath edit field, directly after the given RanoreXPath.

Relative path to all child buttons

This will create a relative path to all child nodes of the actual node, which are buttons.

Element Tree with Child Buttons

2. List all buttons of your AUT:

Navigate back to the form adapter, set it as root node and type in .//button.

Relative path to all buttons

You’ve now created a relative path to all descendants of the actual node, which are buttons. These are all buttons of all levels of the subtree of the current element.

Element Tree with all Buttons

Identify controls with a specific attribute

You can also create a path to controls, to filter them according to specific attributes. In this example, we want to find all checked checkboxes.

Open the “Find” dialog in KeePass (<CTRL><F>), as this dialog contains checkboxes, and set it as root node. Now, you can validate which item of the checkbox control has the attribute “checked” set to true. To do so, enter “//checkbox[@checked=’True’]”:

RanoreXPah for Checked Checkboxes

As you can see, only the checked checkboxes will be visible in the Element Browser.

Element Tree with all checked checkboxes

Identify checkboxes by combining attributes

You can further extend the previous example by combining attributes. This enables you to, for example, omit certain items from the search, or search for specific items.

1. Omit a specific item from the search

You can omit a specific item from the search using the “not equal” operator and the “and” conjunction. In this case, we want to omit the item “&Title”:

RanoreXPah for Checked Checkboxes excluding Title

Element Tree with all checked checkboxes excluding Title

2. Seach for specific items

You can use the “or” instead of the “and” conjunction to extend your search and only look for specific items. Extend the checkbox search to look for the items “&Title” and “&URL”:

RanoreXPah for Checkboxes

Element Tree with checkboxes

Recognize related elements using the parent operator

After running the Ranorex desktop sample project, there will be two entries in our AUT – one for a WordPress and one for a Gmail account. In this case, we’d like to find the username of the “Gmail” KeePass entry:

RanoreXPah for username of gmail entry

Element Tree username of gmail entry

Username of gmail entry

Start with the RanoreXPath to the cell containing the text “Gmail” (framed in red). Next, use the relationship operator “parent” to reference the parent node of the current element. In this example, it’s a row (framed in blue). The index “[2]” navigates to the second cell, which contains the Gmail username (framed in green).

Recognize related elements by using preceding- and following-sibling

Another way to search for related elements is to use the relationship operator “preceding-sibling”. In this example, we want to find the title of a KeePass entry based on its username.

Relationship operators

The command “preceding-sibling::cell” lists all preceding cells. In this case, the result is the title (framed in green) which corresponds to the given username (framed in red).

RanoreXPath Preceding Sibling

Element Browser Preceding Sibling

In contrast, the command “following-sibling::cell” delivers all following cells. In our case, these are all following cells (framed in blue) that correspond to the given username (framed in red).

RanoreXPath Following Sibling

Element Browser Following Sibling

Identify attributes fields using regular expressions

You can also use regular expressions in attribute conditions to identify attribute fields. In this example, we’d like to filter cell adapters that contain an email address in their text attribute. Regular expressions matching an email address may look like this: “.+@.+\..+’”.

RanoreXPath Regular Expression

Element Browser Regular Expression

The “~” operator instructs Ranorex to filter attribute fields using a regular expression. The “.” in our regular expression matches every single character, while the “+” specifies that the preceding element has to occur one or more times. To escape special characters (such as “.”), enter a backlash before the character.

In our example, every expression will match that contains the character “@” with one or more characters before and after it, followed by a “.”, which is followed by one or more characters.

For more examples on how to use regular expressions in RanoreXPaths, please have a look at this user guide section: RanoreXPath with regular expression.

Identify attributes with dynamic values

Dynamic attribute values change each time an element is displayed anew. Fortunately, dynamically generated content usually has a prefix or postfix. To identify dynamic elements, you can either use regular expressions, as described above, or use the ‘starts with’ or the ‘ends with’ comparison operators:

  • ‘>’: The value of the attribute must start with the given string
  • ‘<‘: The value of the attribute must end with the given string
Conclusion

The RanoreXPath enables you to find and uniquely identify every single UI element of desktop, web and mobile applications. You can use the RanoreXPath operators to make your test suite more robust and identify even dynamic attribute values.

RanoreXPath Overview  RanoreXPath Editor 

The post RanoreXPath – Tips and Tricks appeared first on Ranorex Blog.

Categories: Vendor

Smartwatches – Here to Stay & Here to Test

Thu, 08/04/2016 - 12:36

Smartwatches are no longer a second screen to the mobile device. This year, Android has released their marshmallow version for Android Wear, adding yet more features to the smartwatch. Likewise, also developers seem to be kicking it up a notch. It’s no stretch to say that testing will have to adapt to a wearable mindset to face these new challenges. We proudly announce that Ranorex supports Android Wear testing. As always, you can rely on us to stay prepared and stand your ground on the consumer market. But first things first. Let’s start with why smartwatches are such a hot topic in 2016.

Getting off the starting blocks

It seems that fiction is about to become reality. Gadgets are already used to ease our life in almost every area – be it health, entertainment or personal organization. In their February 2, 2016 press release, Gartner* predicts that “274.6 million wearable electronic devices will be sold worldwide in 2016, an increase of 18.4 percent from 232.0 million units in 2015 (see Table 1). Sales of wearable electronic devices will generate revenue of $28.7 billion in 2016. Of that, $11.5 billion will be from smartwatches.”

It’s a given that vendors want to throw their hat into the ranks and join the game. More vendors provide users with plenty of options to choose from. And with the rise of wearables, the pressure’s on for developers. So what does it take to be successful?

The game’s on for smartwatches

Naturally, users expect both hard- and software of smart wearables to function flawlessly. But smartwatches have to be more than just an expensive secondary screen to a mobile device, merely saving the user from getting the phone out of the pocket. They’ve got to be useful. Today it’s all about user experience to keep the excitement going. As customers are presented with an ever increasing choice in smartwatch products, the challenge is on for app developers to provide the best use case and the most appealing functionality. The question of how you can make your app an incentive for using a smartwatch goes right in hand with one question: How can you best react to arising challenges when it comes to smartwatch app testing?

 

Ranorex Smartwatch

In for the win – with Ranorex Android Wear testing

When it comes to testing an Android smartwatch, challenges are definitely usability, device fragmentation and dependency on a mobile device. Here’s a short overview of how Ranorex can help you deal with these challenges:

Usability

Smartwatches come in all forms and sizes. Software has to be able to adapt quickly to ensure highest usability in this ever-changing market. Considering that Android Wear supports square as well as round displays and screen sizes go as small as 1.3 inches, this is definitely a challenging task for developers. With such a restricted screen size, software has to be functional and easy to use. At the same time, it has to be highly adaptable to be appealing and thus desirable no matter the form or screen size.

Ranorex is flexible
With Ranorex, it doesn’t matter which Android Wear smartwatch your app will later be used on. Record your test once and run it on different Android Wear watches. How? We know that test scripts have to be reliable and robust to ensure high quality software. That’s why Ranorex doesn’t rely on a coordinate level, but uses the powerful RanoreXPath to uniquely identify even dynamic user interface elements on your Android Wear device, making your test scripts robust against UI changes.

Dependency on mobile device

Smartwatches aren’t (yet) a standalone gadget, but are highly dependent on a mobile device. This is why you’ll also need to test your smartwatch app on a mobile device – be it mobile phone or tablet. And who knows what’s yet to come. The many possible use cases arising from device fragmentation will definitely pose a challenge.

Ranorex offers an all-in-one license
We’ve got good news. You only need one license to test any kind of mobile, web or desktop application with Ranorex. You can test your app on your mobile device and on your smartwatch. Should you decide to venture out and perform additional cross-technology testing, we’ve got you covered: you can reuse your test case across multiple devices. You also don’t need an additional license to use the wearable testing functionality. No additional license means no additional costs. So all there’s left for us to say is: happy testing.

Time pressure and quality enhancement

As we’ve mentioned in our 2016 Test automation trends blog post, time pressure is an imminent factor when it comes to releasing software, while providing highest quality software remains a prerequisite to compete in the fast-growing wearables market.

Different automation approaches and integration into existing testing environments
Working together in teams is essential for a timely release. As Ranorex offers a broad set of automation tools, every member of your testing team can feel comfortable working on a test automation project. Ranorex is more than just a Capture & Replay tool, but a software that supports collaboration between developers and testers. While you don’t need any programming skills to create robust and easily maintainability tests with the Ranorex Recorder, developers can add further functionalities or create new test automation projects entirely in C# and VB.NET.  You can also seamlessly integrate Ranorex into any development environment, using CI and version control systems. Additionally, our latest major software update, Ranorex 6.0, comes with functionalities that make working in teams even easier: Remote testing, Git integration, code editor enhancements and many more features you’ll definitely love.

 

Do you want to know more about how you can test your Android Wear app with Ranorex? You can find detailed instructions in our Android Wear user guide section.

 

Learn how to test Android Wear apps Download Free Trial 

 

 

*Gartner, Press Release, “Gartner Says Worldwide Wearable Devices Sales to Grow 18.4 Percent in 2016”, February 2, 2016. http://www.gartner.com/newsroom/id/3198018

The post Smartwatches – Here to Stay & Here to Test appeared first on Ranorex Blog.

Categories: Vendor

Integrate Automated Testing into Any Continuous Integration Process

Wed, 07/20/2016 - 08:24

Long gone is the time of waterfall’s strictly separated development & testing phases. Today, it’s all about fast feedback, quick iterations and frequent releases at a previously unseen velocity. It requires an agile methodology to keep up with the high demands. Your team’s success depends on a supporting infrastructure with the right tooling. Without any doubt, automation plays an essential role here. Our tip: Integrate test automation into your continuous integration (CI) process.

We wouldn’t want you to waste precious time if you’ve your development environment already set up. That’s why you can integrate Ranorex into any continuous integration process. Let’s have a closer look at the benefits of integrating test automation into your CI system, and how you can do it:

continuous integration automated testing overview

Automated testing and continuous integration

The idea of continuous integration is to frequently promote code changes and rapidly get feedback about the impact these changes have on the application or system. Including test automation in the development cycle enables you to automatically test each incremental code change.

So basically every time a developer commits code changes to the version control system (VCS) such as Git or TFVC, a build of the application under test as well as the Ranorex test automation project is triggered in the CI system. The resulting test automation executable then runs against the application under test.

To evaluate the outcome of the automated test, the continuous integration tool examines the return value of the executable or its output text (e.g. “TEST FAILED” for failure). With Ranorex, the return value ‘0′ signals the successful execution of the test script, while the return value ‘-1′ signals a failure. Each team member automatically receives a notification about a finished build. This notification includes build logs as well as a test execution report.

Advantages of integrating Ranorex into your CI system:
  • As each code change is immediately tested, potentially introduced bugs are found faster, which ultimately makes it easier to fix them.
  • The test automation report enhances transparency, as each team member will receive instant feedback about the state of code.
  • There’re no integration problems, as Ranorex can be integrated into any CI tool.
Setting up Ranorex test automation in your CI system

Note: You have to install Ranorex on each machine you’d like to execute Ranorex tests on. You’ll need a valid license to do so. Please find more information about Ranorex licenses on our dedicated Pricing page.

Each committed change in the application under test and the test automation project should be automatically tested. In other words, every change should trigger these 3 steps:

  • building the application under test
  • building the Ranorex test suite
  • executing the Ranorex test suite

continuous integration automation testing in detail

First, you need to manually set up these steps in your CI system.

1. Build the application under test

The first build step should generate an executable of your application under test. This executable should later be triggered from the Ranorex test suite project.
Thus, add a build step which will build your application under test (e.g. MSBuild build step, Ant build step, …).

2. Build the Ranorex test suite

In this second step, you’ll need to generate an executable to automate your application under test. To do so, add a build step (MSBuild or Visual Studio) and choose the project file (*.csproj) of your Ranorex project which should be built.

3. Execute the Ranorex test suite

The third step should execute the previously created executables. Simply add an execution step triggering the *.exe file of the test automation project and define the command line arguments if needed.

The test execution should now be triggered on the same system the projects were built on. If you want to trigger the execution on another system, you need to deploy the built executables and all connected files to that system. Please make sure to execute the application under test and the Ranorex test suite in a desktop and not in a console session.

Automated testing of frequent code changes

If the code of your application under test or your test automation project changes frequently, it doesn’t make sense to run the entire test suite including all test cases with every build. Instead, you should run only those test cases that are affected by the changes. How? Run configurations!
You can add and edit run configurations directly in the test suite (see user guide section ‘Running a Test Suite’).

You can trigger a run configuration using a command line argument. The following command line, for example, will run the test suite executable ‘TestCIProject’ with the run configuration (/rc) ‘SmokeTest’ and generate a zipped report file (/zr /zrf) ‘Report.rxzlog’ in the folder ‘/Reports/’.

TestCIProject.exe /rc:SmokeTest /zr /zrf:Reports/Report.rxzlog

Interested in more command line arguments? You find more in the user guide section ‘Running Tests without Ranorex Studio‘.

Test automation report – the importance of feedback

“No news is good news” is definitely not true for agile teams. It’s important that everyone in a team – whether it is a developer or tester – knows about the state of the code and, thus, the outcome of the automated test run. It really couldn’t be any easier: Simply add a post build action which sends a mail to your team members with the build log and the generated zipped report attached.

Integrate Ranorex into a specific CI system:

You’re using a specific CI tool? Whether it’s Bamboo, Jenkins, HP Quality Center, TeamCity or Microsoft Test Manager – check out the section below to find a detailed instruction on how to integrate Ranorex into your CI tool!

As you can see, it’s easy to integrate Ranorex test automation in your continuous integration system. Each code change in your application under test and your test automation project will be automatically tested, which enhances transparency and enables you to find bugs faster.

You want to know about the benefits of integrating Ranorex into your development environment? Try it out! Download the full-featured 30-day Ranorex trial and see the benefits for yourself! Have fun integrating!

Download Free Trial

The post Integrate Automated Testing into Any Continuous Integration Process appeared first on Ranorex Blog.

Categories: Vendor

Keyword-Driven Test Automation with Ranorex

Thu, 07/14/2016 - 10:15

Multiple releases, limited resources, time pressure and a team with mixed skillsets. And it’s your task to create flexible, maintainable automated tests, which every team member can understand and work with. The solution: get a test automation tool that supports keyword-driven testing.

What is keyword-driven testing?

The keyword-driven testing approach separates the test automation implementation from the test case design. A keyword is defined for each action in the test case. Once the keyword is set, you don’t need any programming knowledge to easily design and maintain the automated tests.

What are the benefits of keyword-driven testing?
  • Tests are easily readable.
    As keyword-driven tests are technology-independent, they’re easily readable for non-technical testers. While technically experienced team members can prepare the automation process and define keywords, you don’t need any technical knowledge to design test cases with these keywords.
  • You can create flexible, easily maintainable tests faster.
    In keyword-driven testing, each action is automated only once and the corresponding keyword can be reused throughout several test cases.
How can I create keyword-driven tests with Ranorex?

There are two ways of creating keyword-driven tests with Ranorex:


1. Keyword-driven framework with automation modules

You can use both your recording and code modules in Ranorex Studio as a basis for keyword-driven testing. Simply split your automation modules and give them each a clearly understandable name. For example, you can define a set of actions, which start the system under test, as a module with the name “StartSUT”. You can find detailed information on how to do so in this user guide section.

Drag keyword from module browser for keyword driven test automation

These modules now function as keywords. Once the keywords are defined, you can drag and drop the keywords needed for your test directly from the module browser into your test suite.

Reuse keywords in multiple projects

Start by creating your keywords directly in a Ranorex test suite module library. You then use these keywords in multiple Ranorex projects by referencing back to this library. You can do so in two different ways:

  • Reference the Ranorex test suite module library. This enables you to still edit the keywords when needed.
  • Reference the DLL file of the Ranorex test suite module library. Please note that this approach doesn’t allow you to modify your keywords.

This approach completely separates the keyword implementation from the test case design and the keyword usage.

Separation in several projects for keyword-driven approach

If you want to learn more about organizing test automation projects, please read this blog post: “Organize a Test Automation Project with Ranorex“.

Use external data in keyword-driven tests

You can make your tests even more flexible by using variables. Variables enable you to automatically retrieve external data, which you’ve saved in an Excel or CVS sheet, in your tests – such as passwords for login actions. You can find detailed information on how to implement this type of testing in our user guide section “Data-Driven Testing“.

2. Keyword-driven testing using the action table

We bet you’re familiar with the good old Excel-spreadsheet. So why not use something you already know well in your automated tests? When using the action table in the Ranorex Recorder, you can create keyword-driven tests in a table-like workspace. It just takes a little trick to access your predefined keywords within this view: Inheritance.

Technically experienced team members can provide code-based keywords in a code module. You find detailed information on how to do so in this user guide section or this blog post.

Keyword Implementation

A recording module, which is inherited from a code module, automatically derives all functionalities from its parent module. This is also true for parameters – you can read more about this topic in the user guide section “User Code Actions and Parameters”.

This can be achieved with inheritance in the recording modules “UserCode.cs” file:

Inheritance From KeywordLibrary Module

Now, you can simply add a user code action in the action table (Add New Action -> User Code) and choose a predefined keyword. Once you’ve defined it, you can set the argument.

Keyword Driven Action Table

You can also use data-driven testing within the recording module by simply making the keyword parameters variable as explained in the user guide section “Data-Driven Testing“.

Conclusion

Keyword-driven test automation is a fantastic way to create flexible test cases. It enables teams with different technical background to work on test automation projects together, while keeping test clearly structured and easily maintainable.

Download Trial

The post Keyword-Driven Test Automation with Ranorex appeared first on Ranorex Blog.

Categories: Vendor

Test Automation Day 2016 – Insights

Tue, 07/05/2016 - 11:52

Conferences are always a fantastic way to meet people and exchange ideas with other test automation experts. The Test Automation Day is a major software testing conferences that is dedicated to test automation. This year, it took place in Rotterdam, the Netherlands, on June 23rd. This inspiring conference was packed with test automation experts, software testing professionals and leading IT organizations. Not only did we get to listen to thought-provoking keynotes, but also had interesting talks at our Ranorex booth. Here are some of the most frequently asked questions at our booth:

Is Ranorex just a Capture & Replay tool?

Ranorex is more than a just simple Capture & Replay tool. It is a versatile test automation software that offers a range of tools suitable for every skill level. While you don’t need any programming skills to create and maintain your tests with the Ranorex Recorder, you can also create your automated tests manually.

How can I create my automated tests without using the Ranorex Recorder?

Test automation engineers will especially love the Ranorex Spy. It is a powerful tool that enables you to obtain UI elements from your application under test. Simply open the Ranorex Spy in Ranorex Studio and track the UI elements you want to automate. You can drag these elements directly from the Ranorex Spy into the central Ranorex Object Repository. From there, you can then further drag them either into the action table, or the code editor. Here’s where it gets interesting: Usually, UI elements are used more than once in each test case. When adapting an element in the central repository, this change will be true for all occurrences of this element – both in code and in the action table. The benefit? You don’t have to adapt each element manually, which will save you a lot of time.

http://www.ranorex.com/blog/wp-content/uploads/2016/07/AutomateWithoutRecording.mp4 How does Ranorex support the collaboration between developers and domain testers?

The Ranorex Object Repository is the central point of collaboration between developers and domain testers. This central repository is used to manage UI elements. When you record a UI element with the Ranorex Recorder, or track an element with the Ranorex Spy, Ranorex will automatically create a repository element in this central repository. Thus, when changing a repository element in the Ranorex Object Repository, the changes are automatically applied both in the code and the recording module. This does not only ease team collaboration, but also test maintenance.

How does Ranorex support creating and editing test automation projects in code?

If you’re into coding, you’ll benefit from the Microsoft .NET framework and can write code in C# and VB.Net. You’ll also love the new code editor enhancements, which have just been released with our latest major software release: Ranorex 6.0. You can find further information on the new code editor features in this blog post.

Does Ranorex support automated testing of mobile applications?

Ranorex enables automated testing of mobile Android and iOS applications. You can test hybrid, native and mobile web applications. The benefit? You can connect your mobile device to Ranorex Studio using either a USB or Wi-Fi connection. For more information on mobile test automation with Ranorex, please visit our dedicated Ranorex User Guide section.

At the end of this blog post, we just couldn’t resist letting you in on this hilarious incident that occurred at the Test Automation Day this year. Unaware of what was about to happen, we’re busy talking to prospective clients at our Ranorex booth, when a woman came up to us and asked: “May I touch your balls?”. :-) We’ll leave it up to you to imagine the look on our faces!

 

TAD Rotterdam Ranorex

 

Download Trial

The post Test Automation Day 2016 – Insights appeared first on Ranorex Blog.

Categories: Vendor

7 New Time-Saving Code Editor Features

Tue, 06/28/2016 - 15:40

Writing code is tricky enough. You shouldn’t have to spend hours improving its readability or worry about unnecessary typos causing build errors. Ranorex 6.0 now makes a ton new code editor enhancements available, which will help you quickly write clean and easily maintainable test scripts. Here’re 7 of the most fantastic time-saving features:

1. Code templates

We all love the custom code templates in Ranorex Studio. Using the tab key, you can now access multiple predefined templates, such as the for/for each loop. Icing on the cake for all us coders!

http://www.ranorex.com/blog/wp-content/uploads/2016/06/Code-Templates.mp4 2. Context specific actions

Improve your code structure with these amazing new context specific actions. Simply move newly created classes into specific files, or right click on the edit pencil to check for null or undefined variables. These are just a few examples – give it a try!

http://www.ranorex.com/blog/wp-content/uploads/2016/06/Available-Actions.mp4 3. Refactoring

Wouldn’t it be great if you could replace complex code fragments with small, easily readable methods? The extract method enables you to group your fragments to methods. You can further give them a clear name that explains their purpose.

http://www.ranorex.com/blog/wp-content/uploads/2016/06/Refactor.mp4 4. CamelCase search functionality

Find what you’re looking for faster with the CamelCase search functionality! CamelCase identifies the segments of compound words and uses the capital letters to list potential search results.

5. Auto insertion of using

Start saving time when using namespaces! Type in a class using the auto-complete functionality. Ranorex will then automatically add the specific using directive of the needed namespace.

6. Introduction of new methods

And yet another feature that will save you time: When calling an unknown method in code, you can now easily implement it with the context specific action ‘introduce method…’.

7. Switch on enum

This little feature comes in quite handy and enables you to write code faster. When typing a “switch” statement where the condition is an enum the cases are automatically prefilled.

http://www.ranorex.com/blog/wp-content/uploads/2016/06/Further-Small-Enhancements2.mp4

 

These and many more fantastic features are available with Ranorex 6.0. Update your Ranorex Studio now (yes, it’s free!) and start coding!

 

Learn more about Ranorex 6.0

The post 7 New Time-Saving Code Editor Features appeared first on Ranorex Blog.

Categories: Vendor

Save 30% on Ranorex Runtime Floating Licenses

Tue, 06/21/2016 - 13:24

Don’t miss out on this fantastic offer: Only until June 30, 2016 you can save 30% on Ranorex Runtime Floating Licenses! This offer celebrates our much requested and long awaited feature Ranorex Remote, which is available with our latest major software release Ranorex 6.0.

A Ranorex Runtime Floating License enables you to run tests on additional physical or virtual machines. Now, Ranorex Remote takes remote test execution a step further. Using this new feature, you can:

  • deploy tests to Ranorex Agents for remote test execution directly out of Ranorex Studio with just a few clicks. This makes it easier to simultaneously run multiple automated tests in different test environments and configurations.
  • continue using your local machine during remote test execution, as remote testing won’t block your machine. You’ll receive an automatic notification once the report is ready.
  • share Ranorex Agents with your team.

Remote test execution has never been this easy! All you need is a Ranorex Runtime Floating License to set up a Ranorex Agent and use Ranorex Remote. So don’t just let this offer pass by, and order your Ranorex Runtime Floating License today!

Order a Ranorex Runtime Floating License

The post Save 30% on Ranorex Runtime Floating Licenses appeared first on Ranorex Blog.

Categories: Vendor

Speed up Your Test Run by 200% with Ranorex 6.0

Thu, 06/16/2016 - 14:02

You don’t want your automated test to take longer than it has to. Fact is, the debugger directly affects the test execution time. That’s why in Ranorex 6.0 tests run without debugger by default in Ranorex Studio. Simply press the ‘Run’ button – no administrator privileges are required – and start saving time.

We know, only hard facts count. That’s why we’ve conducted a comparison, running a test with and without debugger, so you can see the benefits of the new default setting for yourself.

Up to twice as fast test run in Ranorex 6.0

Test environment and data
We’ve used the Ranorex KeePass sample, one of our sample test solutions delivered with Ranorex Studio, so you can easily reproduce these tests. All test cases were enabled. To omit static delays which could influence the test results, we further activated the Turbo Mode for all recording modules. We ran the tests in two setups. In the first, the computer was in an idle state. As in everyday work life, however, a machine usually has to juggle multiple processes, we simulated a 100% CPU load with a CPU Burn-in in the second setup.

State Debugger enabled Debugger disabled Execution time reduction Idle 2 min 1.9 min 5% 100% CPU Load 11.3 min 5.4 min 52%

The results clearly show that when your computer is in an idle state, the new default settings merely reduce the test execution time by 5%. However, when you’re using your computer to the full capacity, your test will be twice as fast now. These two scenarios represent two extremes, with a realistic CPU usage being somewhere in the middle. One way or another, one thing is clear: this new default setting will definitely save you time. Especially if you’re using an older system, you’ll see significant improvements in execution time.

When to use the debugger

Debugging is important. You just don’t want the debugger to be part of your test execution by default, but use it legitimately, and only when it really does make sense. So when you do need it, you now simply have to press one button to enable the debug mode. Using the debugger, you can set breakpoints directly in the Ranorex code editor to intercept the test run at predefined positions. This allows you to look at specific steps more closely and perform manual interactions. An important note on the side: Please don’t forget that previously set breakpoints will be ignored in the new default run mode.

System specifications
We’ve conducted our tests using a virtual machine setup on a host machine with the following specifications:

Host Machine
Win7 64 Bit
Intel i5-3570 CPU @3.4 GHz (4 Cores)
16 GB RAM
Samsung EVO 840 SSD
Seagate ST3320620AS HDD
NVidia GT640 2GB

Virtual Machine
VirtualBox 5.0.16 (+ Extention Pack)
Win7 32bit VM – installed on HDD
1 CPU (ICH9; I/O APIC enabled; 100% Execution Cap; PAE/NX enabled; Paravirtualization: default; VT-x + nested paging enabled)
3072 MB RAM
Display: 128 MB memory; 2D + 3D acceleration enabled
AHCI SATA controlled using host I/O cache

Learn more about Ranorex 6.0 Download Free Trial

The post Speed up Your Test Run by 200% with Ranorex 6.0 appeared first on Ranorex Blog.

Categories: Vendor

Remote Testing – Make the Most of Your Resources

Tue, 06/14/2016 - 12:20

The idea of automating tests is that you can optimize quality, speed and efficiency in testing. But what good’s that, if you can’t do any work during test execution instead, have to run one test after the other, and there is no fluid workflow when working in teams? We’ve taken test automation to the next level and offer a sublime feature that will save you time and supports a team approach: Ranorex Remote.

How does Ranorex Remote work?

Directly out of Ranorex Studio, you can deploy your tests to Ranorex Agents to execute them remotely. Using a Ranorex Runtime Floating License, you can install a Ranorex Agent on a physical or virtual machine. You can set up multiple agents within a network and configure the test environment according to your needs. This enables you to simultaneously execute multiple tests in various different test environments, in the same time it took to execute a single test before. Your application has to work no matter which technology or operating system your customers are using! Now you can test desktop, web or mobile applications using different operating systems, system configurations, browsers, etc. at the same time – there are no limitations. You can continue using your local machine during remote test execution. Once the test has been executed remotely, you’ll get immediate feedback on the test performance. The report itself is stored on the Ranorex Agent the test has been executed on.

Remote Testing

The ideal tool for working in teams

Just take agile testing, where immediate feedback and team collaboration are key success factors. Ranorex Remote now supports just that with a sublimely fluid workflow. Each team member can send tests to the same Ranorex Agents in a network and has full access to all information on these agents. As an agent can only execute one test at a time, the agent will queue the tests and execute them in order of arrival. Each team member can view the number of tests in the job queue of a specific agent, filter test reports according to test execution time and status, as well as delete or download reports directly from an agent. Thus, everyone in a team is equally informed about remote test execution. Just imagine a test run has failed, and you need immediate help or feedback from one of your colleagues: Simply pass on the information which agent the test has been executed on and when. Directly from the Remote Pad within Ranorex Studio, your colleague can now easily access the Run History of the Ranorex Agent, filter the report, download it locally and continue working with it. As each team member has full access to all remotely executed tests and their reports, it is easy to keep track of the testing progress.

Think that sounds fantastic? This feature is part of Ranorex 6.0. And as always: all major software updates are included in our maintenance services at no additional costs. Stop wasting time, get a Runtime Floating License and check out our User Guide for detailed instructions on how to set up your Ranorex Agents today!

Ranorex Remote Instructions Order a Ranorex Runtime License

The post Remote Testing – Make the Most of Your Resources appeared first on Ranorex Blog.

Categories: Vendor

Git Integration in Ranorex

Tue, 06/07/2016 - 12:23
Version control your automated tests with Git

Many have requested it, it’s been truly long awaited and finally it’s here: the Ranorex Studio Git integration. Ranorex 6.0 gives you full access to all Git functionalities within Ranorex Studio. Git is the most commonly used open source version control system and plays a major role in many development environments. So far, Ranorex has only supported the centralized version control systems SVN and TFS. Ranorex now responds to the ever increasing demand for a distributed version control system.

Benefits of the Ranorex Git integration

With the release date looming around the corner, it’s always a race of developing and testing new features. If you’re already using Git, you shouldn’t have to invest much needed time and resources to set up an additional version control system. You can now version control your Ranorex projects with Git. Directly from Ranorex Studio, you can commit and push changes to the repository as well as pull them from there. For those of you using Git in the development environment, this update thus not only save you time, but also enhances collaboration between development and testing teams.

This update gives you full access to all Git functionalities within Ranorex Studio, including:

  • Easy branching, merging and switching between branches
  • Working fast and offline
  • Clear file management and access to full file history even when a file has been moved
  • Easy debugging
  • Data assurance

This and more features are available with Ranorex 6.0. And in case you forgot: This major software update is already included in Ranorex software maintenance at no additional costs or hidden fees. Update to Ranorex 6.0 now, check out our Git User Guide section and get started! All there is left for us to say is: Enjoy and have fun testing!

Use Git within Ranorex Download Free 6.0 Trial

The post Git Integration in Ranorex appeared first on Ranorex Blog.

Categories: Vendor