Xray Comparison
Explore and learn more about everything that separates Xray from his main competitors in test management Apps for QA in Jira.
Top 3 reasons to choose Xray over Zephyr
Explore and learn more about everything that separates Xray from his main competitors in test management App for QA in Jira.
Automated tests with native support for BDD methodology and more
With native support for Behavior Driven Development (Gherkin/Cucumber) and integration with multiple test automation frameworks, including JUnit, NUnit, Robot, Behave, Calabash, Selenium and UFT Pro (LeanFT) there’s no excuse not to automate your tests and manage them in Jira.
The only tool that allows you to manage all your Tests as Jira issues
Xray’s tests are normal Jira issues which allow for full Jira power. Thus, you are able to configure screens, workflows and add custom fields to your testing related issues. Tests may validate requirements, defects, any issue type in fact. And you can track their progress in your existing Agile boards!
Ensures consistency by storing test definitions for past executions
In some regulated industries data consistency is crucial and mandatory, to ensure that your recorded data is not tampered. Xray ensures that your historical test data is not changed, so you know the exact conditions and specifications for which you reported your results.
Xray vs Zephyr Features
| Xray | Zephyr | |
|---|---|---|
Specify |
||
| Create, view, edit, clone tests | ||
| Link to Defects and Requirements | ||
| Visual editor for steps | ||
| Imbued Generic Automated Tests | ||
| Native support for BDD (Gherkin/Cucumber) | ||
| Preconditions for test cases | ||
| Re-use preconditions between test cases | ||
| Multiple preconditions for test cases | ||
Organize |
||
| Organize testing artifacts in the same or different projects | ||
| Organize tests in Test Sets | ||
| Hierarchical test organization in folders and subfolders | ||
Plan |
||
| Test plans | ||
| Hierarchical tests for execution organization in folders and subfolders | ||
Execute |
||
| Create, edit, clone and schedule test executions | ||
| Ad hoc style (execute unplanned tests) | ||
| Personalize and create Test run statuses | ||
Measure |
||
| Track with progress bars on Test Execution/Cycles | ||
| Track requirement coverage/status directly on issues, as an attribute | ||
| Number of built-in reports | 6 | 6 |
| Number of built-in gadgets | 6 | 8 |
Explore and evolve |
||
| Advanced query language | ||
| Built-in REST API | ||
Characteristics |
||
| Consistency (Test changing non-retroactivity on past executions) | ||
| Split test executions and plans between different projects | ||
| Email notifications | ||
| Usage of JIRA Issue Types | ||
| Test | ||
| Pre-Condition, Test set, Test execution, Test plan | ||
Test Environments |
||
| Analyze test results and requirement coverage per Test Environment | ||
Configuration |
||
| Extensive configuration, including behavior | ||
| Per project configuration | ||
| Support for project separation between requirements and tests | ||
Agile integration |
||
| See Test Executions and Test Plans in JIRA's native Agile board | ||
| CI Integrations | ||
| Jenkins | ||
| Bamboo | ||
| Importing results | ||
| Cucumber, JUnit, NUnit, Robot framework, Behave, Selenium, Xamarin Test Cloud | ||
| Importing tests | ||
| Manual via Excel/CSV | ||
| Cucumber | ||
| JUnit, NUnit, Robot framework | ||
| Importing results from HP ALM/QC 12.5x | ||
| Exporting Tests to fully customized DOC/PDF/Excel with Xporter | ||
| Integration with other JIRA-related tools (e.g. Confluence) | ||
| UI supported languages | ||
| English, German, French, Spanish | ||
| More languages |
Xray vs. Zephyr Pricing
| Xray | Zephyr | |
|---|---|---|
Users |
||
| 10 | $10 | $200 |
| 25 | $1,000 | $1,500 |
| 50 | $2,000 | $3,000 |
| 100 | $4,000 | $5,000 |
| 250 | $7,500 | $9,000 |
| 500 | $11,000 | $11,000 |
| 2000 | $19,000 | $19,000 |
| 10,000 | $28,000 | $35,000 |
| over 10,000 | $42,000 | $65,000 |
Ready to move to Xray?
Get started with a trial for your business