Sealights Support Matrix

Home/Sealights Support Matrix

SeaLights Support Matrix

[ 1. Configurations ] [ 1.1 Supported Configurations ] [ 1.2 Certified Configurations ] [ 2. Features ] [ 2.1 Test Impact Analytics ] [ 2.2 Quality Risks and Code Coverage ] [ 2.3 Pull Request Analysis ] [ 2.4 BSID Simplification (Only relevant for agents running tests) ]

1. Configurations

1.1 Supported Configurations

Configuration Topic JAVA Groovy C# .NET Core Node.js Browser Python
Language Version 7+ 2.4.x .NET FW 4.5+ Any 6+
  • IE : 8+
  • Chrome : Latest
  • FireFox : Latest
  • PhantomJS : Latest
CPython
2.7, 3.4 – 3.7
Operation System
  • Windows
  • Linux
Windows Windows [B]
  • Windows
  • Linux
  • Windows
  • Linux
Linux
Application Server /

Web Server

  • Apache Tomcat
  • Jetty
  • WildFly
  • JBOSS
  • WebSphere Liberty
  • Weblogic
  • Adobe Experience Manager
IIS IIS [B] (NA) (NA)
  • uWSGI
  • Gunicorn
Applicative Frameworks
  • Spring 4+
  • Java Native URL Connection
  • Selenium Web Driver 2+ [B]
  • Jersey 2.22 [B]
  • Jetty Http Client 9.1.1-9.4.7
  • Apache Http Client 4.2.2 – 4.5.6
  • Netty 4.0.27.Final [B]
  • Servlet API 2.5 [B]
  • Amazon SQS 1.10.56 [B]
  • Rabbit MQ AMQP Client 3.6.2 [B]
(NA) (NA) (NA)
  • AngularJS
  • ReactJS
  • pytest-xdist [B]
Test Frameworks

( Note: Test FW support
is required only for the
Test Results
Import
feature. )

  • JUnit 4.x , 5.x
  • TestNG 6.x, 7.x
  • JSystem
  • Cucumber
    • 1.2.x, 2.x, 3.x : Compatible with JUnit 4
    • 4.x : Compatible with JUnit 4, JUnit 5, TestNG
  • Jmeter 2.13 [B]
  • MS Test 1.x, 2.x
  • xUnit
  • nUnit 3.x
  • xUnit [B]
  • nUnit 3.x [B]
  • Mocha 2.x+

 

The following FW are supported for Uploading Test Results :

  • Mocha PhantomJS [B]
  • Jest
  • Ava
  • Karma
  • Jasmine
  • JUnit 4.x , 5.x
  • Manual Tests (via SeaLights Chrome Ext)

 

The following FW are supported for Uploading Test Results :

  • Karma
  • pytest 3.6.4 – 4.6.6
  • unittest
  • unittest2
  • nose
Build Tools
  • Maven

  • Gradle

  • Build

(NA)
  • WebPack

  • Grant
(NA) (NA)
CI Tools
  • Jenkins
  • VSTS (Azure DevOps)
  • TFS 2018

* Other CI Tools can be supported as long as they can run an EXE/JAR via Shell script or batch
file.

Code Viewers
  • Github Enterprise
  • Github Cloud
  • Bitbucket Server
  • Bitbucket Cloud
  • Gitlab Server
  • Gitlab Cloud
  • VSTS (Azure DevOps)
  • TFS 2018

[B] = Beta-level support

1.2 Certified Configurations

Configuration Topic JAVA Groovy C# .NET Core Node.js Browser  Python
Language Version

7.X

8.X

2.4.x .NET FW 4.5 (NA) 6+
  • IE : 8+
  • Chrome : Latest
  • FireFox : Latest
  • PhantomJS : Latest
CPython
2.7, 3.4 – 3.7
Operation System

Linux

Windows Server 2016 Datacenter version
1607, OS build 14393.1358, x64
(NA)
  • Linux
  • Windows
  • Linux
Linux

Application Server /

Web Server

  • Apache Tomcat
  • Jetty
  • WildFly
  • JBOSS
IIS 10 (NA) (NA) (NA)
  • uWSGI
  • Gunicorn
Applicative Frameworks
  • Spring 4+
  • Java Native URL Connection
  • Selenium Web Driver 2+ [B]
  • Jersey 2.22 [B]
  • Jetty Http Client 9.1.1-9.4.7
  • Apache Http Client 4.2.2 – 4.5.6
  • Netty 4.0.27.Final [B]
  • Servlet API 2.5 [B]
  • Amazon SQS 1.10.56 [B]
  • Rabbit MQ AMQP Client 3.6.2 [B]
(NA) (NA) (NA)
  • pytest-xdist [B]

Test Frameworks

  • Cucumber
    • 1.2.5
    • 2.4.0
    • 3.0.1
    • 4.0.0
    • 4.8.0
  • JUnit
    • 4.12
    • 5 ( = JUnit Platform 1.2)
  • SoapUI
    • 5.0.0
    • 5.5.0
  • TestNG
    • 6.8.8
    • 6.9.4
    • 6.10
    • 6.14.3
    • 7.0.0
  • MS Test
    • V1
    • V2, Adapter V 1.1.11
    • V2, Adapter V 1.2.0
    • V2, Adapter V 1.3.0
    • V2, Adapter V 1.4.0
  • NUnit
    • 3.10.0
    • 3.2.0
    • 3.6.0
  • XUnit
    • 2.0.0
    • 2.2.0
    • 2.4.1
  • Mocha 6.1.4
  • JUnit 4.x , 5.x
  • Manual Tests (via SeaLights Chrome Ext)

The following FW are supported for Uploading Test Results :

  • Karma
  • pytest 3.6.4 – 4.6.6
  • unittest
  • unittest2
  • nose
Build Tools
  • Maven

  • Gradle 

  • MS Build (C# only)

(NA) (NA) (NA) (NA)
CI Tools
  • Jenkins
Code Viewers

2. Features

2.1 Test Impact Analytics

Java C# Node.js Browser Python Ruby
App-Under-Test Language cross (x)
Test Frameworks
  • JUnit 4.x , 5.x
  • TestNG 6.x, 7.x
  • SoapUI 5.x.x
  • Cucumber 2.x, 3.x, 4.x (details)
  • Jmeter 2.13 [B]
  • MS Test 1.x, 2.x (R)
  • xUnit (R)
  • nUnit 3.x (R)
  • Mocha 2.x+
NA
  • pytest 3.6.4 – 4.6.6
  • unittest (R)
  • unittest2 (R)
  • nose (R)
Ruby
RSpec
3.8.x

(R) = Supports Test Recommendation only. No support for Test Selection 

2.2 Quality Risks and Code Coverage

Feature JAVA Groovy Node.js Browser Python C# .NET Core
Coverage by Method (tick)
Coverage by Branch (error) (error) cross (x) cross (x) cross (x)
Coverage by Line (error) (error) (error) cross (x) cross (x)
Production Data (error) cross (x) cross (x) cross (x) cross (x) cross (x)
Manual Tests
Source Control Integration :

  • Commit History
  • Contributors
  • Code Viewer
GitHub Cloud

Gitlab Cloud

Bitbucket Enterprise

Bitbucket Cloud

GitHub Cloud

TFS 2017

TFS 2018

VSTS

2.3 Pull Request Analysis

SCM Type SeaLights Chrome
Extension
SeaLights SCM Plugin
Github Enterprise

 (v2.14+)

Github Cloud
Bitbucket Server  (v5.15+)
Bitbucket Cloud (error)
Gitlab Server (error)
Gitlab Cloud (error)
VSTS (Azure DevOps) (error)
TFS 2018 (error)

2.4 BSID Simplification (Only relevant for agents running tests)

Scenario

JAVA

Groovy

C#

.NET Core

Node.js

Browser

Python
Supported
(error) (error) Not relevant (error)