Integrate Your Test Suite with BrowserStack
BrowserStack’s C# SDK supports a plug-and-play integration. Run your entire test suite in parallel with a few steps!
Prerequisites
- An existing automated test suite.
- .Net v5.0+, NUnit v3.0.0+. (if you are using NUnit), xUnit v2.0+ (if you are using xUnit)
Integration steps
Depending on your preferred method of building projects, perform the following steps to integrate your test suite with BrowserStack. You can integrate yout test suite with C# SDK using NUnit, xUnit, or SpecFlow.
Based on the method you use to build your project, complete the steps in the following tabs to integrate with BrowserStack.
Add BrowserStack SDK as NuGet package
Steps to install BrowserStack SDK as a NuGet package:
- On the Visual Studio toolbar, select Project > Manage NuGet Packages. A NuGet Package Manager Window opens.
- In the Browse tab, search for BrowserStack.TestAdapter, and click Install.
Create your BrowserStack config file
After installing the SDK, create a browserstack.yml
config file at the root level of your project. This file holds all the required capabilities to run tests on BrowserStack.
Set access credentials
Set userName
and accessKey
parameters in the browserstack.yml
file, available in the root directory, to authenticate your tests on BrowserStack.
Set platforms to test on
Set the browsers you want to test under the platforms
object. Our config follows W3C formatted capabilities.
Platform | Browser |
---|---|
Linux | Firefox |
Linux | Chrome |
Linux | Edge |
To dynamically configure platforms across different tests, you can comment out the platforms
capability while still passing platform-specific capabilities.
BrowserStack Reporting (part 1/2)
You can leverage BrowserStack’s extensive reporting features using the following capabilities:
buildIdentifier | Description | Generated build name on dashboard |
---|---|---|
${BUILD_NUMBER} (Default) | If build is triggered locally, an incremental counter is appended. If build is triggered with CI tools, CI generated build number is appended. |
bstack-demo 1 bstack-demo CI 1395 |
${DATE_TIME} | The timestamp of run time is appended to the build. | bstack-demo 29-Nov-20:44 |
Advanced use cases for Build name
Custom formatting of build name
Prefix buildIdentifier
with desired characters, for example, #
or :
buildName: bstack-demo
buildIdentifier: '#${BUILD_NUMBER}'
Re-run tests in a build
In order to re-run your build, you need to ensure that your build name matches an existing build so that your tests get merged into the previously run build.
You can re-run selected tests from a build using any of the following options:
Option 1: Set the existing build name in the BROWSERSTACK_BUILD_NAME
variable and prepend it to your test run command to re-run tests in the same build:
MacOS/Linux:
BROWSERSTACK_BUILD_NAME=“bstack-demo 123” dotnet test --filter "Category=sample-test"
Windows Powershell:
$env:BROWSERSTACK_BUILD_NAME=“bstack-demo 123”; dotnet test --filter "Category=sample-test"
Windows cmd:
set BROWSERSTACK_BUILD_NAME="bstack-demo 123" && dotnet test --filter "Category=sample-test"
Option 2: Set the build name as a combination of buildName
and buildIdentifier
, as seen on the dashboard, and set buildIdenitifier
as null
:
buildName: bstack-demo 123
buildIdentifier: null
Option 3: Set the buildIdentifier
as the build number or time of the required build as seen on the dashboard:
buildName: bstack-demo
buildIdentifier: 123
sessionName
is the name of your test sessions and is automatically picked from your test class/spec name. It doesn’t need to be set manually when using the BrowserStack SDK.
Use additional debugging features
BrowserStack offers session logs, screenshots of failed commands, and a video of the entire test, with additional options to enable.
Update browserstack.yml file
Update the browserstack.yml
file in the root folder of your test suite and add the given code to it.
BrowserStack Reporting (part 2/2)
Test assertions are specific to selected language frameworks. BrowserStack requires explicit instruction to determine whether your tests have passed
or failed
based on the assertions in your test script.
Mark session name
You can use the sessionName capability to give your session a name (usually describing the test case) so that it is easy for you to debug later.
Mark test as passed or failed
To mark whether your test has passed or failed on BrowserStack, use the following Javascript executor in your test script.
The arguments passed in the Javascript method for setting the status and the corresponding reason of the test are status
and reason
-
status
accepts eitherpassed
orfailed
as the value -
reason
accepts a value in string datatype
Run your test suite
The BrowserStack Test Adapter enables you to execute your test suite seamlessly, just as you did previously.
- On the Visual Studio toolbar, select Test > Test Explorer.
- Right-click on your test and click Run.
Install BrowserStack SDK
Run the given command to install the BrowserStack SDK and create a browserstack.yml
file in the root directory of your project.
-
The
browserstack.yml
config file holds all the required capabilities to run tests on BrowserStack. -
The
BrowserStack.TestAdapter
works on top of your framework test adapter to run parallel tests on BrowserStack across multiple platforms mentioned on thebrowserstack.yml
file.
Update your BrowserStack config file
Now that the BrowserStack SDK has been installed and the browserstack.yml
config file has been created, update your browserstack.yml
config file with the given parameters.
Set platforms to test on
Set the browsers you want to test under the platforms
object. Our config follows W3C formatted capabilities.
Platform | Browser |
---|---|
Linux | Firefox |
Linux | Chrome |
Linux | Edge |
BrowserStack Reporting (part 1/2)
You can leverage BrowserStack’s extensive reporting features using the following capabilities:
buildIdentifier | Description | Generated build name on dashboard |
---|---|---|
${BUILD_NUMBER} (Default) | If build is triggered locally, an incremental counter is appended. If build is triggered with CI tools, CI generated build number is appended. |
bstack-demo 1 bstack-demo CI 1395 |
${DATE_TIME} | The timestamp of run time is appended to the build. | bstack-demo 29-Nov-20:44 |
Advanced use cases for Build name
Custom formatting of build name
Prefix buildIdentifier
with desired characters, for example, #
or :
buildName: bstack-demo
buildIdentifier: '#${BUILD_NUMBER}'
Re-run tests in a build
In order to re-run your build, you need to ensure that your build name matches an existing build so that your tests get merged into the previously run build.
You can re-run selected tests from a build using any of the following options:
Option 1: Set the existing build name in the BROWSERSTACK_BUILD_NAME
variable and prepend it to your test run command to re-run tests in the same build:
MacOS/Linux:
BROWSERSTACK_BUILD_NAME=“bstack-demo 123” dotnet test --filter "Category=sample-test"
Windows Powershell:
$env:BROWSERSTACK_BUILD_NAME=“bstack-demo 123”; dotnet test --filter "Category=sample-test"
Windows cmd:
set BROWSERSTACK_BUILD_NAME="bstack-demo 123" && dotnet test --filter "Category=sample-test"
Option 2: Set the build name as a combination of buildName
and buildIdentifier
, as seen on the dashboard, and set buildIdenitifier
as null
:
buildName: bstack-demo 123
buildIdentifier: null
Option 3: Set the buildIdentifier
as the build number or time of the required build as seen on the dashboard:
buildName: bstack-demo
buildIdentifier: 123
sessionName
is the name of your test sessions and is automatically picked from your test class/spec name. It doesn’t need to be set manually when using the BrowserStack SDK.
Use additional debugging features
BrowserStack offers session logs, screenshots of failed commands, and a video of the entire test, with additional options to enable.
Update browserstack.yml file with selected capabilities
Copy the code snippet and replace the contents of the browserstack.yml
file in the root folder of your test suite.
BrowserStack Reporting (part 2/2)
Test assertions are specific to selected language frameworks. BrowserStack requires explicit instruction to determine whether your tests have passed
or failed
based on the assertions in your test script.
Mark session name
You can use the sessionName capability to give your session a name (usually describing the test case) so that it is easy for you to debug later.
Mark test as passed or failed
To mark whether your test has passed or failed on BrowserStack, use the following Javascript executor in your test script.
The arguments passed in the Javascript method for setting the status and the corresponding reason of the test are status
and reason
-
status
accepts eitherpassed
orfailed
as the value -
reason
accepts a value in string datatype
Integration steps
Setup authentication
Set environment variables for BrowserStack credentials:
It is recommended that you store your credentials as environment variables and use those environment variables in your test script.
Update your test suite config file
Update your test cases to read BrowserStack credentials from environment variables and update the Selenium hub URL to the BrowserStack remote hub URL: https://hub-ft.browserstack.com/wd/hub
<appSettings>
<add key="user" value="YOUR_USERNAME" />
<add key="key" value="YOUR_ACCESS_KEY" />
<add key="server" value="hub-ft.browserstack.com/wd/hub" />
</appSettings>
Migrate your test cases
After you set up authentication in your test scripts, you can now add configurations such as adding browser-OS combinations, test suite organization details, test status that you want to track, and then run your tests.
<!-- Set this in your App.config file -->
<configuration>
<environments>
<chrome>
<add key="browserName" value="Chrome" />
</chrome>
</environments>
</configuration>
a. Organize tests
<!-- Set these capabilities in your specflow config file -->
<configuration>
<capabilities>
<parallel>
<add key="buildName" value="browserstack-build-1" />
<add key="sessionName" value="BStack parallel specflow" />
<add key="projectName" value="bstack-demo" />
</parallel>
</capabilities>
</configuration>
Use the following capabilities for naming your tests and builds. This ensures effective debugging, test reporting, and build execution time analysis.
Capability | Description |
---|---|
buildName |
CI/CD job or build name. For example, Website build #23 , staging_1.3.27
|
sessionName |
Name for your test case. For example, Homepage - Get started . |
projectName |
Name of your project. For example, Marketing Website . |
- Use a new
buildName
name every time you run your test cases. This ensures that sessions are logically grouped under a unique build name and helps you monitor the health of your test suite effectively.
- A build can only have a maximum of 1000 tests and post that a new build gets created with a
-1
suffixed to the original build name.
b. Mark test as Passed or Failed
To mark whether your test has passed or failed on BrowserStack, use the JavaScript executor in your test script. You can mark a test as passed
or failed
based on your test assertions.
The arguments passed in the JavaScript method for setting the status and the corresponding reason of the test are status
and reason
:
-
status
accepts eitherpassed
orfailed
as the value. -
reason
accepts a string value.
IJavaScriptExecutor jse = (IJavaScriptExecutor)driver;
JsonObject executorObject = new JsonObject();
JsonObject argumentsObject = new JsonObject();
argumentsObject.Add("status", status);
argumentsObject.Add("reason", reason);
executorObject.Add("action", "setSessionStatus");
executorObject.Add("arguments", argumentsObject);
jse.ExecuteScript("browserstack_executor: " + executorObject.ToString());
c. Set up debugging capabilities
-
Enable visual logs and automatic screenshot capture at every Selenium command by setting the
debug
capability. -
By default, Console Logs with log level
errors
are enabled. Utilize theconsoleLogs
capability to enable various log levels, includingwarnings
,info
,verbose
,errors
, anddisable
. -
Capture the browser’s performance data, such as network traffic, latency, HTTP requests, and responses in a HAR format, by setting the
networkLogs
capability.
<!-- test-script.cs -->
<configuration>
<capabilities>
<parallel>
<add key="buildName" value="browserstack-build-1" />
<add key="sessionName" value="BStack parallel specflow" />
<add key="debug" value="true" />
<add key="consoleLogs" value="info" />
<add key="networkLogs" value="true" />
</parallel>
</capabilities>
</configuration>
Connect your website under test
BrowserStack can integrate with test suites pointing to your localhost URL, staging environment, and even websites behind one or more proxies/firewalls.
Option 1 - Language bindings
a. Install the package
Install the BrowserStack Local binary by running the following command:
dotnet add package BrowserStackLocal
b. Set the Access Key and use available methods in your test script
Set the bsLocalArgs
variable to your BrowserStack access key and use the following methods provided by the local library to manage your local connection:
Method | Description |
---|---|
local.start(bsLocalArgs) |
Expects bsLocalArgs object. Returns a callback when the tunnel has started successfully. Your test script should start executing after this callback has been invoked. |
local.stop() |
Call this method after your test suite is complete. |
local.isRunning() |
Check if the BrowserStack local instance is running. |
using System;
using System.Collections.Generic;
using BrowserStack;
// Creates an instance of Local
Local bsLocal = new Local();
// You can also set environment variables using "BROWSERSTACK_ACCESS_KEY".
var bsLocalArgs = new List<KeyValuePair<string, string>>
{
new KeyValuePair<string, string>("key", "YOUR_ACCESS_KEY")
};
// Starts the Local instance with the required arguments.
bsLocal.start(bsLocalArgs);
// Checks if BrowserStack local instance is running.
Console.WriteLine(bsLocal.isRunning());
// Your test script should start executing after the bsLocal has started.
// Stop the Local instance after your tests are completed.
bsLocal.stop();
c. Add desired capabilities to enable browserstack.local
Copy and set the browserstack.local
capability to true
. You may face errors running your test script if any other capability is enabled before setting up BrowserStack Local.
<!-- App.config -->
<configuration>
<capabilities>
<parallel>
<add key="local" value="true" />
</parallel>
</capabilities>
</configuration>
If your staging environment is behind a proxy or firewall, additional arguments, such as proxy username, proxy password, etc., need to be set. Check out Local Binary parameters to learn about additional arguments.
Option 2 - CLI interface - Binary
a. Download BrowserStack Local
- Download for macOS (10.7+)
- Download for Windows (XP and above)
- Download for Linux (64 bit)
- Download for Linux (32 bit)
b. Unzip the Binary
Unzip the downloaded file and move it to a folder/directory from which you have permission to start it using your command line or terminal.
c. Run the Binary using your command line or terminal
Run the following command to initiate the BrowserStack Local connection:
# macOS or Linux
./BrowserStackLocal --key YOUR_ACCESS_KEY
# Windows
BrowserStackLocal.exe --key YOUR_ACCESS_KEY
If your staging environment is behind a proxy or firewall, additional arguments, such as proxy username, proxy password, etc., need to be set. Check out Local Binary parameters to learn about additional arguments.
d. Set up config to enable browserstack.local
Copy the capabilities into your config file:
<!-- App.config -->
<configuration>
<capabilities>
<parallel>
<add key="local" value="true" />
</parallel>
</capabilities>
</configuration>
We're sorry to hear that. Please share your feedback so we can do better
Contact our Support team for immediate help while we work on improving our docs.
We're continuously improving our docs. We'd love to know what you liked
We're sorry to hear that. Please share your feedback so we can do better
Contact our Support team for immediate help while we work on improving our docs.
We're continuously improving our docs. We'd love to know what you liked
Thank you for your valuable feedback!