This post has been republished via RSS; it originally appeared at: TestingSpot Blog articles.
First published on MSDN on Jul 26, 2017Authored by Ganesh Alalasundaram
Here is a walk through of a cookbook which would enable the use of Visual Studio Online vNext builds for automated Selenium/CodedUI tests to run independently in an Azure VM.
Why Azure VM’s !
As local servers/hardware are aging and becoming more obsolete, using cloud based solutions offer power and flexibility
How to Configure !
Prerequisites :
- Create a Visual Studio account to provision a new TFS or use an existing TFS VSO account. You can refer here for more details.
- Create an Azure VM in https://portal.azure.com/ mapped to a resource manager cluster or classic VM. More details can be found here .
- Create a test plan using test cases. Details can be found here
Steps :
- Go to “Build & Release” and click on “New” button
Mouse hover on “build, deploy and distributed test” and click on Apply button
- Make sure to remove tasks which are not being used. Add an "AzureVM's file copy" task to the template. Select the correct source and project where the source code is available. For this example, GIT repository is being used.
- Restoring Nuget Package . This process restores the Nuget package before building the application. Make sure to target the path to the solution.
- Build Solution .
Select the desired solution for the build, then select the correct Visual Studio version
5. AzureVM’s file copy
This task is used to copy the build generated by the hosted/default agent to your Azure VM. Once the files are copied, the test agent will run the tests using the binaries.
- Select the desired solution as the source
- Azure connection type should be Azure Resource Manager
- Select your azure subscription
- Destination type as Azure VM
- RM Storage account – This is the storage account in which the VM is mapped. It can be found in the Azure portal under the Azure Resource Manager group
- Resource Group (automatically pops up when you have an existing group in azure)
- Admin login (Azure VM’s credential)
- Password (Azure VM’s password)
6. Deploy Test Agent.
This task is used to deploy Test agent onto the azure VM.
- Enter the Machine IP (I used a static IP and saved it as a variable in the next tab to build)
- Admin login (Azure VM’s credential)
- Password (Azure VM’s password)
- Protocol as Https
- Agent Username and Password. (This example is using a hosted test agent, but can be configured for other tests agents.
- Ensure the hosted agent has admin added as your role.
- Select Run UI Tests
- Select Test Agent version
- Select Update Test Agent
7. Run Tests on VM .
This task will configure the test cases or the binaries you need to run. This can be either Selenium or CodedUI Tests.
- Enter the IP or FQDN of the machine under Machine
- Test Drop location (where the binaries are available from the step 5)
- Select the Test Plan/Suite or Enter the assemblies name (*.dll)
- Mention the test configuration.
8. Save and Queue
- Select the agent (either hosted or your custom agent)
- Branch – As its GIT, I have configured my integration branch as my master.
Tests may fail with the exceptions like "WinRM client cannot process the request." To resolve, follow the steps below:
- Goto powershell and type “winrm -quickconfig” or “Enable-PSRemoting -Force”
- enable windows remote management service in services.msc
FAQ : To know more about agents you can refer to the blog here
https://blogs.msdn.microsoft.com/visualstudioalm/2017/03/26/vstest-task-dons-a-new-avatar-testing-with-unified-agents-and-phases/
- Create Deployment Group
To create a deployment group, go to Build & Release -> Deployment Group
Copy the script and run it inside the Azure VM. Use PAT for authentication.
- Reporting .
vNext can send a default mail with the Test Run results. To configure, Go to Settings -> Notifications. Create a new notification and select the template to create a custom notification.
Sample Report
