测试结果已正确发布,但未反映在管道结果中 - Azure devops (Yaml)
我们使用 Azure Devops 2019 和 Yaml Pipeline 来执行 GUI 测试用例。测试在 Microsoft runagent 上执行。最近我们将框架更新为 Microsoft.NET.Test.Sdk 风格,从那时起我们遇到了一个奇怪的问题,如下所示。
问题:- 当我们运行测试时,测试实际上是在运行代理上执行的,在日志中可以看到结果已成功发布(通过 TCM 测试结果发布者完成),但测试仍处于状态“In进步”,无论实际上是通过还是失败。
我们还注意到,没有任何数据源的测试可以正确执行,并且它们的结果也可以正确显示。 ([TestMethod, TestProperty("TestCaseId", "27089"), TestCategory("Smoke"), TestCategory("Selenium"), TestCategory("Appium")])
但不幸的是,具有数据源的测试没有显示结果。 [TestMethod,TestProperty(“TestCaseId”,“27080”),TestCategory(“烟雾”),TestCategory(“Selenium”)] [DataSource("TC27080")]
我们的项目具有以下依赖项(在我们更新之后):
知道这些新更新可能会出现什么问题。(我们可以确认恢复此提交可以解决问题,但我们想知道我们所做的更新到底出了什么问题)
We are using Azure Devops 2019 and Yaml Pipeline in order to execute out GUI Testcases. The tests get executed on Microsoft runagent. Recently we have updated our Framework to Microsoft.NET.Test.Sdk style and since then we have a strange problem as below.
Problem :- When we run the tests, tests are actualyy executed on run agent, in Logs one sees that Results were published successfully (done through TCM Test result publisher), But the Tests remain in status "In Progress" no matter whether it was actually passed or failed.
Also we noticed that the Tests which do not have any Data Source are executed rightly and their Result is also shown correctly. ([TestMethod, TestProperty("TestCaseId", "27089"), TestCategory("Smoke"), TestCategory("Selenium"), TestCategory("Appium")])
But unfortunately no Result is shown for the Tests that have Data source.
[TestMethod, TestProperty("TestCaseId", "27080"), TestCategory("Smoke"), TestCategory("Selenium")]
[DataSource("TC27080")]
Our Project has following Dependecies (after the update that we did):
Any idea what could go wrong with these new update. (We could confirm that reverting this commit solves the problem but we would like to know what is exactly wrong with the the update that we did)
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
以下是问题:- MSTest nuget 包版本 2.2.4 及以上的数据驱动测试存在此问题。 https://github.com/microsoft/testfx/issues/1023
我们降级了MSTest 包版本为 2.2.3,现在测试结果可以正确显示。
Following was the problem :- MSTest nuget Package version 2.2.4 onwards has this problem with Data driven Tests. https://github.com/microsoft/testfx/issues/1023
We downgraded the MSTest package version to 2.2.3 and now the Test results are shown correctly.