調(diào)研目的
- 如何實(shí)施敏捷測(cè)試，并構(gòu)造合理的賦能平臺(tái)進(jìn)行持續(xù)測(cè)試
- 如何更好地在DevOps/DevSecOps/DevTestOps中智能集成測(cè)試Pipeline，ROI達(dá)成
- 如何進(jìn)行策略分析，策略執(zhí)行，策略回溯
- 如何在數(shù)字化轉(zhuǎn)型中適應(yīng)
- 如何更好的自動(dòng)地進(jìn)行自動(dòng)化
941295ca465241bcae36f708160391a3636788290546634945.png
圖片.png
對(duì)比平臺(tái)
- 調(diào)研中...
一、TestRail
網(wǎng)址鏈接：https://www.gurock.com/testrail
Features 官方介紹
Organize test cases,manage test runs,track test results,and measure prgress with our popular web-based agile testing tool. TestRail helps you meet your quality goals and complete your tests on time
- Track Your Entire Testing Effort
- Sprints，Iterations&Milesones
- Integrate Test Automation & Issuse
- Capture Agile Tesing Results
功能模塊
- Modern Test Management
- Track Test Results
- Reporting&Metrics
- Seamless Integration
- Team & Productivity
- Customizable & Scalable
- Enterprise Edition
關(guān)鍵字: Organize manage track results measure 一體化/一站式 可視化 度量化 個(gè)人定制化 Web平臺(tái)化
不足：
有落地產(chǎn)品方案，但有些操作略顯繁瑣
二、SIXSENTIX
網(wǎng)址鏈接：https://www.sixsentix.com/agile
官方介紹
- QA Visual Analytics & Dashboards Make Testing More Visible
- What to Test? Structuring Business Requirements
->高效可重復(fù)的方式(自動(dòng)化，半自動(dòng)化，手工)
-> 基于ROI- Quickly Adapt
整體，分治
minimize overall risk
quickly adapt to changes
sprint
testing early 測(cè)試前置 結(jié)構(gòu)化測(cè)試用例
catching high risk or critica errors 風(fēng)險(xiǎn)梳理，發(fā)現(xiàn)致命錯(cuò)誤- Supporting the Agile Process
- Iterative & Incremental -> 基于風(fēng)險(xiǎn)的測(cè)試，增量結(jié)果可視化可追溯
- Efficient with Face2Face Communications -> 扭轉(zhuǎn)，結(jié)果
- Short Feedback Loop & Adaptation -> 站會(huì)，看版
- Software Quality Focus -> 基于風(fēng)險(xiǎn)，測(cè)試驅(qū)動(dòng)，自動(dòng)化...
關(guān)鍵字
accelerate quality
為多種業(yè)務(wù)提供解決方案(big 、data 、cloud 、functional、erp/sap...)
各個(gè)階段提供敏捷方案、自動(dòng)化方案
提倡數(shù)據(jù)分析，可視化、前置
不足：
大多數(shù)是概念性的講解，未體驗(yàn)真實(shí)落地的案例
三、smartbear
網(wǎng)址鏈接：https://smartbear.com
官方介紹
Think Bigger. Build Smarter.
Plan, build, test, and release great software, faster.
Solutions for shifting-left, moving to DevOps, or any digital transformation that gets thrown your way
Product模塊：
manage
create
Test
manage.png
1.1 manage：
to create a seamless delivery pipeline, testing has to keep pace with a quickening development lifecycle.
solution模塊：
solution.png
質(zhì)量生態(tài)圈完善，涉及了方方面面，理論知識(shí)充足具有參考價(jià)值，落地方案具有參照性
Collaborate
四、sealights
網(wǎng)址鏈接：https://www.sealights.io/
官方介紹
Smarter testing means delivering high-quality software faster. Period.
Use Machine Learning to Accelerate Releases, and Increase Software Quality Without Missing Anything
product模塊
seaproduct.jpg
分析引擎
- Test Impact Analysis 增量代碼分析，精準(zhǔn)化，度量分析(優(yōu)先級(jí)維度)，機(jī)器學(xué)習(xí)持續(xù)優(yōu)化
- Test Gap Analysis 覆蓋率分析 動(dòng)態(tài)代碼分析 風(fēng)險(xiǎn)可視化
a、Stop wasting time building unnecessary tests and accelerate your sprints.
b、You need visibility into high-risk areas, exposing untested code, poor design and coding practices, and even unused legacy code.
c、the SeaLights plugin allows your developers to view the individual methods and lines of code that need attention, including who changed it and when, right in the source code.- Release Quality Analysis 未經(jīng)測(cè)試覆蓋的代碼，禁止發(fā)布
a、Define and enforce your own quality standard.
solutions模塊
seasolutions.jpg
- Agile Testing Optimization
Stop wasting time building unnecessary tests and accelerate your sprints
a、Test Impact Analysis 精確測(cè)試點(diǎn)
b、Quality Risks Analysis 可視分析，實(shí)時(shí)分析未被覆蓋的測(cè)試點(diǎn)以及此點(diǎn)的使用頻率
c、Test Gap Analysis
Monitor -> collect -> Track(changes、usage) -> Correlating -> Visualizing- Agile Metrics
- Technical Debt -> 可用性 可擴(kuò)展性 效率性 性能 穩(wěn)定性 實(shí)現(xiàn)方式粗暴
。。。。
Case studies
seacasestudies.jpg
education
seaeducation.jpg
Agile Testing: 8 Principles，7 Challenges and how to master them
Continuous testing/feedback
Involving the whole team
Quick feedback
high-level software quality - clean and tight
Less documentation
Test-driven
Customer satisfaction
Testing Quadrants
agilequadrants.jpg
7 testing Challenges
a、Changing Requirements - 數(shù)據(jù)分析哪些已被測(cè)試，哪些未被測(cè)試
b、Not enough Information - create high level test scenarios 、以及質(zhì)量數(shù)據(jù)獲取
c、Continuous Testing - 大家一起完善user stories
d、Technical Skills
e、Frequent Regression Cycles - automation、parallel
f、Lack of Communication
g、No quality Measurement -度量的重要性
Establishing a Mesaurement if Quality to Guide Agile Testing
Code Quality
可擴(kuò)展
可維護(hù)
可讀性/代碼風(fēng)格良好
Clarity -> 代碼閱讀性好，可以很容易讀懂代碼在做啥
Well-documented
Well-tested
Efficiency
度量標(biāo)準(zhǔn)、監(jiān)控：
......
關(guān)鍵字:
理論知識(shí)扎實(shí)，具有一定的參考性，提出了敏捷測(cè)試的重點(diǎn)以及關(guān)注點(diǎn)，提供了理論性的解決方案，所以介紹篇幅略長(zhǎng)
data-information、 analysis、 measurable(metrics)、 feedback 、standard、 debt、覆蓋率、一站式、一體化
不足：
未具體使用，未體驗(yàn)其利用機(jī)器學(xué)習(xí)進(jìn)行分析和評(píng)估的能力、解決方案也只是文字性的描述 ，未給出具體數(shù)據(jù)，暫無法評(píng)估產(chǎn)品的分析能力是否精確可靠具有解決能力
四、parosoft
網(wǎng)址鏈接：https://www.parasoft.com/
parasoft.jpg
官方介紹
products
周期內(nèi)各階段產(chǎn)物
各階段測(cè)試類型以及可視化管理構(gòu)造
parasoft-product.jpg
Parasoft Jtest:
Java Static Analysis
Java Unit Testing 利用AI賦能，加快有效case的輸出，減少時(shí)間成本，JUnit, Mockito, and PowerMock，出質(zhì)量數(shù)據(jù)快
Java Test Impact Analysis 精準(zhǔn)性分析、準(zhǔn)確的增量進(jìn)行分析、并非全量運(yùn)行，有針對(duì)性，減少時(shí)間成本ROI
Java Coverage & Traceability manual tests, automated functional tests, and unit tests
Java Security Testing
Reporting & Analytics
solution
圖片.png
AI
圖片.png
Agile Testing
Continuous Testing
關(guān)鍵字：在敏捷測(cè)試，持續(xù)測(cè)試給出了相應(yīng)的解決方案，并利用AI以及機(jī)器學(xué)習(xí)，聚焦關(guān)注點(diǎn)，減少全量測(cè)試的時(shí)間成本，在自動(dòng)化的一些痛點(diǎn)上，也給出了一些解決方案，聚焦ROI
與其他平臺(tái)上的解決方案多數(shù)重合，說明在某些問題的解決上，慢慢趨于了一致，不過更加強(qiáng)調(diào)了AI與機(jī)器學(xué)習(xí)的賦能
五、eggplant
網(wǎng)址鏈接：https://www.eggplantsoftware.com/
官方介紹
Product
圖片.png
- Digital Automation Intelligence
提高生產(chǎn)率和可預(yù)測(cè)性，控制成本并有效地?cái)U(kuò)展測(cè)試范圍
并結(jié)合人工智能（AI）和機(jī)器學(xué)習(xí)以進(jìn)行持續(xù)改進(jìn)
you need to test every type of technology, including within systems, as well as the full UX and journey across all devices, platforms, and operating systems- Customer Experience Insights
monitoring everything
可分析 <-> 監(jiān)控 <-> 自動(dòng)化分析
user journey
Solutions
圖片.png
Automation
圖片.png
scriptless models, AI, and analytics -> 快速/有效自動(dòng)化，test everything
Artificial Intelligence
AI-driven testing
1、AI改變工作方式，生活習(xí)慣
2、Testing from the user perspective <-> test the entire customer experience
3、creates a model of the system and user journeys and automatically generates test cases
Continuous Testing
1、Keep pace with DevOps and Continuous Delivery expectations
2、user journey
Digital Transformation
1、the traditional pass/fail mentality is replaced by a laser focus on the customer experience.
2、compliance criteria
3、By feeding this information back to DevOps
Monitoring
Performance Optimization
How can companies accelerate their release times while ensuring that the technology delivers a high-quality experience?
關(guān)鍵字
強(qiáng)調(diào)了AI賦能，并指出在哪些方面進(jìn)行智能化地探索，如利用AI進(jìn)行自動(dòng)化的實(shí)施，加快DevTestOps的輸出速度
強(qiáng)調(diào)了用戶體驗(yàn)以及user journey的e2e
強(qiáng)調(diào)了監(jiān)控的重要性以及形成閉環(huán)
強(qiáng)調(diào)數(shù)字化轉(zhuǎn)變中的運(yùn)用
下一步
進(jìn)一步了解eggplant是如何利用AI進(jìn)行自動(dòng)化與用戶體驗(yàn)賦能的具體實(shí)施和AI使用細(xì)節(jié)；
如何接入產(chǎn)品
如何決策產(chǎn)品策略
六、Conformiq
網(wǎng)址鏈接：https://www.eggplantsoftware.com/
官方介紹
八、ACCELQ
網(wǎng)址鏈接：https://www.accelq.com/
官方介紹
Codeless Test Automation and Agile Test Management Platform
product
調(diào)研中...
