AI led Software Engineering Use cases: Application to Testing, Deployment & Operations

by Jérôme Perdriaud - Head of Smart Application Modernization, Sopra Steria by Satish Srivastava - Head of Propositions Delivery & Architecture community, Sopra Steria India | minutes read

In the previous edition of the series, we have seen how AI transforms the software engineering lifecycle, specifically Management, Requirements, design and development phases. In this edition we will see how subsequent Testing, Deployment and Operations activities are affected by AI.


In order to achieve continuous delivery it is important to match the high velocity of development with high velocity of testing and AI helps achieve that. The main areas where AI currently has a lot of applicability are automated test case creation and maintenance, detecting vulnerabilities, ensuring test coverage, visual anomaly detection and test case prioritization.

Before delving into these use cases in detail, it is worthwhile to go through Facebook example as they have developed an ecosystem of tools for the implementation of full cycle of automatically designing test cases, running them, finding errors and fixing them leveraging their AI enabled testing tool sets. Its Infer tool points at the buggy code through deep code analysis while Sapienz tool automatically generates test sequences and finds the exact points of failure, in effect establishing both cause and effect. Getafix tool is able to suggest fixes found by both Infer and Sapienz and SapFix is able to provide patch for fixes.  To be fair, about 75% of the bugs reported by Sapienz need to be fixed and only a small fraction of them are fixed by SapFix, mostly null pointers, but about half of SapFixes are directly accepted once checked by a developer. Facebook has been successfully employing these tools in its platform development and enhancement. They have open sourced Infer, Getafix and Sapienz and plan to opensource SapFix soon. 

A vibrant start up ecosystem has come up which leverages AI for automated writing of test cases. They adopt different approaches to test case writing, e.g.  from test cases written in natural language, from changes in visual aspects of the application etc. They usually offer a wider range of AI enabled testing capabilities than just automated test case writing. A description of some of these start-ups and their offerings is given below:

  • Functionalize’s is a cloud based automated testing technology that is used for functional, performance and load testing. It uses ML to speed up test creation and maintenance. Its Adaptive Language Processing (ALP™) engine is based on reinforcement learning paradigm and allows to upload test plans written in natural language. Their intelligent test agent then converts them into a test scripts. The engine asks questions to confirm its understanding and each time a user answers, it learns more about the specific UI is tested or how the tests are described in general. 
  • Application visual management is a recent trend where AI is applied for automatically detecting changes in the visual aspect of a web application (also known as “visual anomaly detection”) and then taking the actions such as in automatically creating and maintaining the tests for new or modified aspects of the UI. Applitools is a leading tool for application visual management.
  • Mabl is a Software-as-a-Service (SaaS) provider and a unified DevTestOps platform for ML-based test automation. The key features of this solution include auto-healing tests, ML-driven regression testing based on application performance metrics, visual anomaly detection, secure testing, data-driven functional testing, cross-browser testing, test output, integration with popular tools, and much more.
  • Testim tries to leverage machine learning to speed up the authoring, execution and most importantly the maintenance of automated tests.
  • offers AI enabled automated testing platform for mobile apps. has trained their bots on tens of thousands of apps to help it understand what an app looks like and how it interfaces with external services. It leverages this learning to produce a test scenario list and leverages bots to test those automatically. 
  • TestCraft is another AI-powered test automation platform which works on top of Selenium. Testers can visually create automated Selenium based tests using drag and drop interface with no coding skill required.
  • ReTest generates and maintains test cases from the project specific semantic representation which mentions list of aspects which need to be tested. 

Automated test case writing Besides the test case writing, intelligently determining test coverage is also an area where AI is being applied. Sealights analyzes both the code and the tests that run against it, it gives insights on what part of the code tests are covering and what they're not. This is done, not only for unit tests, but also functional, manual, performance tests. Its quality dashboard can help understand the test coverage for each build and whether it’s improving, decreasing, or has quality holes or not. 

There are different approaches for defect prioritization possible, e.g. Validata prioritizes the defects based on the risk that they impose, and so it proposes an order in which they should be addressed. Defect prioritization, like requirement prioritization, is an active research area and should see more start-ups in future.




On Aug 2012, the Knights Capital Group lost $400 mil and went bankrupt in just 45 min after a single failed deployment. While such incidents are catastrophic, waiting for disproportionately long while preparing to have a perfect deployment is also not in the best interest of business. AI enabled deployments can help organization ensure reliable and fast deployments. 

AI enabled deployment approach adopted by Sweagle involves learning from status of each prior deployment you made and let AI correlate what bad deployments have in common. AI also look at user feedback data from incidents management systems to enrich its understanding. This learning can be used to automatically correct any wrong configuration data for future deployments.

A San Francisco based start-up,, leverages AI for continuous verification of deployments by analyzing business, performance and quality metrics and deciding on automated rollbacks. 

Modern cloud systems have a vast number of components that continuously undergo updates and identifying bad rollouts amongst them is challenging. These cloud vendors make use of analytics service for safe deployment in a large-scale system infrastructure. Azure’s Gandalf enables rapid impact assessment of software rollouts to catch bad rollouts before they cause widespread outages. It monitors and analyzes various fault signals and correlate each signal to determine which rollout may have caused the fault signals and decide whether a rollout is safe to proceed or should be stopped.




This is the phase where an application is available to business, need to meet its expectations and evolve with it. This is also the phase with most cost cutting opportunities. The AI enabled tools which help an organization perform application management activities are known as AI-Ops tools. These tools cover varied aspects such as application performance monitoring, log analytics, business activity monitoring,  automation platform, incident prediction and resolution, root cause analysis, virtual chat bots etc.  

AI-Ops tools typically take a consolidated approach towards monitoring, including application, infrastructure and network level monitoring. They collect the application, infrastructure and network log data, correlate them and have a single view of problem by combining all three. There are many matured AI-Ops vendors in the market, e.g. Dynatrace, Splunk Enterprise, AppDynamics, Instana, Moogsoft, Micro Focus Operations Bridge, Digitate and so on. 

Sopra Steria, through its IP’s (Alive Intelligent Platform, Lagoon Datalake, Digital Enablement Platform etc) and its partners, has very strong presence in this area. Axway, a sister company to Sopra Steria with very strong ties, has the market leading offering in this space, called Axway Decision Insights.



AI-led software engineering is a very dynamic area with lot of start-up play, research activities as well as intense activities from established players. As we have seen, AI impacts not just Operations phase (AI-Ops) but also all the other steps in the application life cycle. We believe that although it is still new domain but this will inevitably lead to big transformations in the way we are practicing software engineering. 

As this domain is evolving at a very rapid pace any recommendations run the risk of getting obsolete very fast and will need to be revised constantly. Based on the study we have conducted, we have identified use cases that we should prepare to deploy at scale or start experimenting with.


In the next edition we will see some of the products, IP’s and accelerators we have built within Sopra Steria or as part of wider ecosystem.

Read more

AI led Software Engineering Use Cases: Application to Development

In the previous edition of the series, we have seen how AI transforms the software engineering lifecycle, specifically Management, Requirements gathering, Design phases. In this edition we will see how software development activities are affected by AI.

Read more

More on this topic

Supply Chain Management in Aerospace: maximising agility with AI-based risk monitoring

| Benoit Spolidor, Maxime Claisse

One of the main challenges of today’s Aerospace Supply Chain Practitioners is to manage their operations in such a complex and volatile environment. The Supply Chain purpose of fulfilling customer service promise while controlling costs within the overall industrial chain has become harder, in particular because Aerospace manufacturers are facing a lack of visibility in their supply and delivery processes.

How can Artificial Intelligence support the performances of Aerospace Supply Chain?

| Benoit Spolidor, Maxime Claisse

Artificial Intelligence is having a positive impact on almost every industry. It improves decision making processes, creating fast and consistent operations management. In the specific field of Aerospace, our conviction is that to be fully efficient, AI must be developed with dedicated characterics. Sopra Steria invests on these features for sustainable and large scale transformation by AI for Aerospace companies.

Remote experts help technicians on-site

| Torbjørn Meland

New technology helps maintain production and increase productivity at operating facilities by reducing the need to send technical experts between factories. By using HoloLens 2, Microsoft Teams, Intune and Dynamics 365 combined with a design-drive process, you can get a solution that gives on-site technicians support and help from remote experts.

AI lead Software Engineering: Sopra Steria Ecosystem Offerings

| Jérôme Perdriaud, Satish Srivastava

Apart from internally developed IP’s given in the previous edition we also have an ecosystem of mature market leading companies, start-ups as well as labs and universities to build competency in their offerings and use them to help our clients. Following are some of the offerings from the ecosystem.

AI led Software Engineering: Sopra Steria Offerings

| Jérôme Perdriaud, Satish Srivastava

Sopra Steria has been investing in AI led software engineering in order to help our clients not only reduce cost and gain efficiency but also empower their businesses by making the processes more responsive and scalable.

AI led Software Engineering Use cases: Application to Testing, Deployment & Operations

| Jérôme Perdriaud, Satish Srivastava

In the previous edition of the series, we have seen how AI transforms the software engineering lifecycle, specifically Management, Requirements, design and development phases. In this edition we will see how subsequent Testing, Deployment and Operations activities are affected by AI.

AI led Software Engineering Use Cases: Application to Development

| Jérôme Perdriaud, Satish Srivastava

In the previous edition of the series, we have seen how AI transforms the software engineering lifecycle, specifically Management, Requirements gathering, Design phases. In this edition we will see how software development activities are affected by AI.

AI led Software Engineering Use Cases: Application to Requirements & Design

| Jérôme Perdriaud, Satish Srivastava

In the previous edition of the series, we have seen how AI transforms the software engineering lifecycle, specifically Management phases. In this edition we will see how Requirement engineering is affected by AI.

Innovating in Pursuit of Climate Action and Environmental Sustainability

| Avinash Lunj, Siva Niranjan

From reducing carbon footprint to improving energy efficiency, the surge of sustainable business continues to increase in prominence. To attract new business, talent and investment, companies are required to demonstrate, that they are putting their climate change strategies into action.

Digital Innovation Factory: Which technical platform select and how operate it over the time?

| Béatrice Rollet, Simon Herd

As seen previously, digital experience and platform offerings call for a massive amount of software with frequent new services, and regularly updated and deleted new features. Long-established companies adopting an Enterprise Platform model must then own a new Digital Innovation Factory encompassing a Technical Platform.

Digital Innovation Factory: How to reshape your software development activities at the era of cloud-native application?

| Béatrice Rollet, Neil Anderson

60% of backend developers use containers in their work. Relying on cloud-native technologies, defining as modern applications packaged in containers, deployed as micro-services, running on elastic infrastructure, and managed through agile DevSecOps processes fits very well with large enterprise who very often encompass a wide variety of software technologies.

The Enterprise Platform and the CIO at the age of the new normal

| Béatrice Rollet, Marlon Bromfield

Covid-19 pandemic has showed that the most digitalized companies, the digital-first companies, were the un-constable winner of this challenging period. Providing business activities through advanced digital experiences or platform offerings, these companies has kept their customers and partners engaged and happy in this challenging period.

AI led Software Engineering Use Cases: Application to Project Management activities

| Jérôme Perdriaud, Satish Srivastava

Using various AI techniques such as machine learning, deep learning, natural language processing (NLP), information visualization etc it is possible to guide the software engineering professionals with AI enabled decision making and automations. 

AI led Software Engineering

| Jérôme Perdriaud, Satish Srivastava

CIOs are expected to partner business, and at times leads, the delivery of digital transformation. The existing IT landscape of a company needs to be rationalized and modernized to be able to achieve the expected business velocity.

Conversational Assistants: go to scale

| Patrick Meyer

74% of French companies consider chatbots as a lever for digital transformation and more than a third have already deployed one. By 2020, 80% of them could use a chat assistant. A massive deployment that echoes consumer habits: 69% prefer the bot to a human exchange.

How can you use your IT assets to achieve digital transformation?

| Andre Bakland, Simon Herd, Béatrice Rollet

According to Gartner, for every dollar invested in digitalisation in 2020, three dollars will have to be invested in the modernisation of IT assets. Therefore, opting for the right evolution strategy becomes a crucial issue. Read more.

How Data Science can help in a pandemic situation?

| Marlon Cárdenas

With the aim of covering current and future needs of society, Data Science and Artificial Intelligence are seeking to drive the creation of technological solutions that benefit users in their daily lives. Many disciplines are uniting behind this cause, with health sciences to the fore, especially given the current context of the battle against the Covid-19 pandemic.

How holographic technology is helping doctors deliver better care

| Scott Leaman

Long gone are the days when holograms were the stuff of sci-fi movies and video games. Holographic technology is taking the medical world by storm, and by the looks of it, it’s here to stay. So how exactly is this technology helping doctors, and what are the major developments that we expect in the near future?

How will artificial intelligence transform industry?

| Maxime Claisse, Alexis Girin, Benoit Spolidor

Whilst there is no set definition of artificial intelligence as of yet, experts are in agreement that AI can simulate human cognitive capabilities such as perception, reasoning, action, and learning. AI now promises to completely transform the industrial sector – one of its primary applications.

International Paris Air Show: 5 trends to transform aeronautic

| Youssoupha Diop

The 53rd International Paris Air Show 2019 has confirmed the mounting fierce competition in the world of aeronautics. In this context, data, digital tools and artificial intelligence are now understood to be precious bargaining chips to accelerate transformation and turn these challenges into opportunities.

Anticipate cloud migration with FinOps

| Béatrice Rollet

Innovative and fast cloud services are crucial to digital transformation initiatives. Whilst there is no textbook model on how to adopt these services, it is nonetheless vital for companies to integrate them as fully optimised services in order to control their ROI.

From product to services: Flying the Aeronautics Industry into the Digital Future

| Philippe Armandon, Gaudérique Garrigue

With increasing travel demand and new competitors entering the market, aircraft manufacturers today are under considerable pressure.

How to control and optimise your cloud costs

| Didier Teixeira, Béatrice Rollet, Frédéric Janicot

Using public cloud services means rethinking your IT financial management. 

ASD S5000F: taking Aircraft MRO to new heights?

| Cyrille Greffe

In the 1990s, the combination of computer-aided design (CAD) and the concept of modular documentation gave rise to the first ASD standards (AeroSpace and Defence Industries Association of Europe).

Application replatforming: the Cloud migration booster

| Benjamin Chossat

Simple set-up, low cost and access to the horizontal elasticity of the Cloud: replatforming is often considered the best solution for porting a business application to the Cloud.

7 key strategies to transform applications with the Cloud

| Benjamin Chossat

How to modernise an application efficiently using the Cloud?

Innovating in pursuit of environmental sustainability

| Siva Niranjan

To attract new business, talent and investment, companies have had to demonstrate their environmental credentials more and more over the past years to wide range of stakeholders including institutional investors, regulators, clients, and employees.

Urban Air Mobility: will the future of mobility be in the air?

| David Elmalem, Sébastien Lautier

While the dream of the flying car has often been reserved for science fiction, a very practical and real future is gradually emerging for urban air mobility.

Guidance is the key for adapting DevOps to big business

| Gauthier Deschamps

DevOps is revolutionising agile transformation for big business. The method was initially focussed on software building but by automating production, it frees up resources so as to better resolve organisational and human malfunctions.

How Blockchain technology can improve Industry 4.0’s cybersecurity

| Alexandre Eich Gozzi

Earlier this year, the world’s largest container shipping company Maersk fell victim to a massive ransomware attack from the infamous NotPetya malware.