Useful software facts and statistics
We've aggregated interesting facts and figures from a variety of sources on topics such as DevOps, the cost of software development, testing and AI.
| Metric | Source | Topic |
|---|---|---|
| A McKinsey study of 1500 software projects demonstrated that agile teams are 27% more productive than those which follow other methodologies such as waterfall. | McKinsey | Agile |
| 91% report they have adopted agile, up from 82% in 2015 | Sauce Labs - Testing Trends for 2018 | Agile |
The types of revenue-generating and performance-improving applications that developers say are most in demand at their organizations are:
|
Appian Survey Report | AI |
68% agree low-code is viable for the development of mission-critical applications |
Appian Survey Report | AI |
79% of IT Developers say low-code can improve aspects of job satisfaction |
Appian Survey Report | AI |
80% of IT professionals say emerging technologies are increasing business pressure on IT |
Appian Survey Report | AI |
86% of IT developers feel overburdened by requests for new emerging technology applications and requests to integrate emerging technology with legacy systems and data |
Appian Survey Report | AI |
86% of IT developers surveyed agree that emerging technology is increasing the pressure on the IT organisation |
Appian Survey Report | AI |
Fewer than 50% of respondents say their organisation is 'extremely or very' effective at integrating AI and RPA into customer service workflows |
Appian Survey Report | AI |
The number 1 way to help IT and reduce job frustration is 'faster/easier development tools', and 79% believe that using low-code can free up developer time to work on higher level projects |
Appian Survey Report | AI |
| AI-enabled tools alone will generate $2.9 trillion in business value by 2021 (in part by saving an estimated 6.2 billion hours of worker productivity) | Biere, A., Cimatti, A., Clarke, E., & Zhu, Y. (1999). Symbolic Model Checking without BDDs. United States, Carnegie Mellon University. | AI |
| Organisations feel automated technology has the potential to offer benefits but it is underexploited, largely due to the lack of specialist in-house knowledge of the depth and range of automation techniques | Capgemini World Quality Report 2017 – 2018 | AI |
| 36% of the UK's largest financial services companies do not think their infrastructure is ready for the AI revolution | Digital Reality Survey 2019 | AI |
| UK businesses need to invest a total of £11.4 billion to be ready for new AI technologies | Digital Reality Survey 2019 | AI |
| AI-based marketing patents are the fastest growing global category, reaching a Compound Annual Growth Rate (CAGR) of 29.3% between 2010 and 2018 | EconSight | AI |
| 100% of enterprises that have implemented a low-code development platform have received ROI | Forrester Study, Appian | AI |
| By 2021 15% of all customer service interactions will be completely handled by AI, an increase of 400% from 2017 | Gartner Report 2018, Appian | AI |
| Technology will add an estimated £10 trillion to global economic activity by 2030 | McKinsey Business Discussion Piece 2018 | AI |
| AI focused' startups receive 15%-50% more funding on average | MMC Ventures Report | AI |
| Nearly 40% of Europe's 'AI Startups' use no AI (looked at 2,830 European companies that claim to make use of AI) | MMC Ventures Report | AI |
| AI deals increased in Q1, 2019 to 116 deals, up from 104 deals in Q4, 2018 | PwC and CB Insights' MoneyTree report | AI |
| AI-related companies raised $9.3B in 2018, a 72% increase over 2017 | PwC and CB Insights' MoneyTree report | AI |
| 11% of US and UK organisations have had AI/ML projects in production for more than 3 years | SnapLogic Study 2019 | AI |
| 19% of US and UK organisations are just beginning to think about their AI/ML plans and goals | SnapLogic Study 2019 | AI |
| 30% of US and UK organisations started their first AI/ML project within the last year | SnapLogic Study 2019 | AI |
| 33% of US and UK organisations had AI/ML projects in production for 1-3 years | SnapLogic Study 2019 | AI |
| 51% of US and UK organisations do not have the right in-house skilled employees to execute an AI/ML strategy | SnapLogic Study 2019 | AI |
| 93% of US and UK organisations consider AI/ML to be a business priority and have projects already planned or in production | SnapLogic Study 2019 | AI |
| For 6% of US and UK organisations AI/ML is not a priority at the time of the survey | SnapLogic Study 2019 | AI |
| A cursory search on a popular internet search engine of “artificial intelligence for software engineering” generated 164,000,000 results. Changing this search term to “AI for Code” produces a staggering 1,500,000,000 results (almost 11x the volume). | The Telegraph | AI |
| 21% of developers who don't do machine learning professionally think AI will never replace them | The State of Developer Ecosystem 2019 (Jetbrains Survey) | AI |
| 27% of developers who do machine learning professionally think AI will never replace developers | The State of Developer Ecosystem 2019 (Jetbrains Survey) | AI |
| 57% of developers expect AI to partially replace them in the future | The State of Developer Ecosystem 2019 (Jetbrains Survey) | AI |
| 21% of respondents are putting AI trials/proof of concepts in place | World Quality Report (Capgemini 2019-2020) | AI |
| 28% of respondents from this sector say that their most important activity in AI is to put trials and PoCs in place | World Quality Report (Capgemini 2019-2020) | AI |
| AI impacting the skills gap, particularly in non-functional testing areas. 49% of those in the automotive industry noted this to be an issue, compared with the survey average of 28% | World Quality Report (Capgemini 2019-2020) | AI |
| Almost 1/4 (24%) of financial services budgets are earmarked for investment in AI projects | World Quality Report (Capgemini 2019-2020) | AI |
| 12% of respondents reported that test environments are going to be specified with AI algorithms | World Quality Report (Capgemini 2019-2020) | AI |
| 16% of respondents reported plans to use AI in test execution activities | World Quality Report (Capgemini 2019-2020) | AI |
| 19% of respondents are going to use AI systems to store and reuse important domain knowledge | World Quality Report (Capgemini 2019-2020) | AI |
| 19% of respondents are going to use AI within the process of creating smart test dashboards | World Quality Report (Capgemini 2019-2020) | AI |
| 2% of respondents reported that AI was not part of their future plans | World Quality Report (Capgemini 2019-2020) | AI |
| Only 40% of respondents perform disaster recovery testing at least annually using one or more of the methods listed. | 2019 Accelerate State of DevOps Report | Automated testing |
| We found that formal change management processes that require the approval of an external body such as a change advisory board (CAB) or a senior manager for significant changes have a negative impact on software delivery performance. Survey respondents were 2.6 times more likely to be low performers if their organization had this kind of formal approval process in place. | 2019 Accelerate State of DevOps Report | Automated testing |
| 45% expect to increase spending on test automation in 2018; 55% at large companies | Sauce Labs - Testing Trends for 2019 | Automated testing |
| 56% do as much or more automated as manual testing, a minor decrease from 59% (2017) and 60% (2016) | Sauce Labs - Testing Trends for 2020 | Automated testing |
| 87% say management is on board with automated testing | Sauce Labs - Testing Trends for 2021 | Automated testing |
| The growing demand for test environments for various types of testing, as well as the increased need for availability of non-production environments, are two reasons for these rising costs | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 20% of respondents ' testing is said to occur in cloud-based temporary test environments, while considerably more - 30% - takes place in a traditional, permanent test environment. | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 20% of respondents' testing is said to occur in cloud-based temporary test environments, while 30% - half as much again - takes place in a traditional, permanent test environment | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 31% of the respondents in this sector believe their test engineers need to have data analytical skills and test case design skills | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 58% of automotive industry respondents - a significantly higher number than for the survey as a whole - say one of their greatest technical challenges in applications development is with security validation | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 59% of respondents form financial services backgrounds, identified that the greatest challenge with test automation within the financial services industry is the lack of appropriate test environments and data. | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 60% of respondents claimed that in 2019 the greatest test environment challenge they face is cost. This figure is up from 39% just two years ago | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 69% of respondents in this sector rated the top objective within testing and quality assurance as 'ensure end-user satisfaction' | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 84% of respondents say that they are, regularly or occasionally, proactively monitoring and reviewing production logs for incidents, and they are using that information to raise defects before end users notice that there's an issue. Whilst the remainder say they plan to do so in the coming year. | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 93% of respondents in the automotive industry reported an increase in proportional effort and cost spending on QA and test activities | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Across the board, in every area of testing, around 30% of respondents felt workforce transformation skills were lacking | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Automation is increasing across the test spectrum, despite a drop in figures for end-to-end business scenarios in 2018 (down by 1% to 15%). | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Half of respondents say that they have adequate test strategy and test design skills, and 45% say they have sufficient understanding of the implications of AI for business processes. (Authors regard these figures as optimistically high) | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 11% of respondents integrated all test cases in the CI/CD pipeline | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 14% of respondents used less test stages than in traditional developments | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 15% of respondents defined test cases as early as possible using BDD | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 19% of respondents used automated tools to help decide what tests are really needed | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 44% of respondents reported 'deficiency in design which secures data at source' as a challenge in securing data | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 49% of respondents reported 'lack of secure data policy and guidelines and awareness' as a challenge in securing data | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 51% of respondents reported that they used purchased, automation tools to generate new test data, compared to 49% in 2018 and 47% in 2017 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 53% of respondents claimed a reduction of overall security risk as a result of test automation | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 54% of respondents claimed a reduction of test costs as a result of test automation, compared to 61% in 2018, 53% in 2017 and 39% in 2016. | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 54% of respondents claimed a reduction of test cycle time as a result of test automation, compared to 64% in 2018, 54% in 2017 and 39% in 2016 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 54% of respondents reported that they reused and expanded available test data sets after each test run, compared to 53% in 2018 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 56% of respondents claimed better detection of defects as a result of test automation, compared to 64% in 2018, 60% in 2017 and 42% in 2016 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 57% of respondents claimed better reuse of test cases as a result of test automation, compared to 65% in 2018, 57% in 2017, and 40% in 2016 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 57% of respondents reported that they used in-house, custom-built automation tools to generate new test data, compared to 54% in 2018 and 49% in 2017 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 59% of respondents reported 'deficiency in controls in place which ensure systems that consume, process, and store this data adhere to the security policies embedded therein' as a challenge in securing data | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 59% of respondents reported that they created data manually with every test run, compared to 58% in 2018 and 27% in 2017 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 6% of respondents automated all test cases | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 62% of respondents reported using data visualisation tools for data provisioning, compared to 60% in 2018 and 44% in 2017 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 63% of respondents claimed better control and transparency of test activities as a result of test automation, compared to 66% in 20178, 43% in 2017 and 38% in 2016 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 65% of respondents reported that they copied production data, that they anonymise before testing, compared to 62% in 2018 and 43% in 2017 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 69% of respondents recorded using spreadsheets to manually generate new test data, compared to 66% in 2018 and 63% in 2017 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, 8% of respondents reduced the number of tests during sprints based on priority decision (must have, would have, could have) | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, respondents on average claimed that 15% of testing occurs in containerised (docker or similar) test environments, compared to 16% in 2018 and 15% in 2017 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, respondents on average claimed that 17% of testing occurs in a virtualized test environment, compared to 17% in 2018, 19% in 2017 and 24% in 2016 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, respondents on average claimed that 20% of testing occurs in cloud-based temporary test environments, compared to 19% in 2018, 21% in 2017 and 27% in 2016 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| In 2019, respondents on average claimed that 30% of testing occurs in a traditional permanent test environment, compared to 31% in 2018, 26% in 2017 and 28% in 2016 | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Insufficient time to test is reported by 43% of those within the automotive industry as the greatest challenge in testing key applications | World Quality Report (Capgemini 2019-2020) | Automated testing |
| More than half of our survey respondents (53%) report that as a result of automation, they have seen a reduction in their overall security risk | World Quality Report (Capgemini 2019-2020) | Automated testing |
| More than one in four respondents in 2019 (28%) say that full automation is difficult because some steps in the test process have simply had to be manual | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Not having time to test' is marked as higher than any other sector, as the industry's top challenge over the past few years | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Other testing challenges includes not having an in-house testing environment (reported by 36% of those in the automotive industry, compared to an overall average of 32%) and not having the right level of test automation | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Respondents report that 19% of user acceptance tests are being automated | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Security is the least automated testing type, with a level of 13% of this activity being automated | World Quality Report (Capgemini 2019-2020) | Automated testing |
| Since 2015, levels of security testing being performed in this way have risen from 42% to 58% | World Quality Report (Capgemini 2019-2020) | Automated testing |
| The figure for temporary environments has been trending downwards in recent years, from a high of 27% in 2016. | World Quality Report (Capgemini 2019-2020) | Automated testing |
| The greatest challenge posed by test environment is reported to be cost. In 2017, 39% of respondents identified cost as a challenge. In 2019, 60% recognised it as a challenge. | World Quality Report (Capgemini 2019-2020) | Automated testing |
| The share of IT budgets allocated to quality assurance and testing has dropped to 23% | World Quality Report (Capgemini 2019-2020) | Automated testing |
| The three most popular types of testing executed by respondents were - performance testing (used by 63% of respondents) functional testing of cloud services (61%) and security testing (58%). | World Quality Report (Capgemini 2019-2020) | Automated testing |
| 54% see a reduction of test cycle-time from automation | Capgemini World Quality Report 2017 – 2019 | Automated testing |
| 57% of respondents see an increase in the reuse of test cases through applying automation | Capgemini World Quality Report 2017 – 2020 | Automated testing |
| Up to 60% of respondents reported that test automation improves their ability to detect defects | Capgemini World Quality Report 2017 – 2021 | Automated testing |
| Respondents were overwhelmingly in favour of unit testing | Stack Overflow Developer Survey 2019 | Automated testing |
| 16% of developers don't have any tests in their projects | The State of Developer Ecosystem 2019 (Jetbrains Survey) | Automated testing |
| 71% of developers use unit tests in their projects | The State of Developer Ecosystem 2019 (Jetbrains Survey) | Automated testing |
| Among fully-employed senior developers 8% do not have any unit tests in their projects | The State of Developer Ecosystem 2019 (Jetbrains Survey) | Automated testing |
| We found that technical debt negatively impacts productivity, that respondents with high technical debt were 1.6 times less productive, and that the highest performers were 1.4 times more likely to have low technical debt. | 2019 Accelerate State of DevOps Report | Costs and code |
| Participants work an average of 43 hours/week and spend 50% of their time writing code (on average). | 2019 Diffblue Developer Survey | Costs and code |
| The three most popular primary coding languages are JavaScript (34%), C++ (24%), and Java (18%). | 2019 Diffblue Developer Survey | Costs and code |
| Automation is currently under-exploited in QA and testing. The average level of automation for test activities is around 16%. | Capgemini World Quality Report 2017 – 2022 | Costs and code |
| However, demand for testing in digital transformation, mobile applications, and Internet of Things is driving the industry to forecast an increase in the proportion of IT budgets allocated to testing in the future. By 2020, they expect it to rise to 32% of the total IT budget | Capgemini World Quality Report 2017 – 2023 | Costs and code |
| The proportion of total IT spending dedicated to quality assurance and testing is 26%. It has fallen from 31% in 2016 and 35% in 2015 | Capgemini World Quality Report 2017 – 2024 | Costs and code |
| 31% of IT leaders saw an issue with legacy infrastructure (restrained by this) | Digital Reality Survey 2019 | Costs and code |
| 40% of IT developers felt their ability to prepare their businesses for these new technologies is restrained by budget | Digital Reality Survey 2019 | Costs and code |
| Industry research shows that 33% of software projects overrun | McKinsey Business Insights 2019 | Costs and code |
| Industry research shows that 66% of software projects go over budget | McKinsey Business Insights 2019 | Costs and code |
| If the testing budget is $500,000 per year, test process optimisation could save $50,000 per year, while finding more defects than before | Software Testing Training Online | Costs and code |
| Not unusual for a production defect to cost over $4,000 to find, fix and re-implement. Twenty defects at this cost would be around $80,000 per release | Software Testing Training Online | Costs and code |
| Almost 40% of the respondents in this sector still rate 'enhance customer experience' as the most important aspect of their IT strategy, with a similar figure given for the high quality of software solutions | World Quality Report (Capgemini 2019-2020) | Costs and code |
| At Capgemini, we estimate that 20% of all testing will encompass artificial intelligence, and independent research suggests that by as soon as 2020, it will form part of 40% of all software development | World Quality Report (Capgemini 2019-2020) | Costs and code |
| Downward trend in the proportion of allocated budget for human resources within testing and QA, at 26% in 2019, compared to 35% in 2014. | World Quality Report (Capgemini 2019-2020) | Costs and code |
| In 2015, respondents to the World Quality Report survey said that more than a third (35%) of their overall IT budget was allocated to the testing and QA function. Since then, the trend has been downwards, and this year, the figure stands at just 23% | World Quality Report (Capgemini 2019-2020) | Costs and code |
| Highest performing engineers are 1.5 times more likely to have easy-to-use tools | 2019 Accelerate State of DevOps Report | Developers |
| Our analysis found that this culture of psychological safety is predictive of software delivery performance, organizational performance, and productivity | 2019 Accelerate State of DevOps Report | Developers |
| Research from a large two-year study at Google found similar results:26 that high-performing teams need a culture of trust and psychological safety, meaningful work, and clarity https://rework.withgoogle.com/blog/five-keys-to-a-successful-google-team/ | 2019 Accelerate State of DevOps Report | Developers |
| The use of external searches for information led to 1.67 times more likely to be productive - External search is important because these technologies provide strong communities for learning and growing (and recruiting, an important side benefit) and provide support for the use and adoption of public cloud and open source tooling | 2019 Accelerate State of DevOps Report | Developers |
| The use of internal searches for information led to 1.73 times more likely to be productive - providing developers, sysadmins, and support staff with the ability to search internal resources allows them to find answers that are uniquely suited to the work context (for example, using “find similar” functions) and apply solutions faster | 2019 Accelerate State of DevOps Report | Developers |
| The average annual salary of our respondents (before tax) is £67,624. | 2019 Diffblue Developer Survey | Developers |
| 30.2% of developers surveyed believe Elon Musk will be the most influential person in tech this year followed by Jeff Bezos (7.2%), Satya Nadella (4.4%), me/myself (2.5%) and Donald Trump (2.2%) | Stack Overflow Developer Survey 2020 | Developers |
| 74% of developers are satisfied with their careers | Stack Overflow Developer Survey 2021 | Developers |
| 80% of developers code outside of work/as a hobby | Stack Overflow Developer Survey 2022 | Developers |
| 9% of developers surveyed, started wrote their first line of code or program under the age of 10 | Stack Overflow Developer Survey 2023 | Developers |
| Over half of respondents (54.2%) had written code by the time they were sixteen | Stack Overflow Developer Survey 2024 | Developers |
| 60% of developers develop web back-end | The State of Developer Ecosystem 2019 (Jetbrains Survey) | Developers |
| 80% of developers use the source code collaboration tool regularly | The State of Developer Ecosystem 2019 (Jetbrains Survey) | Developers |
| 87% of developers code on the weekend | The State of Developer Ecosystem 2019 (Jetbrains Survey) | Developers |
| Java is the most popular primary programming language | The State of Developer Ecosystem 2019 (Jetbrains Survey) | Developers |
| Python is the most studied language with 27% of respondents having started or continued to learn Python in the last 12 months | The State of Developer Ecosystem 2019 (Jetbrains Survey) | Developers |
| Cloud continues to be a differentiator for elite performers and drives high performance. The use of cloud—as defined by NIST Special Publication 800-145— is predictive of software delivery performance and availability. The highest performing teams were 24 times more likely than low performers to execute on all five capabilities of cloud computing. | 2019 Accelerate State of DevOps Report | DevOps |
| Delivering software quickly, reliably and safely is at the heart of technology transformation and organisational performance. We see continued evidence that software speed, stability and availability contribute to organisational performance (including profitability, productivity and customer satisfaction). Our highest performers are twice as likely to meet or exceed their organisational performance goals | 2019 Accelerate State of DevOps Report | DevOps |
| Elite performers were 24 times more likely to have met all essential cloud characteristics than low performers | 2019 Accelerate State of DevOps Report | DevOps |
| In our survey, 80% of respondents said the primary application or service they supported was hosted on some kind of cloud platform | 2019 Accelerate State of DevOps Report | DevOps |
| Only 29% of respondents who said they were using cloud infrastructure agreed or strongly agreed that they met all five of the characteristics of essential cloud computing defined by NIST | 2019 Accelerate State of DevOps Report | DevOps |
| Productivity can drive improvements in work/life balance and reductions in burnout, and organizations can make smart investments to support it. To support productivity, organizations can foster a culture of psychological safety and make smart investments in tooling, information search, and reducing technical debt through flexible, extensible, and viewable systems. | 2019 Accelerate State of DevOps Report | DevOps |
| Respondents who meet all essential cloud characteristics are 2.6 times more likely to be able to accurately estimate the cost to operate software. They are also twice as likely to be able to easily identify their most operationally expensive applications, and 1.65 times as likely to stay under their software operation budget. | 2019 Accelerate State of DevOps Report | DevOps |
| The best strategies for scaling DevOps in organisations focus on structural solutions that build community. High performers favor strategies that create community structures at both low and high levels in the organization, including Communities of Practice and supported Proofs of Concept, likely making them more sustainable and resilient to reorgs and product changes | 2019 Accelerate State of DevOps Report | DevOps |
| The DevOps industry continues to improve, particularly among the elite performers. The proportion of our highest performers has almost tripled, now comprising 20% of all teams. | 2019 Accelerate State of DevOps Report | DevOps |
| There’s a right way to handle the change approval process, and it leads to improvements in speed and stability and reductions in burnout. Heavyweight change approval processes, such as change approval boards, negatively impact speed and stability. In contrast, having a clearly understood process for changes drives speed and stability, as well as reductions in burnout. | 2019 Accelerate State of DevOps Report | DevOps |
| This year, we found that automated testing drives improvements in CI. It means that smart investments in building up automated test suites will help make CI better. | 2019 Accelerate State of DevOps Report | DevOps |
| Elite performers deploy code 208 times more frequently than low performers | 2019 Accelerate State of DevOps Report | DevOps |
| From 2018 to 2019, the proportion of 'low performers' is down, this reflects a continued shift in the industry, as organisations continue to transform their technology | 2019 Accelerate State of DevOps Report | DevOps |
| From 2018 to 2019, the proportion of medium performers is up. Some are likely improved low performers, while others may be high performers who dropped as they struggled with increased complexity | 2019 Accelerate State of DevOps Report | DevOps |
| From 2018 to 2019, the proportion of 'elite performers' has almost tripled | 2019 Accelerate State of DevOps Report | DevOps |
| In 2019, 57% of respondents agreed or strongly agreed that 'consumers can automatically provision computing resources as needed, without human interaction from the provider', a figure which is 11% higher than 2018 | 2019 Accelerate State of DevOps Report | DevOps |
| In 2019, 58% of respondents agreed or strongly agreed that 'Capabilities can be elastically provisioned and released to rapidly scale outward or inward on demand, appearing to be unlimited and able to be appropriated in any quantity at any time' a figure which is 13% higher than 2018 | 2019 Accelerate State of DevOps Report | DevOps |
| In 2019, 58% of respondents agreed or strongly agreed that 'Provider resources are pooled in a multi-tenant model, with physical and virtual resources dynamically assigned on-demand. The customer may specify location at a higher level of abstraction such as country, state, or datacenter', a figure which is 15% higher than 2018 | 2019 Accelerate State of DevOps Report | DevOps |
| In 2019, 60% of respondents agreed or strongly agreed that 'capabilities can be accessed through heterogeneous platforms such as mobile phones, tablets, laptops, and workstations', a figure which is 14% higher than 2018 | 2019 Accelerate State of DevOps Report | DevOps |
| In 2019, 62% of respondents agreed or strongly agreed that 'Cloud systems automatically control, optimize, and report resource use based on the type of service such as storage, processing, bandwidth, and active user accounts' , a figure which is 14% higher than 2018 | 2019 Accelerate State of DevOps Report | DevOps |
| In 2019, respondents 'indicated increased use of multi-cloud and hybrid cloud compared to last year' | 2019 Accelerate State of DevOps Report | DevOps |
| The Elite performers 'routinely deploys on-demand and performs multiple deployments per day' whilst low performers 'reported deploying between once per month (12 per year) and once per six months (two per year) | 2019 Accelerate State of DevOps Report | DevOps |
| When comparing elite vs low performers, the elite performers have '208 times more frequent code developments', '106 times faster lead time from commit to deploy', '2,604 times faster time to recover from incidents', 7 times lower change failure rate'. | 2019 Accelerate State of DevOps Report | DevOps |
| 83% of the software developers we surveyed agree that their company’s software quality could be improved. | 2019 Diffblue Developer Survey | DevOps |
| When asked which factors contribute to poor software quality, 40% of developers attributed it to manual processes, 40% cited unrealistic schedules, and 39% said it was due to insufficient software testing. | 2019 Diffblue Developer Survey | DevOps |
| When asked which issues their organizations suffers from as a result of poor software quality, the top responses were - Increased cost to fix errors (selected by 46%), increase in the amount of development work (42%), delays to new releases (40%) and reduced staff productivity (29%). | 2019 Diffblue Developer Survey | DevOps |
| When a release is delayed due to poor quality, the delay takes an average of 3 weeks. | 2019 Diffblue Developer Survey | DevOps |
| Developers spend about 20% of their time writing unit tests, at an average cost of £14,287 per developer per year | 2019 Diffblue Developer Survey | DevOps |
| With 45 developers employed (on average) at participants’ companies, the average annual cost of unit testing for just one organization is approximately £643,000. | 2019 Diffblue Developer Survey | DevOps |
| Developers spend 15% of their time writing all other types of tests. | 2019 Diffblue Developer Survey | DevOps |
| The data revealed that the average code coverage target for the organizations the study participants work at is 63%. | 2019 Diffblue Developer Survey | DevOps |
| In addition to spending 35% of their time just writing tests, developers are also under pressure to deliver on new product development, which takes 29% of their time | 2019 Diffblue Developer Survey | DevOps |
| Almost half (48%) of developers reported that they have found it difficult to achieve the unit testing coverage set by their organizations | 2019 Diffblue Developer Survey | DevOps |
| 42% of developers have skipped writing unit tests in order to speed up new feature development | 2019 Diffblue Developer Survey | DevOps |
| When it comes to the benefits of the unit tests that developers are instructed to write, however, they tend to be in agreement that unit tests improve software quality (90% agree) and speed up code maintenance (95% agree), making maintenance 40% faster on average. | 2019 Diffblue Developer Survey | DevOps |
| 75% of respondents agreed with the statement “It’s faster to rewrite legacy code that has unit tests,” | 2019 Diffblue Developer Survey | DevOps |
| 77% agreed with the statement “It’s easier to review peer’s code to identify errors when the code has unit tests.” | 2019 Diffblue Developer Survey | DevOps |
| The issues developers would most expect to see from releasing software applications without unit tests are bugs (selected by 51%), delays to product launches (42%), poor application performance (36%) and security problems (33%). | 2019 Diffblue Developer Survey | DevOps |
| When asked to rank the top three benefits to their organization of using unit testing as part of software development, 55% of developers chose the response “It helps us to achieve our DevOps goals,” and 50% chose “It makes the end-to-end development process faster”—the top responses behind “It improves the quality of code” (chosen by 63%). | 2019 Diffblue Developer Survey | DevOps |
| 73% of developers in the UK and 53% in the US report that they could be more satisfied in their jobs | 2019 Diffblue Developer Survey | DevOps |
| In terms of having achievable targets, 87% agree that having realistic targets is important to job satisfaction, and 91% say it’s important to have the right tools | 2019 Diffblue Developer Survey | DevOps |
| When it comes to writing unit tests to meet internal coverage targets, 66% agree that unit test setup is mundane and 39% of developers wish they didn’t have to write unit tests at all. | 2019 Diffblue Developer Survey | DevOps |
| 66% of developers agreed that they get less enjoyment out of repetitive tasks, and 86% say the availability of automation for repetitive tasks is a factor in their job satisfaction | 2019 Diffblue Developer Survey | DevOps |
| 86% also say it’s important to have time to work on creative problem-solving tasks, and 82% agreed that they would rather spend their time on creative tasks, such as developing new product features, than on repetitive tasks. | 2019 Diffblue Developer Survey | DevOps |
| For 84% of respondents, their organization’s willingness to adopt new technology, like AI, is important to job satisfaction. | 2019 Diffblue Developer Survey | DevOps |
| 68% of our respondents said their company has partially or fully adopted AI tools that assist with software development | 2019 Diffblue Developer Survey | DevOps |
| When asked which tasks developers would most like to see automated, findings bugs was ranked first by 33%, and software testing (including writing unit tests) was the first choice for 28%. | 2019 Diffblue Developer Survey | DevOps |
| Developers would expect automating the development of unit tests to result in the following benefits - faster development times (selected by 65%), more accurate code (57%), and reduced stress and frustration (52%), among other benefits | 2019 Diffblue Developer Survey | DevOps |
| 97% of the developers in this study said they would be interested in having the opportunity to use a tool that could help guide them to develop unit tests. | 2019 Diffblue Developer Survey | DevOps |
| Notably, twice as many respondents in the US (compared to the UK) answered that their company has “fully adopted” an AI tool for software development, reflecting a trend among respondents from the US to voice greater demand for automation tools, to report higher adoption of automation tools in their companies—and to have higher overall workplace satisfaction than their counterparts in the UK. | 2019 Diffblue Developer Survey | DevOps |
| A recent survey by Atlassian suggests that over 50% of software teams are already using continuous integration and/or delivery, and over 32% have plans to move to CI/CD. | Atlassian | DevOps |
| The same survey indicates that over 50% of organisations are able to push changes to production daily. | Atlassian | DevOps |
| 17% have fully embraced DevOps, up from 10% in 2017 | Sauce Labs - Testing Trends for 2022 | DevOps |
| 21% fix bugs immediately, down from 23% in 2017 | Sauce Labs - Testing Trends for 2023 | DevOps |
| 44% report that they want to deploy more quickly, down from 54% in 2016 | Sauce Labs - Testing Trends for 2024 | DevOps |
| 9% report they want to deploy more slowly, up from 0% in 2016 | Sauce Labs - Testing Trends for 2025 | DevOps |
| 59% of respondents report deficiencies in the controls they have in place which ensure that the systems they consume, process and store their data adhere to embedded security policies | World Quality Report (Capgemini 2019-2020) | DevOps |
| 87% of respondents claimed that defect leakage into production was being measured | World Quality Report (Capgemini 2019-2020) | DevOps |
| Almost 2/3 of respondents report that they have difficulties in automating because their applications change too much with every release. A figure which has increased since 2018 records. | World Quality Report (Capgemini 2019-2020) | DevOps |
| Challenges with security validation are cited by more than half (52%) of respondents | World Quality Report (Capgemini 2019-2020) | DevOps |
| In 2019 there has been a significant growth in the use of Open Source automation tools | World Quality Report (Capgemini 2019-2020) | DevOps |
| More than half our respondents (53%) believe automation is reducing their overall security risk | World Quality Report (Capgemini 2019-2020) | DevOps |
| Over one in four respondents (26%) say that agile and DevOps developments have changed their security skills requirements and created a greater need | World Quality Report (Capgemini 2019-2020) | DevOps |
| Security Testing being performed in cloud environments has risen to 58% from 42% in 2015 and, as our main security section notes, we expect to see that figure rise significantly higher. | World Quality Report (Capgemini 2019-2020) | DevOps |
| When asked to what extent agile and DevOps have changed the skills expected of QA and test professionals, more than one in four respondents (27%) said security skills are lacking. | World Quality Report (Capgemini 2019-2020) | DevOps |
| 27% of financial services expect their workloads to remain on-premise | Digital Reality Survey 2019 | Software & Financial Services |
| 48% of large financial services businesses will move their workloads to cloud wherever possible | Digital Reality Survey 2019 | Software & Financial Services |
| 62% of IT teams are investing to address legacy issues and modernise infrastructure | Digital Reality Survey 2019 | Software & Financial Services |