Editor’s note: This article on the quantum computing sector was originally published by UK-based IDTechEx.
+++
CAMBRIDGE, UK – When it comes to assessing the performance of emerging technologies like quantum computing, establishing meaningful benchmarks is crucial but challenging. Just as predicting World Cup results can be unpredictable, using metrics to evaluate quantum computing technologies can be complex.
In a recent report by IDTechEx, the challenges of setting universally applicable benchmarks for quantum computing are explored. Metrics such as qubit number, coherence time, error rate, quantum volume, algorithmic volume, and circuit layer operations per second are commonly used but can be difficult to interpret, especially for those without a physics background.
Despite the complexity, benchmarking in the quantum computing industry is essential for predicting trends, making investments, and forming partnerships. Understanding common benchmarking methods, their trade-offs, and how they can be used together is crucial for stakeholders in this transformative technology.
Challenges in Benchmarking
Developing benchmarking metrics for a new technology like quantum computing presents challenges, especially when there are no existing rules. Some benchmarks have been developed by companies building quantum computers themselves, raising concerns about bias. Independent, widely applicable benchmarks are needed to facilitate fair comparisons in the industry.
Looking Towards the Future
Technology readiness levels (TRL) are commonly used to assess emerging technologies, but they may not be the best fit for computing technologies. Benchmarking efforts for quantum computers should focus on continuously expanding capabilities to serve a growing market, rather than reaching specific milestones.
Focus on Value
While there are numerous technical benchmarks for quantum computing, the ultimate measure of success lies in providing value to end-users. The key milestone will be when quantum hardware can solve commercially valuable problems in areas like drug development or weather forecasting. A universal benchmarking metric should track progress towards this goal.
Quantum Commercial Readiness Level
To evaluate the progress of quantum computing companies and technologies, IDTechEx has introduced an unbiased ‘Quantum Commercial Readiness Level’ (QCRL) index. This index ranges from 1-10, tracking different stages of commercial usability and scalability.
IDTechEx image
Overview of IDTechEx’s Quantum Commercial Readiness Level (QCRL). Source: IDTechEx – “Quantum Computing 2023-2043”
Conclusion
Benchmarking quantum computers is a complex task, but essential for demonstrating progress to stakeholders. Efforts to standardize benchmarking in the industry must continue, with a focus on unbiased metrics and the technology’s potential for commercial and societal value.
For more information and market forecasts, refer to IDTechEx’s report “Quantum Computing 2023-2043”. The report includes forecasts for different technology categories and projections for quantum computer adoption over the next 60 years.
To explore further, visit www.IDTechEx.com/QuantumComputing.
(C) IDTechEx
