Contact us

Measuring the accuracy of AI and Machine Learning for classifying patents – what’s the Gold Standard?


We hosted a webinar in collaboration with Patinformatics LLC around how we can test ML (machine learning) for its accuracy in classifying patents. The webinar stemmed from an article published by Cipher in World Patent Information titled, Construction and Evaluation of Gold Standards. It aims to provide an objective and reliable way for both developers and users of patent classification software to better understand and test the accuracy of automated patent technology mapping. We were joined by the Managing Director at Patinformatics LLC, Tony Trippe, and our very own CTO, Steve Harris, who spoke about the Gold Standard for measuring the accuracy of machine learning and AI.

The webinar Measuring the accuracy of Machine Learning and AI for classifying patents? covered:

  • How a Gold Standard helps test the accuracy of machine learning
  • The approach to building a Gold Standard that can be trusted
  • Testing Cipher against the Gold Standard

To listen to the recording of the webinar and to get a copy of the slides used, fill out the form below.

Your speakers

  • Steve Harris, CTO, Cipher
  • Tony Trippe, Managing Director, Patinformatics LLC


Nigel Swycher, CEO, Cipher


Download webinar slides              Download the full Academic study

Insights & Events

Testing for accuracy using independently created Gold Standards

Cipher scores a 98% accuracy in an independently created test.
Read more

Beyond portfolio optimisation – calculating the value of rightsizing

View our webinar discussing results of the Cipher Report on Portfolio Optimisation and the optimisation model that can help you balance your portfolio.
Read more

Cipher Report on Portfolio Optimisation

Hear from Google, Accenture, Facebook and many other large patent owning organisations in the full Cipher report. Take a look at what the world’s patent owning organisations are saying about balanced portfolios and the various strategic objectives served by those portfolios.
Read more

With Cipher you can…

Portfolio Optimisation connecting cogs

Optimise your portfolio

Ensure you have the right portfolio to meet your strategic patenting objectives.

Read more
Competitive Intelligence

Gather competitor intelligence

Understand who’s doing what by automating patent to technology mapping.

Read more
Cross Licensing

Model cross licensing

Combine patent and revenue data to determine rational licensing outcomes.

Read more

Manage your budget

Justify patent budgets and communicate the impact of your investment.

Read more

Conduct due diligence

Automate manual reviews for efficient execution of M&A and licensing transactions.

Read more

Tackle inbound patent assertion

Be prepared with evidence to create a fast and effective threat assessment.

Read more

Benchmark your portfolio

Assess your portfolio in comparison to other owners through your technology lens.

Read more

Monetise your portfolio

Identify opportunities to create value through licensing or sale of patent assets.

Read more
Technology Trends icon

Predict technology trends

Track new technologies and discover the unknown owners of future innovation.

Read more
Icon of a meter

Create Risk Mitigation Strategies

Understand the materiality of your threats to define your risk mitigation strategy.

Read more

Improve your patent strategy now

Speak to the Cipher team today.

Arrange a callback