Announcing OpenTest.AI: A New Community for Testers in the Age of AI

Published on September 29, 2025
Early Vibe-coded OpenTest.AI Community Website

Software testing is at a turning point. AI-generated code is arriving faster than most organizations can comprehend, and with it comes an avalanche of new bugs, risks, and unknowns. Developers, ops teams, and even AI coding agents themselves are starting to move deeper into the testing space. If testers don’t organize, collaborate, and step up now, we risk losing our role in shaping the future of quality.

That’s why I’m excited to announce OpenTest.AI — a soon-to-launch website and community built by testers, for testers.

What is OpenTest.AI?

OpenTest.ai will be a collaborative hub where testers can:

  • Share prompts that are useful for testing AI systems, code, and applications
  • Propose new evaluation suites (evals) that measure how useful and reliable AI models really are
  • Exchange tips and patterns for working with AI in testing workflows
  • Online tools that help testers run evals against different AI models

Access utilities to improve their own artifacts — from bug reports to test plans to automated checks

It’s not just another forum. It’s a space where testers can build shared intelligence to tackle the unique challenges that AI has unleashed on software quality.

Who’s Behind It

The founding principal board members are:

Jason Arbon — CEO of Testers.ai and principal at IcebergQA. He brings decades of experience leading AI-first testing at Google, Microsoft, and beyond.

Jonathon Wright — Chief AI Officer at Keysight Technologies. Recognized global thought leader in test automation and AI.

Phil Lew — CEO, President of the Pacific Northwest Software Quality Conference, of XBOSOFT and IcebergQA, actively advancing the partnership between testers and AI.

Together, we’re kicking off OpenTest.ai to give testers a collective voice and platform as the testing landscape shifts beneath our feet.

Why the Urgency

AI coding agents aren’t just spitting out snippets anymore. They’re:

  • Compiling and running apps, testing basic functionality automatically
  • Suggesting tests for developers to run manually
  • Scaling code generation 10X, which means exponentially more buggy code is landing in production

And here’s the hard truth: AI-generated code has a different texture and new classes of bugs. Old testing methods can’t keep up.

This is where testers come in. The world’s software — from hospitals to financial systems to the phones in our kids’ hands — depends on us organizing, innovating, and wielding AI to defend quality.

How You Can Help Before Launch

We need your help to shape OpenTest.ai before we go live. Specifically:

  • Help us test the community website before launch
  • Contribute the first wave of community artifacts — prompts for testing, evaluation suites for AI models, and practical tips
  • Experiment with tools to run evals across different models and share your findings

By getting involved early, you’ll help set the tone and standards for this new community.

Community Features

To make participation fun and rewarding, we’re building:

  • Badges so you can showcase your contributions
  • Voting and comments so testers can rate and discuss community submissions
  • Points and leaderboards to highlight the top contributors driving the conversation forward
  • Community moderators to ensure content is free of hype, commercial-free, and truly useful for testers everywhere

We’ll lean on a few sponsors to donate time and money to keep the site running, but sponsorship mentions will be tucked quietly to the side. The focus will stay on open, practical, and valuable content.

A Call to Testers Everywhere

The code needs us.
The world needs us.

👉 Sign up now for early access: https://testersai.fillout.com/joinotai
(especially if you can help test the site or share early prompts, evals, and tips)

👉 Share this announcement with testers you know
👉 Bring your insights and artifacts to seed the community

Let’s ensure testers — not developers, ops, or AI agents — own the future of testing, and the world of software is high-quality.

More to come.

— Jason Arbon, President, OpenTest.AI