AI Driven Test Automation with Playwright and Midscene

Let’s explore AI Driven test execution, with Midscene and OpenAI — and find out what is good, bad and uncertain, about the future of test automation

Check out the full blog post here: https://garyparker.dev/blog/playwright-ai-driven-test-automation

Introduction

There are quite a few AI solutions on the market, mostly are paid or require a subscription. I wanted to explore some open-source solutions — I stumbled across Midscene on GitHub and decided to trial it out. Auto-Playwright is also fairly popular and I’ll most likely explore that in the future as a comparison.

Why open-source? For me, I like the fact that you’re only paying for the OpenAI calls being made, there’s no additional charges. So you’re in full control of your spending and usage.

The tech.

• Midscene GithHub Repository
• Midscene Homepage
• Midscene Playwright Integration
• OpenAI

You can use the above resources to get started with Midscene, it supports integration with Playwright and Puppeteer.

You will also need an OpenAI API Key, and token credits. You can make a deposit in the billing section of your OpenAI settings.

AI Automation in action

Check out the full blog post here: https://garyparker.dev/blog/playwright-ai-driven-test-automation