Workroom PlayTime 023: LLM comparison I

Published on July 2, 2025
Workroom PlayTime 023: LLM comparison I

We'll gather on Zoom / Miro, on Thursday 4 July at 4pm London time (local time for you) to play together with testing stuff.

Workroom PlayTime 023: LLM comparison I

We'll do the following exercise, where we compare several LLM's responses to the same prompt. We pick that prompt to be something in which we are already expert, so that we have something to judge against. We compare in several ways. I hope that the exercise will help use explore judgement.

LLM comparison – local knowledge
Compare LLM output – something obscure that you know well.
Workroom PlayTime 023: LLM comparison IWorkroom ProductionsJames Lyndsay
Workroom PlayTime 023: LLM comparison I

These exercises are for everyone, for free. Paying Subscribers get to play together every week. This week's is open to subscribers and friends: Subscribers will see joining info below. Pop your name on the Miro board if you're coming.

In other news:

Thank you for reading!

Cheers –

James

joining info and links below