Bring your experience
Tell us what you know about your work or community, and where you think AI could be useful.
You know your work. You know your community. That knowledge should help shape the tools we build.
We’re exploring a language model shaped by people across the Commonwealth. Tell us what would be useful, bring your experience, or help test whether AI gets it right.
No technical background needed. Start by telling us about yourself; evaluation work comes later.
A useful model needs people who understand the problems, the examples, and the consequences of getting an answer wrong.
Tell us what you know about your work or community, and where you think AI could be useful.
Let us know if you could judge answers, discuss an example dataset, or help develop useful tests.
Follow the project, help others learn, contribute technical skills, or explore a partnership for your organization.
Joining the effort and developing an evaluation are separate stages. The first conversation helps us decide where and how you might contribute.
Share your background, interests, and the kind of help you could offer. KOS reviews the intake and discusses a suitable next step with you.
Outcome: an agreed role or next conversation.
Start with the intakeAfter that review, contributors work with KOS on tasks, examples, expected answers, and scoring. Larger evaluations may be developed and run outside the website in an agreed workspace.
Outcome: an evaluation ready for review, with approved records considered for PanAtlas.
Continue to evaluation planningWe’re starting by listening. The model’s design and evaluation priorities will need to grow from clearly described needs.
Register your interestSign in and tell us how you would like to contribute. Track your intake decision, agreed role, and evaluation progress through your account.
KOS reviews each intake and agrees on a contribution with the participant. Approved contributors can develop an evaluation, share a summary for review, and see the next steps here. Project updates will describe decisions and verified results as the work develops.
Sign in with ORCID to connect your intake, approval, and evaluation progress. Then add a contact email where KOS can reach you.