Hey, Joe what authentication option should I choose for my copilot to perform this automated testing as I have troubles doing it using Microsoft Entra ID authentication and without authentication, should it be the manual one? thanks
Joe, great walkthrough. i can see this being extended as a GH Actions or AzDO ci/cd workflow. Any thoughts on how we would test Generative Answers with PVATestFramework?
It’s open source in GitHub so we can contribute to it, I was thinking about this, you’re not going to be able to check for a 1-2-1 match as the generated text will always be different. I’ve considered doing something like ‘contains()’ to see if the generative text contains context as a validation for at least some sort of confidence.
