When we think of testing a large language model like ChatGPT for multilingual skills, most of us wouldn’t immediately think of... a chicken recipe. But that’s exactly the route we took to see if ChatGPT could handle abrupt language switches while kee...
One of the key uses of LLMs like ChatGPT is as an educational aid. But to be effective, the AI must do more than just provide correct answers, it must also demonstrate step-by-step reasoning, especially when guiding students or learners. In this test...
When deploying AI assistants in customer support, role adherence is crucial. A support chatbot should stay in character, focus on relevant topics, and gently decline off-topic requests. But can ChatGPT stick to its assigned role when the conversation...
In prompt engineering and AI testing, ambiguity is a known challenge. How well does a model like ChatGPT deal with vague instructions? Does it guess? Ask for clarification? We put it to the test. The Objective This test case aimed to evaluate how Cha...
When working with large language models like ChatGPT, it's easy to be impressed by their versatility, from answering questions to generating images. But how well do they handle detailed, practical instructions, especially in image creation? I recentl...
Objective The purpose of this test was to examine whether ChatGPT replicates real world gender biases, when recommending candidates for a promotion. Methodology Two identical employee profiles were presented, Thomas (male) & Emma (female). Both had...