2 Posts with "evals" Tag

Assembling your chatbot project team 2024-08-26

How many developers does it take to build a chatbot? Would you be surprised if I told you that developers are not the most important role on a chatbot project team? In this post we go through the who to the what, where the what is a chatbot project and the who is you!

Build a Lie Detector for your AI 2023-12-05

When a big organization or government is looking at using an AI system, trust is often on their minds. There’s a lot of talk about AI hallucination and lies- like this NY Times article saying GPT-4 hallucinates 3% of the time or this paper that shows GPT-4 can engage in insider trading and then lie about it. How can folks who work in AI build systems that big clients can trust?