Define Exact Match (EM) vs. F1 Score in the context of an extraction task (e.g., extracting dates from a PDF). When should you use EM?

How do you programmatically check if an LLM is making things up that aren't in the provided search results?

How would you automate the process of trying to make your model "break" or "hallucinate"?

You’ve updated your system prompt to fix a specific bug. How do you ensure this "fix" didn't break 10 other things the model was previously doing correctly?