At what stage of the evaluation pipeline is a human absolutely necessary, and where can they be replaced by an automated "Judge LLM"?

You’ve updated your system prompt to fix a specific bug. How do you ensure this "fix" didn't break 10 other things the model was previously doing correctly?

How do you measure "Time to First Token" (TTFT) vs. "Total Runtime"? Which one matters more for user experience in a chatbot?

If you are using an LLM to grade another LLM, why is it critical to provide a "multi-point rubric" rather than just asking "Is this answer good?"