How to Evaluate AI-Generated Content: Lessons from a CEO's Commencement Speech

Overview

In May 2024, Delta Air Lines CEO Ed Bastian delivered a commencement address at Emory University that sparked a valuable lesson for anyone using artificial intelligence for writing. Bastian revealed that he had asked AI to draft his speech, was impressed by its speed and ease, but ultimately discarded it because it lacked soul, warmth, and his personal voice. He chose instead to write by hand, emphasizing authenticity over algorithmic efficiency. This guide uses Bastian's experience as a case study to teach you how to critically evaluate AI-generated content, decide when to use it, and ensure your work retains genuine human connection. Whether you're a student, professional, or content creator, these steps will help you harness AI's power without losing your unique voice.

Prerequisites

Before diving into the tutorial, ensure you have the following:

• Basic familiarity with AI writing tools (e.g., ChatGPT, Claude, Jasper) – you don't need to be an expert, but you should know how to generate text.
• A sample writing task (e.g., a speech, email, blog post, or report) that you intend to evaluate.
• Willingness to be honest with yourself about the tone and authenticity of your writing.
• Access to a text editor (digital or paper) for rewriting and personalizing content.

No advanced technical skills are required – just an open mind and a commitment to quality communication.

Step-by-Step Instructions

Step 1: Generate an AI Draft

Start by using an AI writing tool to produce a first draft of your content. For example, if you're writing a commencement speech, prompt the AI with: "Write a commencement address about integrity and persistence for graduating university students." As Bastian noted, AI can produce a coherent, grammatically correct draft in seconds. This initial output serves as a baseline for evaluation. Do not assume it's final – treat it as raw material.

Example prompt used by Bastian: "Prepare an address for Emory University's commencement." The result was quick and easy, but lacked personal touch.

Step 2: Evaluate for Soul and Warmth

Once you have the AI-generated text, read it aloud and ask yourself these questions:

• Does this sound like me? Does it reflect my experiences, values, and emotions?
• Is there genuine appreciation or empathy, or does it feel like generic platitudes?
• Would my audience connect with this on a human level, or does it feel like a machine wrote it?

Bastian noticed his AI draft lacked "soul nor warmth" and was not his "personal voice." He realized his genuine appreciation for the opportunity to share insights was missing. If you detect a lack of authenticity, proceed to Step 3. If it feels personal enough, you may still need to tweak it – but be cautious.

Step 3: Decide to Use or Discard

Based on your evaluation, make a conscious decision. Bastian chose to throw his AI speech away and turned to pencil and paper. You have three options:

1. Use as-is: Only if the content is perfectly aligned with your voice and purpose – rare for sensitive communications.
2. Edit heavily: Keep the structure but replace sections with your own anecdotes, humor, and emotions.
3. Discard entirely: Start from scratch using your own words, as Bastian did. This ensures maximum authenticity.

Bastian's decision to discard was met with applause from graduates who appreciated his honesty. Similarly, other speakers who promoted AI enthusiastically were booed (e.g., Gloria Caulfield at University of Central Florida). The key is to prioritize your audience's need for genuine connection over convenience.

Step 4: Rewrite Manually with Personal Voice

Whether you start from your own outline or heavily edit the AI draft, focus on injecting your unique voice. Use these techniques:

• Share personal stories: Bastian recounted his career journey from VP of finance to CEO, and mentioned tough decisions (like cutting snacks on flights).
• Use conversational language: Avoid jargon unless necessary. Write as you would speak to a trusted friend.
• Express genuine emotion: Acknowledge your audience's situation. Bastian addressed the turbulent job market reshaped by AI, offering empathy.
• Incorporate your values: He emphasized that a "good name" is the most important asset, saying "It's your brand."

When rewriting, use a pencil or digital tool – the medium matters less than the intention. The goal is to make every sentence reflect your personality and purpose.

Step 5: Test for Authenticity with a Small Audience

Before delivering your final version, share it with a trusted peer or a small group from your audience. Ask for feedback on whether it sounds like you and whether it moves them. This step prevents you from missing the mark. Bastian's final speech included lines like "Doing the right thing comes at a cost – but I always prefer to think of it as an investment." Such sentences carry weight because they are authentic and backed by experience.

If the feedback suggests the content still feels robotic, consider: return to Step 3 and increase personalization. Use this loop to refine until your voice shines through.

Common Mistakes

Mistake 1: Over-reliance on AI for Emotional Content

AI excels at data, structure, and neutral tone, but it struggles with empathy and personal narrative. Using AI for a eulogy, wedding toast, or commencement speech – content that demands humanity – often backfires. Bastian's experience shows that audiences can sense when a speech lacks soul, leading to disengagement or even booing (as with Caulfield's AI-centric address).

Mistake 2: Ignoring Your Own Voice

Even if you edit AI output, it's easy to keep its phrasing habits. You might end up with a hybrid that still feels robotic. To avoid this, rewrite entire sections in your own words, not just tweak a few sentences. Read everything aloud – if it doesn't sound like you, start over.

Mistake 3: Using AI for Critical Career Communications

Bastian noted that in his career, taking shortcuts (like the "easy button") never yields enduring results. Applying AI to applications, cover letters, or negotiation scripts can come across as insincere. Invest the time to write from scratch for high-stakes documents.

Mistake 4: Promising an "AI Revolution" Without Balance

Caulfield was booed for touting AI as the "next industrial revolution." Overhyping AI can alienate audiences who fear job displacement or value human touch. Instead, acknowledge AI's role but emphasize that personal integrity and effort remain irreplaceable. Bastian's balanced approach – using AI for curiosity but discarding it for authenticity – resonated with graduates.

Summary

This guide has walked you through evaluating AI-generated content using Ed Bastian's commencement speech as a real-world example. By generating a draft, checking for soul and warmth, deciding to discard or edit, rewriting with personal voice, and testing with a small audience, you can leverage AI's efficiency while preserving authenticity. Avoid common pitfalls like over-reliance on AI for emotional content, ignoring your voice, using it in critical communications, or overhyping the technology. Remember Bastian's lesson: your most important asset is your good name – and only you can protect it by choosing authenticity over convenience.