핵심 요약
데스크톱 에이전트가 사람 감시 없이 30분 넘게 돌아갈 수 있게 됐는데, 프롬프트가 애매하면 에이전트가 뇌절 치다가 토큰이랑 시간만 날리기 딱 좋다. 장시간 작업을 제대로 끝마치게 하려면 기대하는 결과물의 기준과 명확한 종료 조건을 프롬프트에 꽂아줘야 함.
주요 포인트
- ChatGPT(Codex)나 Claude Co-work 같은 데스크톱 에이전트는 이제 감시 없이 30분 넘게 스스로 작업 수행이 가능함.
- 실행 시간이 길어질수록 프롬프트가 모호할 때 발생하는 멋대로의 가정과 탈선 리스크가 커지고 비용도 팍팍 늘어남.
- "요약본이 마음에 들 때까지 계속해라" 같은 애매한 지시는 에이전트가 언제 멈출지 몰라 토큰만 무한으로 태우는 지름길임.
- 에이전트가 뻘짓 안 하게 막으려면 '좋은 요약'의 기준, 위험 요소의 정의, 구체적인 완료 경계를 확실하게 설정해 둬야 함.
Desktop agents like ChatGPT via Codex and Claude Co-work can now run for 30 minutes or more without you having to watch them. If you're new here, I'm Dylan. I run an AI consultancy. And lately, many of my coaching sessions are around helping people get these long agent runs under control. But here's the catch. The longer it runs, the more a vague prompt actually costs you. And the AI agent either quits too early or it never knows when to stop, burning tokens and time. So, I'll show you why agents lose the thread and four things to lock them down before you ever hit go. So, let's get into it. Now, the reason I want to bring this up now is a lot of people that I work with are starting to venture off into the world of desktop agents. So, they're getting access to things like Codex or Claude Co-work. And these sophisticated models and really advanced tools, when applied to a hard task, can work for a long time. So, what you're likely used to is when you work with Claude or ChatGPT, you give it a question or a task, it goes off and does the task, and then it comes back and gives you a response. Within this loop, you can provide feedback continuously. You can stop it when you need to and you can redirect it. But when you have a tool like a desktop agent and you apply it to a really hard task that has many steps or many files the AI has to process, it's going to go off and it's going to do work for potentially 30 minutes, an hour, maybe even two to three hours. And when it's doing that task, there are a lot of assumptions it has to make. It has to fill in a lot of gaps. And that's sometimes beneficial, but it also can backfire on us. And one other thing to consider is the AI doesn't necessarily know when to stop often times. So, it'll go continuously until it feels it's done. And as you can see from this, there's a lot of things that can go wrong. And that's what I want to share with you today. We need to put guardrails around the AI so when it works on that long task, it knows how to go in the direction we care about. And also, it knows when to stop when we think it's done. Let me first show you the wrong way to do this. So, this here on the left-hand side looks like a prompt that's pretty strong. So, we're asking the AI to review the vendor contracts in this folder and create a summary of the biggest risks. Keep going until the summary is good. Now, at the surface, this seems okay, especially if it's a smaller task. But, if in this folder, what if there are 100, 200, 300, maybe 500 contracts that AI has to review? Well, that means it's going to process it for more than an hour. And there's a lot that's left unsaid in this prompt that needs to be covered, such as what does a good summary actually look like? What counts as a risk? How do you even define something as good and when to finish? And a variety of other things. We need to have some sort of explicit boundaries so that AI understands our expectations of what good looks like and how to get there. And the beautiful part about all of this is the AI can actually assist us in the process of creating these boundaries. We don't necessarily have to do it ourselves from scratch. And that's what this prompt's going to do for you. So, you can copy and paste this prompt, use it for yourself. The only thing that you need to update in this prompt are going to be these pink sections here. Quick pause in your regular programming. This video is brought to you by me, as always. So, two quick things. First off, below is a 30-day AI insight series, completely free. You'll get 30 insights in your inbox of how you can apply AI to your business and your work. The second thing is if you'd like to work with me, below are a series of offerings to see if there's good fit between the two of us. So, what is this prompt saying? Well, at the very top, we're simply telling the AI that we want to plan for a task that we're going to run in the future. And I need its help to design a specific plan for this task to ensure it goes in the right direction. I then give it three things. So, the first thing we're doing here is we're being very specific on the task. We're telling the AI exactly what we want to do. And here you want to be as specific as possible on the task and the outcome of the task. After you've explained the task, then you put in your inputs. So, the inputs could be folders you're sharing with the AI. It could be different systems AI is connecting to through data connectors and a variety of other things. You want to share those and let the AI know that it has access to them. Then finally, we want to share the output. And this is going to be key. We want to tell it not just where the information should go. So, should it go in a certain subfolder or if there's a certain tab you need to update, but we also need to show it what good looks like. So we need to say this is the expected output from you. Once we've shared those three things, we're then going to ask the AI to interview us