← 대시보드로
2026-08-24
3개 영상
2026-08-25 06:02 생성
Everything Goldman Sachs Taught Me About AI (In 10 minutes)
Nate Herk 2026-08-24
Everything Goldman Sachs Taught Me About AI (In 10 minutes)
↗ 유튜브에서 보기

핵심 요약

골드만삭스 출신 분석가가 전하는 AI 활용 핵심 원칙 중 첫 번째 단계인 검증(Verify)에 관한 내용이다. AI가 그럴듯하게 내놓은 결과물과 실제 정답은 엄연히 다르므로, 프로세스 자체에 검증 단계를 구축하는 것이 필수적이다. 모델의 최종 답변이 틀리더라도 추론 과정을 분해해 활용할 수 있으며, 결국 AI 시스템의 성능은 기반 데이터의 품질에 달려 있다.

주요 포인트

  • **결과물 검증(Verify)의 필수성**: AI는 틀린 답변도 매우 완성도 높고 그럴듯하게 출력하므로 반드시 사실 여부를 재확인해야 한다.
  • **추론과 최종 출력의 분리**: 골드만삭스 CIO에 따르면, 모델의 최종 결론이 틀리더라도 문제를 분해하고 접근하는 추론 과정 자체에서 가치를 얻을 수 있다.
  • **데이터 품질이 핵심(Garbage In, Garbage Out)**: 정제되지 않은 지저분한 데이터를 AI에 넣으면 마법처럼 해결되는 것이 아니라 잘못된 답변만 더 빠르게 도출될 뿐이다.
  • **프로세스 내 검증 단계 내장**: AI에게 최종 답변 전 수치와 사실을 재점검하고 출처를 표기하도록 프롬프트나 파이프라인 수준에서 검증을 강제해야 한다.
So, I'm going to give you everything that I learned after working at Goldman Sachs, one of the biggest financial firms on the planet. These are principles I still follow to this day in everything that I do with AI. A company like this doesn't have the luxury of making mistakes, and one wrong data entry or hallucination can cost them millions of dollars, or even worse, their reputation. So, if one of the biggest and most trusted financial firms on the planet follows these principles, it's because they work. And even if you're not working at a big firm, these principles will completely change how you use AI and the results that you get out of AI. So today I'm going to share the five AI principles I learned from Goldman Sachs which I call vault and show you how to apply them to your AI projects. So let's get into it. Okay, so V is to verify the output. And just a reminder, this is the framework I created from the principles I learned while working there. And these principles apply whether you're using claude code, codecs, or whatever new tool comes out next month. So Verify, I think a lot of us, myself included, can get a little too comfortable with AI because it gives you something that looks finished and it will deliver it to you super confidently. It's formatted perfectly and it probably took about 30 seconds. But something that looks finished and something that's actually correct are obviously two very different things. So Marco Agenti, Goldman's CIO, has made this distinction between the reasoning of a model and its final output. Basically, the way a model breaks down and analyzes a problem can still be useful even when the final answer it gives you is wrong. So you can use the breakdown to get value from it, but you still need to verify the result. And this actually starts before the AI even generates an answer. So my role at Goldman was in business intelligence. And every business intelligence analyst in my role had to pass something called data school. We had to understand how data gets pulled in, how it gets cleaned, how it gets updated, and how you turn all of that into something that people can actually use to make a decision because every report, every dashboard, every automation, and now every AI system is only as good as the data that's actually powering it. And your company's data is probably one of the biggest advantages that it has because nobody else has that exact information. They don't have your customers, your sales history, your internal processes, your support tickets, all of that kind of stuff. It's gold. But if that data is outdated or duplicated or messy or just wrong, then plugging it into AI doesn't magically fix it. It just gives you the wrong answer faster. So when I use AI tools, I like to build verification directly into the processes. You could give the model a prompt like, "Hey, you know, before you give me the final answer, recheck every number and factual claim. Cite the source for each one and flag anything that you're not fully 100% confident about." And you don't have to manually verify every single word that it gives you. If you're creating a report, maybe there are only two or three numbers that could actually change the decision. So have the model site those numbers and then you can spot check them yourself. And obviously for higher stakes projects you can even build a separate AI reviewer or multiple you know like a team of AI agents that are just there to review. They'll check the first output before you see anything and then the whole system can iterate once again before you see anything. And that's an additional check. But important claims still need original sources, deterministic tests or human review. So verify the data going in, verify the important outputs coming out and build review into [music] the process. But once you can trust the inputs and the outputs, you still have to decide whether AI should be in the workflow at all. So moving on to a augment, which means augment don't replace. Now my full-time job at Goldman was basically building automations, reports, dashboards, and systems that made teams more efficient. [music] And across the teams I worked with, there were people doing some version of that work. None of this was some brand new AI initiative. You know, Goldman had been building automated data and risk systems for decades. and teams across the firm were doing this kind of work before the current wave of AI agents hit the market. Which means there were already a crazy amount of problems worth solving before anyone started talking about AI agents. There were manual reports being built that took hours. You know, data had to be moved between systems. Teams were waiting on information from other people. People would enter something incorrectly with a fat finger or skip a step or or two people would follow the same process in two slightly different ways. [music] Because at the end of the day, humans are inconsistent. We get tired. We miss steps. comm
100 Hours Testing Deepseek Harness vs. Claude Code. What You Need to Know.
Nate Herk 2026-08-24
100 Hours Testing Deepseek Harness vs. Claude Code. What You Need to Know.
↗ 유튜브에서 보기

핵심 요약

DeepSeek Harness는 오픈소스이자 무료로 제공되는 AI 에이전트 구동 프레임워크(하네스)다. Claude Code 같은 폐쇄형 하네스와 달리 내부 루프와 프롬프트 규칙까지 자유롭게 수정할 수 있는 높은 커스터마이징 자유도를 제공한다. 툴, 스킬, 샌드박스, 세션, 루프, UI 등 모든 핵심 기능이 플러그인 구조로 설계된 점이 가장 큰 특징이다.

주요 포인트

  • **새로운 오픈소스 에이전트 하네스**: Codex나 Claude Code처럼 모델을 실행하고 제어하는 프레임워크 역할을 하며, 오픈소스로 완전 무료 공개됨
  • **다양한 모델 확장성**: DeepSeek 기본 모델(V4 Flash/Pro 등) 외에도 GPT, Claude Opus, Kimi 등 원하는 다른 모델을 자유롭게 연결 가능
  • **폐쇄형 대비 높은 커스터마이징 자유도**: 내부 동작(프롬프트 규칙, 툴 호출, 에이전트 루프 등)을 수정할 수 없는 Claude Code와 달리 내부 구조까지 전면 수정 가능
  • **'모든 것이 플러그인' 아키텍처**: 단순한 스킬/MCP 연동을 넘어 도구, 세션, 샌드박스, 스토리지, 실행 루프, UI까지 전체가 플러그인 방식으로 모듈화되어 동작함
So, I've been using Deep Sea Carness for the past week now, and I found a lot of things that I really like about it, and a lot of things that I also don't really like about it. So, today I'm just going to give you guys my honest thoughts, break down what I've been using it for, how it feels, and I'm also going to be specifically talking about it in comparison with Cloud Code since I know that's on a lot of you guys' minds. So, let's not waste any time and just get straight into this video. Okay, I'm going to try to do this in about 60 seconds. If you've never heard of Deep Seek Harness, what is it? So, Deepseek has different models, right? We had a big Deepseek moment last year, Deepseek R1, and then we have like DeepSeek V4 Flash and Pro right now. Decent models, pretty cheap, but we have a harness now from Deepseek, which is open source, and it's free. So, as we know, we have something like Codeex, which is the harness, and the AI models that you can use inside Codeex natively are GBT 5.6 Soul, GBT 5.6 Luna, things like that. We have Cloud Code, which is a different harness, and the AI models we natively use inside of Cloud Code are Cloud Opus, Cloud Fable, things like that. And now we have a Deep Seek harness which has other AI models inside. I mean by natively we have the Deepseek models, but you can also add any of the other models. You can add Opus in there. You can add GBT in there. You can add Kimmy. You can add Meta if you're crazy enough to do it. You can add basically whatever you want in there. Now, yes, you can also do that with these harnesses as well, but they're not exactly like made for it or promoted as much. But also things like OpenClaw, that's an agent harness. Also something like Hermes Agent, that's an agent harness. So it's not groundbreaking new tech. It's just a new harness. But what's really cool about this one is because the harness is open source, we can like fully customize it. So with a closed source harness like Cloud Code, it has its basic kind of like prompting rules and it has its tool calls and it has its loops and it has its agentic harness that we can't touch. We can basically look at it like a car that we can sit in, we can drive it, we can change out the model of the engine, but we can't move things around. Whereas with our deep sea harness, the open source harness, we can switch out the seats. We can switch out the steering wheel. We can switch things out. We can change the way the agent actually behaves under the hood, which is pretty cool. And that's why a lot of people are freaking out because if you go back to the site, it literally says everything is a plugin. And so by that, they don't mean just like skills and like MCP servers. They mean every capability is a plug-in. Tools, skills, sessions, sandboxes, storage, loops, the UI. This is all a plug-in environment. And so I will just be honest about that real quick. In this video, I'm not going to be talking about plugins that I installed from other people or plugins that I've built because I wanted to see out of the box what this thing felt like. And I will say about plugins, be careful because if people are giving out all these open source plugins, you don't know what might be in there. So, be smart. Have Cloud Code or have Codex review the plugins before you ever install anything like that off the internet. Okay, so here are some of the things that I want to talk about today when it comes to our DeepC Carnis. So, the first thing is let me just open up the UI and just show you what it looks like real quick. So, it looks like a chatbot, right? It looks like kind of like the Chag app or whatever you might be familiar with. It's not going to be anything new or super confusing. You can have products on the left. You can manage your different sessions, things like that. Pretty normal stuff. And if you want to test this out, literally what I did is I gave the GitHub link to Codeex and I said, "Hey, help me set this up." It opens this up in a local host. So, this is completely local right now. And then you're pretty much all good. All you have to do from there is you're going to go to your settings. You're going to go to models and you're going to put in some sort of key. I put in an open router key which is why now I can choose between all of these different models that are available to me on open router. Unfortunately you can't by default use like a cloud subscription or a codec subscription. I have seen some plugins where people say that it works. I haven't myself tested it but if you are interested in that then definitely look into that. But default you're going to be charged here by token you know API billing. Anyways that's what it looks like. We'll look at some other stuff in this UI in a bit but let me just go back over here to this screen. Okay, so let's talk about output quality. This entirely depends on the model and the effort, of course. I mean, you have a harness, so that can do so much, but at the end of
Claude Just Changed Tax Season Forever
Nicholas Puru 2026-08-24
Claude Just Changed Tax Season Forever
↗ 유튜브에서 보기

핵심 요약

회계 법인을 위해 고객의 세무 서류를 접수 즉시 분석하고 전년도 데이터와 대조·검증하는 AI 에이전트 구축 사례다. 입력 실수로 인한 이상치나 잔액 불일치를 수초 만에 포착해 확인 메일 초안을 작성하며, 인간 검토자가 최종 승인하도록 설계되었다.

주요 포인트

  • **접수 즉시 자동 매핑 및 대조**: 세무 서류가 들어오는 즉시 워크북에 숫자를 정리하고 사람이 검토하기 전에 전년도 기록과 비교함
  • **주요 3대 이상치 감지**: 전년 대비 10배 이상 증가한 숫자(0 추가 입력 오류 등), 부적절한 음수, 은행 잔고 불일치를 자동 추적
  • **인간 승인 기반 발송 (Human-in-the-Loop)**: 클라이언트 확인 메일은 초안만 작성하며, 담당자의 최종 검토 및 승인 없이는 외부로 발송되지 않음
  • **90% 미만 신뢰도 시 플래그 지정**: AI가 임의로 추측하지 않고 신뢰도가 90% 미만인 항목은 즉각 사람에게 전달해 신고 오류를 방지
So, I just changed tax season forever. I just built an agent for an accounting firm that reads a client's tax organizer the second that it comes in. It maps every number into their workbook [music] and checks it against last year before human ever can look at it. So, I just fixed that the kind of mistake that shows up every single season. An [music] advertising expense entered at $12,000 when last year it was 1,200. That one extra zero was caught in seconds and it drafted a client an email asking to confirm the number. So, it's checking three things. Any number 10 times bigger than last year, a negative where there shouldn't be one, [music] and an ending cash balance that does not tie to the bank statement on file. And it never sends anything on its own. First, it'll draft and then from there a person will approve and nothing is leaving the building without somebody clicking send and approving. And it won't guess either. Anything under 90% confidence, it's going to stop and flag a human because a wrong guess in February is a wrong tax return in April. Comment need and I'll send you the entire step-by-step video.