0:00
There will never be a time like this.
Search this video
0:01
I've never seen anything like it.
0:01
I doubt I'll ever feel anything like this in business again where there's unlimited demand.
0:05
How do you make sure that three months from now, six months from now, you have like no regrets.
0:08
Get on the plane to go talk to a customer.
0:12
Make the late night push.
0:12
Check the data six times over again.
0:15
>> Your company creates new data to continue advancing the intelligence of models.
0:20
This is a business that you built on top of a business you've already had.
0:24
>> We're the largest expert network in the world.
0:26
But we have this massive strategic advantage which is like no customer acquisition costs.
0:29
The only mo in human data is access to an audience.
0:33
You guys come in after the models train to tweak the weights based on additional data that you've created.
0:38
>> The models have gotten so good that the generalists are no longer needed.
0:40
What they really need is experts.
0:44
>> There's this tension between all these students training models to become smarter and then there's that they will have harder time potentially finding jobs.
0:52
>> That's not what we're hearing from our employers.
0:53
This is just enabling human beings to be even more productive.
0:55
You used to put like Google search on as a skill on your resume because you like grew up at Google being like AI native.
1:02
Young people are at a huge advantage.
1:05
Today my guest is Garrett Lord.
1:05
Garrett is the co-founder and CEO of Handshake, which is one of the most interesting and incredible AI success stories that you probably haven't heard of.
1:14
Handshake has been around for over 10 years.
1:16
They're essentially LinkedIn for college students.
1:20
It's a place for students to connect with companies to find a job.
1:24
They are the platform of choice for every single Fortune 500 company.
1:25
Over 1500 colleges, over 20 million students and alumni, and over 1 million companies use them to hire graduates.
1:32
At the start of this year, Garrett and his team realized that their huge proprietary network of students, including tens of thousands of PhDs and master students, is extremely valuable to AI labs to help them create and label highquality training data.
1:47
So, they launched a new business from 0 to 1 in January.
1:49
Four months later, they hit 50 million ARR.
1:54
They're now on pace to blow past 100 million ARR within just 12 months.
1:58
They'll exceed the revenue that they're making with their decade old business in under 2 years.
2:03
This is a truly incredible and rare story and one that I think a lot of teams can learn from because AI is creating a lot of opportunity, but also a lot of potential disruption.
2:13
And this is an amazing story where the company basically disrupted themselves.
2:17
This episode is packed with insights, including a primer on what the heck are people actually doing when they're labeling and creating data to train models.
2:24
A huge thank you to Garrett for making time for this.
2:26
His wife just had a baby this week.
2:28
He's also in the middle of scaling this insane new business. So, thank you, Garrett.
2:33
If you enjoy this podcast, don't forget to subscribe and follow it in your favorite podcasting app or YouTube.
2:38
Also, if you become an annual subscriber of my newsletter, you get a year free of a bunch of incredible products, including lovable, replet, bold, nad, linear, superhuman, dscript, whisperflow, gamma, perplexity, warp, granola, magic patterns, raycast, chatp, and mobin.
2:54
Check it out at lennisnewsletter. com and click bundle.
2:58
With that, I bring you Garrett Lord.
3:01
This episode is brought to you by Code Rabbit, the AI code review platform transforming how engineering teams ship faster with AI without sacrificing code quality.
3:10
Code reviews are critical but timeconuming.
3:13
Code Rabbit acts as your AI co-pilot, providing instant code review comments and potential impacts of every pull request.
3:20
Beyond just flagging issues, Code Rabbit provides one-click fix suggestions and lets you define custom code quality rules using a GP patterns, catching subtle issues that traditional static analysis tools might miss.
3:33
Code Rabbit also provides free AI code reviews directly in the IDE.
3:36
It's available in VS Code, Cursor, and Windsurf.
3:40
Code Rabbit has so far reviewed more than 10 million PRs installed on 1 million repositories and is used by over 70,000 open-source projects.
3:49
Get Code Rabbit for free for an entire year at code rabbit. ai using code Lenny. That's codeabrabbit. ai.
3:58
This episode is brought to you by Orcus, the company behind open-source Conductor, the orchestration platform powering modern enterprise apps and agentic workflows.
4:06
Legacy automation tools can't keep pace.
4:08
Siloed low code platforms, outdated process management, and disconnected API tooling fall short in today's event-driven AI powered agentic landscape. Orcus changes this.
4:20
With Orcus conductor, you gain an agentic orchestration layer that seamlessly connects humans, AI agents, APIs, microservices, and data pipelines in real time at enterprise scale.
4:28
Visual and codeforce development, built-in compliance, observability, and rock solid reliability ensure workflows evolve dynamically with your needs.
4:36
It's not just about automating tasks.
4:38
It's orchestrating autonomous agents and complex workflows to deliver smarter outcomes faster.
4:44
Whether modernizing legacy systems or scaling nextgen AIdriven apps, Orcus accelerates your journey from idea to production.
4:51
Learn more and start building at orcus. io/lenny. That's o ke. io/lenny.
5:04
Garrett, thank you so much for being here. Welcome to the podcast.
5:07
>> Yeah, thanks for having me. A longtime subscriber. >> I appreciate that.
5:09
Okay, so before we get into the insane trajectory that your data labeling business is on, which is just an amazing story that I think a lot of founders and product teams that are trying to navigate this AI disruption that's happening will have a lot to learn from.
5:25
I want to first help people understand what the hell data labeling actually is.
5:29
Just like what are people actually doing? Why is this so valuable?
5:34
some of the most I don't know fastest growing companies in the world today including you guys are just are are this is what you do clearly there's something really important here I sort of understand it probably not really I think a lot of listeners feel the same way so let me just ask you this what is
5:48
data labeling actually like what are people actually doing and then just why is this so valuable to Frontier AI labs >> yeah so I I think it's helpful to take like a step back of like what what does training a model look like so there's really two primary functions There's a pre-training and a post-training process in training a model. And for a long
6:06
And for a long time, these AI providers or LLMs or frontier labs were focused on basically sucking up more and more information on the pre-training side of the house.
6:16
And that's basically the entire corpus of like written human knowledge.
6:19
So that's not just written, but like every YouTube video, every book, basically, you know, the pursuit of sucking up everything that was on the internet.
6:28
That was the pre-training side.
6:29
And there was a lot of gains from pre-training like models continue to get better.
6:33
And about 18 months ago, 24 months ago, we started to really see like an asmtoing of gains coming from because they had essentially like sucked up all the knowledge on the internet.
6:44
And so labs really shifted towards most of the gains now coming from the post- training side of the house.
6:49
And what post training is is it's augmenting the and improving the data they have across every discipline or capability area that they care about.
6:58
So take coding or mathematics or law or finance.
7:04
You know they are focused on collecting high quality data that really improves the state-of-the-art capabilities of their models.
7:13
And you can see a lot of these popular benchmarks on on what are called model cards.
7:18
You know, when Llama 4 is released, you'll see like the benchmarks across various domains.
7:24
And each one of the research teams inside of the labs are have different use cases.
7:29
Basically, they're running experiments almost think like the scientific process.
7:34
They have like a hypothesis around how to improve the model.
7:36
They're trying to collect small pieces of data to see if that hypothesis works out.
7:40
If that hypothesis is proving true, then they expand the overall collection of the data in that effort.
7:47
Um, and it can it can look like reinforcement learning environments.
7:50
It can look like trajectories.
7:52
It could be audio and multimodal.
7:54
It can be text based like prompt response pairs.
7:56
Um, it can also be like reinforcement learning with human feedback which is like you know preference ranking data.
8:02
Um, and so that's the that's the state-of-the-art of models.
8:05
And most of the gains that are happening from models right now are are coming from the post training side of the house.
8:13
And there's just an an incredible amount of demand to stay at the absolute frontier of where models are going.
8:18
So training, pre-training is feeding it say the entire internet.
8:22
Here's like all the data that the humans have ever created.
8:27
Uh, figure out knowledge and facts and how to reason and all these things.
8:30
Post training, is it correct to say there's essentially two buckets of things to do?
8:35
There's reinforcement, learning, human feedback, RLHF, and then there's kind of this bucket of fine-tuning.
8:41
>> I mean, yeah, yes and no.
8:41
Because like like take for example like trajectories or like you want to be able to do people use flight search or like an accounting end process or you want to be able to like conduct biological like experiments like you need actual trajectory data like you you need to there's still very much a lot of the labs are still they have points of view on what they collect.
9:02
It's evolving very quickly.
9:02
But I think you know reinforcement learning is really like preference ranking right like which which question do you like more question A or question B.
9:10
Sept data is like a prompt and a response.
9:13
And obviously the labs are very focused on these like thinking or reasoning models.
9:20
So in order to improve a reasoning model you need to actually have like the step-by-step instructions of which when you interact with a lot of these frontier models they're you know they struggle in very advanced domains.
9:29
And so, you know, I I think there's a variety of datas that that they're working, you know, working with to improve capabilities in their models.
9:39
>> What I'm hearing is there's other ways to uh post train.
9:41
Which of these are you guys focused on?
9:44
Where do you help models?
9:45
Most of these three-ish buckets.
9:48
>> Our like real unique proposition as a business is the fact that we like have an engaged audience.
9:55
We have 18 million professionals uh across you know we have 500,000 PhDs we have 3 million master students we're a global platform and so you know depending on kind of what you're looking for across any area of academic knowledge you know what is the
10:14
definition of a PhD it's essentially to like be at the how do you get your how do you get your PhD you defend your thesis defending your thesis means generally speaking like you have proven that you have extended the the world's knowledge in a particular domain. And so the ability to
10:26
And so the ability to like hyperarget this audience into chemistry, math, physics, biology, coding, and really touch parts of human knowledge that have never before made it to the internet is really where we we excel.
10:43
And I would say that when you talk about the labeling market, something to to make it more abstract is like it used to be generalist work.
10:49
Like a lot of the market before the model started to get better was leveraging talented international lowercost labor to do basic generalist tasks.
11:00
But really what's happened is the models have gotten so good that the generalists are no longer needed.
11:06
Like what they really need is experts.
11:09
experts across every area that the models are focused on.
11:13
And and really, you could think about these model model builders as they're focused on like the most economically valuable capability areas in the economy, right? Right.
11:26
And so that generally speaking right now is focused on you know advanced STEM domains, advanced science and math domains and then the kind of derivative functions of like accounting, law, medicine, finance uh where they want to make the models more capable.
11:40
Um and then the work that we're doing I think to come full circle to your question like we're doing work across across so many domains.
11:47
I mean we have we have millions of bachelor students that are being used for work in like audio work in customizing a model depending on the voice and tone where you are geographically in the country.
12:01
Uh what do women versus men prefer all the way to the most advanced PhDs down domains out there. >> Okay.
12:08
So is it fair to say essentially all the data that is available has been trained on and your company procreates new data new knowledge to continue advancing the intelligence of models. >> Yeah.
12:22
And I also say we help point out where the models are weak.
12:26
>> So in order to break a model, you know, it's pretty tough for the average person to break a model and get an incorrect response.
12:33
But if you're a PhD in physics, like you can go in in multiple kind of subdomains of physics and prove where the model's actually breaking either breaking in its reasoning steps or it's where it's broken in its ground truth right answer or you start throwing tools in there or needing to, you know, follow some step-by-step process and it's it's it's uh I wouldn't say it's easy for them, but the average person cannot break the models.
12:59
Uh and that's where we really come in.
13:01
So essentially it's just like catching mistakes that the model has made. Um okay.
13:05
So what are these people actually doing? What is it?
13:10
I know there's all kinds of different types.
13:11
You described all the ways that data is generated.
13:13
What kind of data is useful?
13:15
So maybe just like the most common examples like let's say a PhD person is sitting there doing stuff.
13:21
What are they actually doing?
13:21
A great example is a public paper called like GPQA.
13:25
So for the engineers out there that want to read about it like essentially the the crux of the paper is you break the model you provide a ground truth the right answer to the question you provide the stepby-step reasoning steps.
13:41
So you know you can you might imagine like because models are nondeterministic like the model can get the answer right once but it might not get the answer right you know three out of five times.
13:49
So you actually prove where the model's failing.
13:51
You actually break down into like where is it failing.
13:55
You know, maybe it can get the it knows the question, but it can get the right answer, but the actual steps to get there are wrong.
14:00
And they're really focused on like the steps to get there.
14:03
Say there's like 10 steps in a math problem, right?
14:04
Like step six through 10 is wrong.
14:07
And so like how do you fix the actual steps?
14:09
Um and uh what are they doing?
14:13
So they're going in, we put them, you know, we're really focused on calling this like a branding experience and treating people like experts.
14:20
Like PhD students expect to be treated different than lowerc cost international labor with a different work expectation.
14:27
And so these PhDs come into a community.
14:29
We have a instructional design team and an assessments team that's going through and basically iteratively helping them understand how to use the tools that we built and how to interact with the latest models.
14:41
Then they go in and start actually creating data and that you know that process is on our side the model builders they want to know that the data we're producing is high quality.
14:49
So we have our own research team our own post training team.
14:52
I hired a a gentleman from meta that wanted a lot of a lot of the post training over there named hope you paid him well. >> Yeah.
14:59
So war for AI talent is uh very expensive but super super privileged and proud to be working with him.
15:04
And so you know each unit of data you we have to build an environment for them to actually create the data.
15:09
Then we have to understand at a at a in a unit level we're trying to approximate the actual gain from that piece of data and whether it can improve in a particular capability area.
15:18
Uh and then we're also focused on you know evolving the use cases to also follow what the modelers want which is they want more they they want more real world tool use and trajectory based data as well.
15:31
Okay, there's so much here and like we could go infinitely down here, but I think this is really interesting because just like people hear so much about all of this and they barely understand what the hell it actually is.
15:40
So this is for me really interesting and I think it's going to help a lot of people.
15:43
So essentially a PhD say a biologist biology PhD is just their job is find flaws in what say Chad GBT is producing and then come up with here's the correct answer and that is used to fine-tune the model.
15:58
here's like here's something you're doing incorrectly, here's the correct answer and that improves the model.
16:03
Is that a simple way to think about it?
16:04
Please correct anything I'm saying that is incorrect because I don't want people to misunderstand it.
16:08
>> I mean like um a great example, let's take like a nonverifiable domain like education.
16:14
>> So there's like a PhD student uh Rachel on the network.
16:16
She got her PhD from the University of Miami.
16:19
spent two decades as a teacher teaching students in the eighth grade and she was an adjunct professor at a local community college uh in the field of education and so she is interacting with the state-of-the-art models in educational design.
16:34
So actually trying to understand what is the best way to teach people and like how do you frame the how do you how do you spot incorrect issues in a model and the way that they're like training people and help the models understand the forefront of educational design with the hands-on experience of being an eighth grade teacher for 10 plus years and having a PhD in education.
16:58
So that's an example of like you know you can have that all the way down to like a verifiable engineering problem that you're seeing the latest you know you know seeing the latest models fail on.
17:10
So you have yeah I think that gives you a you know the gamut.
17:13
You also have you know we talk about professional domains like these reinforcement learning environments like you know there's a bunch of papers out there that basically speak to like people narrating over their stepbystep tool use.
17:25
So as they go to solve a problem from start to finish, interact with multiple different service areas, interact with multiple different tools, you know, they're like, you know, there's papers that talk about this, but like, you know, talking over what they're doing, actually following and screen recording where their mouse is going, how they're problem solving, when they run into a roadblock, what do they do?
17:47
So they really want to understand how humans think.
17:50
>> You mentioned this term trajectory.
17:50
Can you just explain what that actually means?
17:53
Because it feels like you've mentioned that a few times and that feels important to all this.
17:55
A trajectory is basically just like the entire environment that is collecting what you're doing.
18:00
Um, so it's your screen, it's your mouse. >> Yep.
18:05
>> Including this voiceover. Okay.
18:05
And then this might be too technical, but what is the output of all this work?
18:09
This say teacher, is it just like a JSON file, an XML file, like a text file? >> Yep. Think about JSON data. >> JSON data. Okay.
18:17
>> JSON data. Okay. And then you also have like multimodal work like audio like classifying music and understanding we're engaging like thousands or not thousands like probably hundreds of uh top music students at you know the weed music schools in the country who are
18:37
improving models understanding of music and they also have the thing called which we haven't talked about here like a rubrics and a rubric like models are you can you can put a model in as a judge like you you can if you what is a good what is a good educational design
18:53
or what's a good MRI result and instead of having some of these in some of these domains you actually don't have a a guaranteed correct right answer and so models can sit in the middle as a judge and actually understand you know what is you know kind of like think back on your school days like what
19:12
how do you get an A on your 5,000word paper well there's like a great introductory statement and their scientific proof, you know, like so you can build a rubric that allows a model to sit in the middle and actually like auto evaluate responses. We're seeing a
19:23
We're seeing a lot of rubrics work as well.
19:28
>> And you would think like why would you trust this one teacher's opinion that this is the right way to do it, but what's cool is the market speaks for itself.
19:35
If these models are being used more and more and people love them and value them, I imagine there's steps in between to verify this is good and other people think this is a good idea.
19:44
There's it feels like the market dynamics will tell you if the data you're providing is correct and what people want.
19:49
Is there something more there?
19:51
you know, I didn't get a PhD in in AI or math or physics and I haven't trained myself via the frontier mouse, but you know, there is a lot to each unit of data whether it's improving if you know there's a ton of science and research out right now around like how do you make sure that the data that you're producing is improving the model and it's very hard for modelers to understand, you know, they they really care about to to zoom out.
20:19
They care about three things.
20:20
They care about like quality first and foremost.
20:22
You have to have high quality data.
20:24
And if you you imagine you're training a model like teaching the student and you're giving it the wrong data, it's extremely you know challenging to overcome that.
20:31
So quality is first and foremost.
20:33
And then the other huge problems you have is like volume like how how do you generate thousands of pieces of data in the most advanced domains of chemistry and mathematics and physics and how do you ensure that it's high quality?
20:47
Well, for us, like say in physics, we just reach out to students at Stanford and Berkeley and MIT and like they're the top GPA the at the best physics schools in the country.
20:58
And so our ability to get to scale or volumes of data with to produce very high quality data is is something they care deeply about.
21:06
And then the other thing I'd say model builders care about is speed because they have all these hypotheses and they're constantly testing different pipelines.
21:11
And so you might have like three or four bats going at once.
21:15
And then as soon as one is actually showing a gain, imagine you're a researcher or you know your scientific process, one's showing a gain, then you're trying to grow that pipeline and grow that piece of data that's actually improving it.
21:26
And you're maybe ditching two or three other projects you had that weren't showing improvement.
21:29
So your ability to quickly turn around for them in in a period of days and then get to high volumes of data that are high quality is the number one thing they care about.
21:41
And so there's quite a bit of technology we built on our side to assess each unit of data.
21:45
We have our own post-training teams.
21:47
We're renting our own GPUs and we're trying to make sure that we can sit directly with these researchers and help share like what we're seeing with the data that we're creating and how how it could improve their model, how they could best train with it.
22:00
Um, so hopefully that helps.
22:02
Going back to the types of post-training, just because I think this might be helpful, at least for me, the mental model of there's pre-training, there's post- training.
22:09
Within post- trainining, there's uh reinforcement learning, human feedback, there's kind of this concept of fine-tuning.
22:14
Uh there's also evalu uh supervised fine-tuning.
22:26
Uh yes, we're doing preference rank.
22:30
I mean, we're kind of doing all the above.
22:31
Uh we don't do the auto eval.
22:33
We we produce rubrics which are used in auto evals. Um yeah. Okay. Awesome.
22:39
So essentially there's a model, it's trained on all this amazing data.
22:44
Uh you guys come in after the model's trained to tweak the weights based on additional data that you create.
22:51
What's interesting is that this is a scalable system.
22:54
I I want to talk about just like the supply of amazing people that you have producing this, but it's amazing that humans can do this.
23:03
Like you would think it needs to be this infinitely scalable thing, but like humans sitting there adding creating data is working in improving the intelligence of models significantly. >> Oh yeah.
23:13
I mean I think like maybe a funny joke it's like all the MBAs think this is all just like going to go away.
23:19
It's like and I think for as long as models are improving humans will be needed in this process.
23:23
And when you talk to the lead scientists and researchers at these labs, it's like the data types will evolve and what they're trying to capture and collect, but you know there will be there'll be humans needed in this space for the next decade until we reach like full ASI.
23:38
So yeah, it's I mean you think about like you you know a lot of the models struggle to do basic trajectories right now.
23:47
So you know right now people are very focused on academic domains and I think they'll continue to be focused on academic academic domains but there'll also be you know far far more demand for professional domains as well across basically every every trajectory or step-by-step kind of problem that a knowledge worker solves in the workplace.
24:09
You know it's the pursuit of these labs to make sure that they're trying to collect the data to help add as much value in that process for humans as possible.
24:16
So let me ask about this.
24:18
There's this tension I imagine people might feel between uh all these students training models to become smarter and smarter and smarter and then there's the they will have harder time potentially finding jobs if models are so smart that people at entry level uh aren't being hired as much.
24:36
How do you think about just that tension?
24:38
Do you think this is a real problem or not?
24:39
Where do you think this goes?
24:42
>> I'm brought in the camp of like GDP growth over like universal basic income.
24:46
Like I I like very much like believe that this is going to improve and accelerate every human's ability to like create an impact in the economy in the world and that you know we're hearing from there's like a million companies that use Handshake.
24:58
Like we have 100 100% of the Fortune 500 uses Handshake.
25:04
So we we basically power the vast majority of how young people find jobs.
25:08
And a lot of people are kind of hyperbolic at saying that all young people won't have jobs.
25:11
And like that's not what we're hearing from our employers.
25:13
What we're hearing is like pick like social media marketing.
25:15
Like before you needed like somebody that could do Photoshop and take pictures and both created videos and you needed somebody that understood like marketing analytics platforms to track, you know, you're posting on different social media forms.
25:28
It's like now one person, one like young talented AI native Iron Man suit enabled young person can get on and like they can build their own videos, produce their own creative assets, post across multiple social media platforms, run all of their own analytics.
25:42
They don't need a data science degree to be able to do that.
25:46
And that's an examp or like take an intern in our company like he had his first PR up like I think like the afternoon he started, right?
25:52
Like you were a PM like you realize how how challenged that would have been historically.
25:57
your dev environment set up and like figure out where to add value.
26:00
He just took a bug and and squashed it.
26:01
And so I'm really a believer this is just like enabling human beings to be even more productive and create more impact.
26:07
And yeah, like of course like like hundreds of millions of jobs will become you know the jobs will evolve like people will come displaced they'll have to upskill and reskill.
26:17
And I think Handshake has a huge role to play in in in helping uh knowledge workers evolve.
26:22
This has come up a couple times, this point that I think is really good that uh younger people coming out of school are actually going to be much more likely to be successful because they're kind of growing up with these tools and are much more native to all these advanced tools and so they just come in as beasts just doing so much more.
26:42
>> Do you remember do you remember when like I mean I a little bit predates me but like you used to put like Google search on as like a skill on your resume, right?
26:50
Like you were the only person you were like good at Google, right?
26:53
because you like grew up with Google.
26:54
It's like I think being like AI native and having your Iron Man suit on and understanding how to leverage these tools is like uh young people are at a huge advantage. >> Yeah.
27:03
Especially if they're involved in training these models.
27:05
I imagine there's some other cool advantage there. >> Yeah.
27:09
>> Well, I mean just to hit on that like what we're getting from like our thousands of fellows is like they're in the classroom.
27:15
They're actually producing research.
27:16
Like we're talking about, you know, PhDs at the top institutions of the country and like they they can make like$1red $150, $200 an hour in their area in their field of expertise. It's pretty sweet.
27:28
Like you can make like 25 bucks an hour being a teacher assistant or you can actually make $150 an hour breaking the latest models.
27:36
And like you're learning what we're hearing from our our fellows is like they're bringing a lot of those insights into the classroom to help them be more effective at teaching.
27:43
More importantly, they're they're starting to learn how to leverage these tools to actually advance their area of research.
27:49
So, they believe that these tools can help them advance their area of research by helping them be more effective with their time.
27:54
And so, uh it is quite cool to get kind of paid to learn a skill.
27:58
Before I get to the story of how this all emerged because that is an incredible story.
28:02
Is there anything else about this whole field of labeling of reinforcement learning uh that you think people just kind of don't fully understand or you think that is really important?
28:12
There's just like so much happening.
28:13
Like I said, some of the fastest growing companies in the world are in the space.
28:16
Scale was just like acquired for I don't know 30 like sort of acquired for $30 billion.
28:19
Uh just like what else is there if there's anything that you think people need to understand?
28:25
Generally speaking, like anytime that you're interacting with a model and you're asking it to do really advanced things and it's not performing your expectations, like somewhere there's probably an expert that is, you know, the top mind in that domain working directly for the best researchers in the world at the frontier labs trying to understand and go through this scientific iteration process of how to make that better.
28:53
And that the assumption there is that like they already have the entirety of human knowledge that's written and recorded.
29:00
And so you know for as long as there are problems in solving any problem with AI you know that any human problem there will need to be humans in the loop helping advance that and like models don't generalize.
29:11
I mean there obviously the field will advance a lot and the type of data they'll collect a lot will will evolve a lot but it's it's pretty exciting at the frontier.
29:18
Kevin Wheel was on the podcast, the CPO at uh OpenAI. Yeah.
29:24
>> And he he made this point that really stuck with me that the model of today is the worst model you will ever use. >> I love that line. >> Will only get better.
29:30
Just just boggles the mind.
29:32
And now we know why these are getting better because all the work you guys are doing.
29:35
Uh just one quick question on this whole scale thing.
29:37
I guess they were like I don't know the main company doing this.
29:40
Now they're swallowed up and Alex is running super intelligence and meta.
29:44
intelligence and meta. Are they still like a big player in this labeling space or are they kind of out of it and and that's >> includes the whole scale team out of respect and for what what they built um there's many great companies operating in the space I think to the core of your question it's like uh I think if you
30:02
were building the most if you viewed your research team and your model building team and the experiments they're running to be you know really the cornerstone of how you're improving you probably wouldn't want the latest research of what you're trying to work on being, you know, being invested in by by a peer. I mean, that's
30:22
I mean, that's just generally what we hear in the space.
30:25
Uh, and so we have seen a uh an incredible search and demand um and are I think extraordinarily well positioned.
30:34
We we like to say like the only the only moat in human data is access to an audience.
30:38
Basically, there are, you know, many many small players in the space.
30:42
uh some mid-size players in the space and they're basically, you know, running Tik Tok ads, running Instagram ads, paying money for Google search display ads, YouTube ads, and uh they will be like, can you get me 200 physics PhDs? They what do they do?
30:56
They only can do one thing.
30:59
They're like, you know, they have 100 recruiters on staff.
31:02
They all get on LinkedIn. They all send messages.
31:04
They spend a couple million bucks on performance advertising campaigns.
31:07
campaigns. somebody's scrolling their Instagram feed that's a physics PhD of which you can't target them that well and they like see you know come train a model it's like I've never heard of this brand before the huge advantage that we've had and why we've resonated so fast the marketplace is like we built a decade of trust with you know 18 million
31:26
people and they trust us and and we built a ton of brand affinity and they use Handshake and they have an active profile and we have a ton of information around their academic performance and what they've done in school and so we're able to really target people really effectively and get to scale and volume of high quality data faster than anyone else. And I think that competitive
31:43
And I think that competitive advantage of access to an audience is really resonating in the marketplace.
31:49
Today's episode is brought to you by Anthropic, the team behind Claude.
31:50
I use Claude at least 10 times a day.
31:53
I use it for researching my podcast guest, for brainstorming title ideas for both my podcast and my newsletter, for getting feedback on my writing and all kinds of stuff.
32:04
Just last week, I was preparing for an interview with a very fancy guest, and I had Claude tell me, "What are all the questions that other podcast hosts have asked this guest so that I don't ask them these questions?"
32:14
How much time do you spend every week trying to synthesize all of your user research insights, support tickets, sales calls, experiment results, and competitive intel?
32:24
Claude can handle incredibly complex multi-step work.
32:27
You can throw a 100page strategy document at it and ask it for insights.
32:32
Or you can dump all your user research and ask it to find patterns.
32:35
With Cloud 4 and the new integrations, including Cloud4 Opus, the world's best coding model, you get voice conversations, advanced research capabilities, direct Google Workspace integration, and now MCP connections to your custom tools and data sources.
32:50
Claude just becomes part of your workflow.
32:52
If you want to try it out, get started at claude. ai/lenny.
32:56
And using this link, you get an incredible 50% off your first 3 months of the pro plan. That's claude. ai/lenny.
33:06
Okay, this is an awesome segue to where I wanted to go, which is just how how this business emerged.
33:10
This is a business that you built on top of a business you've already had.
33:14
From what I understand, you were at like $150 million in revenue.
33:17
You've been at this for a long time.
33:19
you found this opportunity and now that I, you know, looking back it's like obviously this is an amazing idea. Labs need data.
33:25
You guys have this supply of incredible experts. What an opportunity.
33:29
Talk about just how you first realized this was something that you could be doing and should be doing and then how you started to kind of execute down this path.
33:38
to kind of execute down this path. Yeah, I I think it's been a pretty natural extension from like helping people jump start, restart, or start their career like you know monetizing their skills and in this new employment ecosystem is
33:52
going to look very different in the future and we wanted you know to to zoom into like how we discovered it's like we because we have such a large access to this audience and as the world shifted from generalists to experts, we're the largest expert network in the world. We
34:06
We have, you know, more PhDs, 500,000 of them use Handshake than any other platform.
34:13
We have three million master students who are, you know, in school alumni.
34:17
And so we started to see all the what I would call like middleman companies reaching out to us saying, can we recruit your PhDs and master students?
34:28
And like any great marketplace, you know, we started sending them to these different platforms and started to really realize that, you know, from hearing from our users that like the experience was really frustrating.
34:36
Like training was very transactional.
34:38
The payments were, you know, there was very amorphous how you could get paid like there was immense amount of drop off in the process to actual project like completion on these other platforms.
34:49
completion on these other platforms. So we started to we started to think the company was you know making tens of millions of dollars from uh helping these other platforms and we started to realize like we you know what really kicked it off was like hearing also from the frontier labs like they started to
35:04
reach out to us and sort of go direct and trying to like almost kind of cut out the middleman and we started to realize well you know we could really serve our fellows our PhDs our experts we could treat them we we just believe there's like there will need to be a platform an expert experts first platform in the pursuit of ASI and
35:23
advancing AI and there will need to be a place that everyone in the world could go to to monetize their skills and their knowledge as these labs are focused on improving in these you know in all these multi-disiplinary outcomes and yeah we we entered the business in really like I started doing it over like Christmas and New Year's like that's
35:46
when I started like flying around my family kind of thought it was a little wild that I was like on on planes trying to chase different leaders, but we we built an incredible team of people that came from the human data world and really started building out our platform in January and then started really monetizing the relationships about 5 months ago. Uh fast forward to today,
36:05
Uh fast forward to today, we're working with seven of the frontier labs.
36:10
Basically, every lab that's doing that's that's doing work in building the best large language models.
36:16
and the team has exploded and revenue exploded and it's been it's been really a incredible ride kind of like running back a new company inside of a company for the second time over again.
36:28
>> And just to share some numbers, tell me if this is correct or if you're sharing these, but uh I heard that you hit $50 million in revenue just four months into this.
36:36
Today we're at 8 months in and you're on track to hit $und00 million in revenue uh in the first year.
36:42
>> I think we'll blow through that number, but yeah. >> Okay. Incredible.
36:44
Uh, and I didn't even know there were seven Frontier Labs.
36:49
That's >> zero to 50 is pretty good in four months, I think.
36:52
>> Uh, zero to 50 million in four months. That's something.
36:54
It's like the bar has been shifting constantly.
36:56
Like, you know, a year ago that'd be legendary.
37:01
Now it's like, all right, well, another one of these.
37:02
50 million in four months. No big deal. Uh, it's truly insane.
37:08
>> Just to zoom out one second for people to that don't know a ton about Handshake, the original business. What was that like?
37:14
What was actually this network that you had that you sat on top of?
37:18
>> Yeah, that that network does about 200 million.
37:19
This will do about 200 million. Yeah.
37:22
>> So that's we have like 600ish like super passionate teammates that work on on the core business which is you know I I would separate these out like these aren't two businesses.
37:31
I think it's like it's one business but uh that what is that business?
37:35
Um it's the if you're a young person in America that's graduated in the last five six seven eight years you probably have Handshake on your phone.
37:43
you like definitely know what handshake is.
37:44
It's like a it's a verb with young people in America.
37:46
It's a verb with people that like are in college in their PhD or masters, you know, program.
37:52
And it is I call it like an unconnected graph.
37:54
Uh meaning like you don't need to, you know, LinkedIn's very focused on like who you know and like what your experiences.
38:01
The first question on LinkedIn is like what's your job?
38:04
And a lot of young people start off like they've never had a job before, right?
38:07
They don't they don't have like 500 connections to add to their to their to their graph.
38:11
Whereas on Handshake, you start off like trying to discover and explore and figure out how to navigate through a school and figure out, oh, I'm an engineer, maybe I want to be a PM, maybe I want to work at a startup, maybe I want to work at a larger company, like what are the pros and cons?
38:24
You want to learn from near peers and young alumni.
38:26
And so Handshake's this I I call like a very like social platform with like groups and messaging and profiles and short form video and a feed all focus on your interests and helping pro really like build your confidence in your early career to find your first job, your second job and to manage you know kind of 18 to 30 I would say.
38:49
>> And how long have that has that business been around?
38:51
>> It's been around 10 years. >> 10 years. Okay.
38:52
So it's just like again it just feels like such holy you guys are in the right place in the right time with the right network that is extremely valuable now.
39:00
Uh what an interesting story feel like feel like it's just another interesting example of you've been doing something for a long time and then all of a sudden AI is just like opens up a whole new way of leveraging something that you have been doing for a long time.
39:14
It makes me think a little better about uh Bolt and Stack Blitz which was building for seven years this like browserbased uh OS where you could run an OS in the browser and they're like I don't know no one needs this.
39:26
Why are we what are we doing?
39:26
And then all of a sudden AI and they're like oh what if we build AI apps in the browser and just generate products for you with with AI and now it's I don't know one of the fastest growing companies in the world. >> Yeah. >> So interesting.
39:37
And so I think this is just an interesting time for people to think about what have we done that may give us a new opportunity to build something huge based on this unfair advantage that we have.
39:49
>> I think also like as your company grows in size and headcount and maturity, it's also like hard to like incubate something new inside of a business.
39:56
Like it's hard to, you know, it's hard in so many ways, right?
40:02
like the way that you build 0ero to one and find product market fit and scale a team very quickly and is very different than the way that you run a a more mature business that has been around for 10 years with hundreds and hundreds and hundreds of people.
40:17
Um so I've really had a ton of fun and and been it's been found a ton of passion in like running it back again for the second time inside the business.
40:28
And then yeah, we have this massive strategic advantage which is like no customer acquisition costs and we have like much higher conversion rates and retention than like any of the other platforms by a large margin because we have such consumer affinity.
40:40
There's actually two threads here I want to follow.
40:44
I'm going to follow the second one first.
40:45
Uh this idea of where this data labeling work can come from.
40:49
This isn't a really clear simple understandable one which is just experts sitting there creating data.
40:55
Another one that I know a lot of other uh companies in the space use scale.
41:00
I know especially is just like lowc cost labor internationally.
41:03
Um are there other methods for doing this that isn't one of those two?
41:08
How are other companies doing this?
41:10
I think if you like care about building a really high quality business and having like good gross margin and like high quality growth like you know the the the ecosystem here is like one of the leading players has like they have like 200 recruiters.
41:25
>> It's like unsustainable.
41:25
They're like 200 people on LinkedIn sending individual messages to acquire these people because there's no brand. There's no trust.
41:32
They spend, you know, they're spending tens of millions of dollars a month on performance advertising, Google ads >> to find experts and to find folks.
41:39
And it's experts mostly at this point. >> Yeah.
41:43
And then they put them onto an experience that like is treating them like they're drawing like boundary boxes around stop signs in the Philippines.
41:51
like you know the the frontier tax accountants don't want to be treated like lowcost international labor right and I I don't I mean I I don't think anyone enjoys that process and so you know the ability to build a experience that's rooted in community that's rooted in like high quality training like if
42:09
you're getting your PhD at MIT chances are you're just not being taught well enough on how to use the tools not you can't break the models it's just like you know the other platforms you know they're spending thousands of dollars to acquire individual user and they're put right into a project with no training. So, we just started from day one at
42:24
So, we just started from day one at building like this expert.
42:26
We believe there'd be a deep network effect here that's very connected to our core business of starting, jumparting or restarting your career.
42:32
And like, you know, you come in, you build a profile, you see the community, there's, you know, groups and a feed of here's how people are learning.
42:41
Like, you come into actual individual cohort with like peers that that look like you and have your similar backgrounds.
42:47
You're being taught on how to interact.
42:49
And there's like a trial and error and it's we have an instructional design key how to do it.
42:54
Then you're put on the projects where we're building like you know there's certain swim lanes where we're actually pre-building data and selling that data to all the labs.
43:02
So we could do this thing where you know we produce one unit of data ourselves.
43:06
We pay for it almost like a movie production.
43:08
We pay for a unit of data and then we you know we make sure it's very high quality.
43:13
We we run our own post training on it and then we produce a bunch of specifications of the data and we actually sell that individual package of data to like many different labs and so that you get put on a project like that.
43:24
Once you're doing a really really good job on our projects often times then we'll put you on customer projects where you know we they only want the best of the best people in you know machine learning right and then they go from our projects to their projects.
43:37
Uh and so you know there's a huge customer acquisition.
43:39
there's a huge customer acquisition. I mean it's a basic you know you love going deep on your podcast so just to talk about it it's like you know you really have a couple things that matter you have a c cost of customer acquisition right your CAC and you have your LTV like the lifetime value of a
43:52
user and an LTV is calculated pretty simply in this business like it is based on the retention of a person and how many projects they can participate in so if you treat people really well you train them really well right like well a we have no customer acquisition cost because we partner with 1600 universities power 92% of the top 500 schools in the country. We power almost
44:12
We power almost every institution and community college in the country.
44:16
We have no customer acquisition cost to acquire the people.
44:19
We have ton of brand and trust with them built up.
44:21
So they convert at ind you know really really high rates and then if you treat them really well and because that's what they expect from us like they know handshake their school buys handshake like we we need to treat we we care about treating these people well but like the universities would not tolerate our partnership with these with these fellows unless we treated them well.
44:41
So you put them into this process where our LTVs and repeat engagement rate and retention rate on different projects is is really high.
44:48
And so these structural advantages are quite significant when you contrast like a leading provider that has like 200 individual contributing recruiters and are spending tens of millions of dollars a month on performance marketing, you know.
45:03
So that's I think why we've seen so much success.
45:07
>> That's extremely interesting.
45:07
>> That's extremely interesting. And it feels like as you said there used to be a big focus on generalists which is people anywhere in the world for low cost can do the work like draw bounding boxes around things and it and essentially the market has shifted from
45:23
lowcost generalists to experts and a lot of these companies like scale were optimizing for general work model training data and you guys are set up to be extremely good at expertbased data And so you're in the right place at the right time with the right supply. Uh Uh what a business. >> Yeah. >> Nice work.
45:44
>> Not I would say it's not been easy building business two inside of business one.
45:47
But >> so let me actually Yeah.
45:48
So let me follow that thread.
45:49
That's where I wanted to go. What was just that like?
45:52
So you started noticing that model companies were coming to your people that people were having hard times with some of these other companies in this space and you're like oh maybe we should be doing this sort of thing.
46:02
How did that just like initial inception start and how did you start to explore that idea and to see if it was a real thing >> tactically?
46:09
Um, you know, we were working with many of the middleman companies doing work.
46:13
We started to see the demand as I talked about earlier.
46:15
We we started to see direct outreach from the frontier labs reaching out to us trying to cut out the middleman in their pursuit of getting higher quality data.
46:26
When we started to put together the dots on we we could build a way better experience for our fellows.
46:31
We could serve them directly to the labs and build a direct customer relationship with the labs and basically cut out the middleman and provide a better experience to the labs, provide a better experience to our fellows and provide a better experience long term to our like our million companies in the network and uh you know and the and and you might you might think about just like upskilling and reskilling what's going to happen there.
46:54
So we want to enter the space.
46:55
We started in, you know, really December exploring and learning more about it.
46:59
Um, like expert calls and hammering down, you know, I hired like three expert firms, alpha in the alpha sites and like GLG and started doing a bunch of calls with the latest researchers because we had resources.
47:14
Like one of the cool things about being a larger company is like we we have financial, you know, our core business is $200 million AR.
47:19
So it's like you know we we we had resources to be able to like accelerate the learning curve here.
47:24
Uh and then we started working with the arguably like the number one lab about 5 months ago. I wonder who that is. >> Yeah.
47:35
Um yeah wonder who it is but with Ben get different answers.
47:38
uh working with the number one lab and uh and and have just you know now we're working with Z on the frontier labs and uh the number one thing we're trying to do is just focus on like scaling up.
47:49
I mean we've gone from four or five people working on this to 75 plus people working on it.
47:55
Uh we're trying to I think we had like 12 people start last Monday.
47:59
It's like we are, you know, we are so bottlenecked on just meeting this opportunity because in this market there's there's essentially like unlimited demand.
48:10
Like if you can produce high quality volumes of data, uh you most likely will be able to sell whatever you produce.
48:17
Um and so on our side, it's like we're really focused on making sure that we pick the right longer term strategy.
48:25
uh making sure that we don't grow too fast as to erode the trust that we've built up with these frontier labs. Yeah.
48:32
But it uh you know it's it's been it's been fun.
48:38
>> You said it's also been really hard to start those business within an existing business.
48:42
What has been what's been hard? What's been hardest?
48:44
You touched on a couple of these elements already, but what else?
48:48
I think I just kind of followed a lot more of my intuition around this doing this.
48:56
I mean the story of Handshake was we had to sign up 1600 universities.
49:00
So I had to learn how to be like the best we are the fastest growing higher education company in like history.
49:06
So we signed up 1600 schools.
49:09
Then we had to build an employer business where you know we had to figure out how to sell the 100% you know 70 you know all these for companies use it and like 70% of it pay for I had to learn about like up market sales to like Goldman Sachs and General Motors and Google and the biggest companies in the world which is totally different than selling universities.
49:26
And then we had to learn how to build like an incredible student like kind of social network like what is the what does the best feed look like?
49:32
What does group messaging look like you know?
49:34
So we had I felt a little bit of familiarity and there's like kind of zero to ones often times like marketplaces are like many zero to ones.
49:42
Sometimes I dream that we just like I actually don't dream but I make a joke that like I just wish we were like a cyber security company and we had like one buyer and just like one product and it was just like you know we had to in in a marketplace you have to serve three
49:53
different sides you know from your time at Airbnb and so one of my learnings in spinning up these three different businesses in starting Handshake was like you know you I was pretty hands-on so like you know everyone reported directly to me. I really did not try to
50:07
I really did not try to be like I I really said in a lot of meetings like I'm not trying to be the boss.
50:13
I'm just trying to be like another smart guy in the room.
50:14
Like I hired I was just we've hired an incredible team of people that have have spent a lot of time in the space and have been big leaders at a lot of the human data companies in the space.
50:26
And so everyone saw very clearly the structural advantages that we had and a lot of the focus was on making sure that we could deliver high-quality data to one customer before we expanded anyone else.
50:41
Like we just you had to say no to a lot of things.
50:43
And then you also had a lot of people in the core part of the business that rightfully so like there's just checks and balances that there's a lot of people that like try to get involved, right?
50:53
involved, right? Like everyone wants to say not everyone this is a stretch but you know it's easy to say no right it's easy to be like I I can't prioritize that this week or this month I have an existing set of priorities so you know I
51:08
essentially with the exception of a few things like everyone just came straight into this new orc that I built everyone did not have any responsibilities in the existing part of the business it was extremely clear who was like the directly responsible individual tool
51:24
across each area of the new co and now we've got deeper coupling and integration points across the rest of the business but like we sat in a separate part of the office you know we you know everyone's in the office 5 days a week a lot of weekends there's a
51:39
totally different expectation in hiring talent too where it's like hey this is a this is a 247 job right like this is an early stage company we the compensation was also different too and based on like hurdles in this new business so people felt like owners creating the new code. And yeah, it's
51:53
And yeah, it's like it's still extremely nimble, very, very flat.
52:01
You know, just because you want run one function doesn't mean you're the directly responsible individual on a project.
52:06
We pick the best person who's most capable of driving an initiative forward, regardless of the function to be the DRRi.
52:13
We're a lot more metrics oriented.
52:17
You know, when I when I built Handshake, we we we resisted this like operating cadence for a long time, like this weekly, monthly, quarterly operating cadence.
52:25
With Handshake AI, we've we've been way more focused on like operating with data and metrics and rigor from an early stage.
52:32
There's a gentleman named Sahill on our team who's been doing an incredible job with that. Shout out Sahil. Shout out Young. Shout out Paco. Um, yeah.
52:42
>> Okay, this is incredible.
52:42
So a few kind of elements of what allowed this to succeed within a decade old company.
52:46
And by the way, so you're at 200 million a year in revenue with the traditional business.
52:53
You're going to, as you said, blow past 100 million in the first year of this new business.
52:57
So it's wild that in the first couple years, if things continue to go this way, you'll exceed uh the size the run rate of a business that took you 10 years to build. Incredible.
53:09
To make this successful, a few of the things I noted as you were talking.
53:11
One is clearly you were just like in founder mode.
53:14
You were the CEO of this company.
53:17
You're like the lead of this new business.
53:18
You were taking you weren't delegating to someone.
53:20
Hey, go start this thing.
53:21
You dedicated people here.
53:24
We're going to pick people.
53:24
You have nothing else going on. This is your new job.
53:26
You're going to work on this this stuff.
53:27
You worked in different part of the office.
53:29
There's a different there's a metrics based cadence.
53:31
So, it's just like let's stay really diligent about here's how it's going.
53:35
Here's where we're going. Here's our track. Here's our KPIs. Things like that.
53:37
our KPIs. Things like that. anything else there that you felt really important to making this work because a lot of companies are going to try to do this I imagine and so I'm curious what else you found important to make this work >> yeah I mean I just really believe it's separate and everything like separate
53:52
engineering team separate design team separate accounts and operations team separate finance team like early on everything was separate people only had one job and one job only and that was making a guy successful we had a couple integration points more and I I have an incredible executive team on the core
54:10
part of the business and now there's becoming more and more involvement but like you know I the our executives that have built Handshake for a long time like ran the core business and I focused 80 plus% of my time and attention on just this and you know we hired an incredible engineering leader like Avery who you know we we focused on hiring a
54:32
lot of entre we have a lot of entrepreneurs people that have started companies inside the company or pardon me people that started companies before like that was huge huge uh a lot of familiarity with hiring talent that have like only worked at early stage companies before that feel super comfortable with ambiguity. Um we were
54:44
Um we were also like way more upfront around this is going to be chaotic like just like owning that narrative like in front of all hands at the core company owning it directly with the team.
54:55
We have a separate all hands.
54:57
We have separate onboarding.
54:59
We have a separate recruiting team like you know everyone was essentially you know I had some connection points but mostly separate and I think that was like absolutely critical.
55:10
We took some of the top people I mean we have great people in the core business.
55:14
We took some great people from the core business and and basically said sorry like I know you love your old team.
55:20
I know you love what you're doing like will you join us in hiki?
55:21
and they like completely forgo their historical responsibilities and came over.
55:25
That became really critical with engineering when things started to scale and topple and like you know we're growing so quickly.
55:31
We took some of our top senior engineers who are very entrepreneurial and principal engineers, staff level engineers like parachute them in and you know that that's been like it's been awesome to be able to like we have it's been awesome to like ask some of the most talented people in the core business like hey do you want to come over here and do this and sometimes they say no like they're like I don't want to work you know most of the weekends.
55:51
I don't want to be on the number of 2 am 3 am nights we've done in this business.
55:58
It's it's it's I mean it's quite regular like people sometimes don't want to commit to that but we've been up front like here here are the expectations for this team.
56:05
It's a it's a you know it's an insane pace.
56:08
If you want to be a part of one of the fastest growing you know businesses in Silicon Valley you can join it.
56:15
Um owner the ownership too has also been huge like owning this outcome and like we have we have this model like I'll leave nothing a chance like I always for a while there we like drew the number of days in the year on the whiteboard and it was like there will never be a time like this.
56:30
I've never seen anything like it.
56:32
I doubt I'll ever feel anything like this in business again where there's unlimited demand and it's just our ability to execute against it.
56:38
And so we had this motto like leave nothing to chance.
56:40
Like how do you how do you make sure that 3 months from now six months you have like no regrets.
56:46
Like get on the plane to go talk to a customer.
56:48
Like make the late night push.
56:51
Check the data six times over again.
56:53
Like ship the extra feature that helps.
56:56
And really a huge celebratory culture too like calling people out across. It's very flat, right?
57:01
So there's there really isn't this principle of you know the there's so many people putting up points like directly calling out the people that are putting up points and creating a really fun environment around impact.
57:10
I think it's been it's been awesome.
57:13
>> The leave nothing to chance piece I imagine speaks partly to the value of trust in what you're doing.
57:17
trust in what you're doing. people are gonna like you win if they can trust that your data is awesome and great and consistent and I could see why that ends up being such an important part of what you're building and like just listening to you describe this I understand like
57:30
it's there so it's obviously a massive opportunity obviously a massive uh advantage you guys have and just like the stress that comes with that burden also I imagine is very high of just like this is we can't screw this up cannot cannot you know it's handshake should be a business does billions of dollars revenue. It's a public company like it
57:51
It's a public company like it should we should be able to continue to I mean and it also helps our core business like the longer term opportunity that we see is it's connecting it's building the best job matching marketplace on the internet.
58:07
It's like, you know, it's probably one of the largest problems in the world, like labor supply matching.
58:15
Like, it's where people spend most of their time and energy, just hours of their life, they spend it at work.
58:21
The process of like searching for a job, applying to a job is going to be completely reinvented with AI.
58:28
We've been leading the charge there.
58:30
like you know an AI interviewer that's collecting skills and actually asking about your experiences doing work simulation experiences that like help employers find the best candidates. me.
58:42
I don't know the last time you've done this, but like the hiring manager process like reviewing 200 RS are you kidding me?
58:48
Like I'm going to sit there and review 200 RS like not a chance 5 years from now, right?
58:53
Like students manually making cover like not a chance, right?
58:58
So there will need to be a marketplace that wins in connecting you know supply and demand and you know talent with opportunity and we think and get psyched about like the opportunity for impact here. Like that's my story.
59:12
Like I went to community college, a pivary school.
59:13
I went to a no-name school in the upper peninsula of Michigan.
59:17
I worked at Palunteer as an intern.
59:19
It totally changed my life.
59:20
And like I started Handshake because I wanted to make it easier for like anyone regardless of who you knew, what your parents did, what school you went to to find a great opportunity.
59:30
And I think AI like totally step function improvement in matching.
59:38
And I think that our human data business is really serving as like the foundation for improving meshing.
59:42
Like a lot of things that we're doing in the human data business are being integrated to our core business.
59:47
I think that's going to improve outcomes for employers, save them, you know, in the aggregate like billions of dollars over time.
59:53
Uh and I think it makes the experience way better for students.
59:57
So it's uh it's just like we have to meet the moment like you know I we still have the stamina and the excitement and the passion internally in our core and in the new business to like go charge after this.
1:00:07
Uh and that's a lot of the message we've been sharing internally is like it's it's time to amp it up.
1:00:12
It's time to like this is a once in a lifetime opportunity to be positioned as well and like we're we we are going to meet the moment as a team. >> It really is.
1:00:19
This is very much feels like a once in a-lifetime opportunity.
1:00:24
Let me ask a few other questions along these lines that are something I've been thinking about, something that a lot of people think about just while I have you.
1:00:30
There's always this question of will we run out of data?
1:00:32
Will models stop advancing?
1:00:34
Are we going to hit some plateau?
1:00:35
And there's not actually going to be some AGI moment, SGI moment.
1:00:36
So, first of all, do you think we'll run out of data?
1:00:40
There's a point at which we just can't produce more knowledge and data to feed these models.
1:00:43
And kind of along those lines, what do you think is the biggest bottleneck to advancing models faster and further? >> Yeah.
1:00:50
I mean like it's just the type of data we're going to need is going to evolve.
1:00:53
It's going to be CAD files.
1:00:53
It's going to be you scientific tool use data as they trying to automate scientific discoveries and drug discovery.
1:01:04
It's going to you know it's going to be esoteric you know operating systems that exists on you know scientific tools.
1:01:11
It's going to be, you know, so I I love this like trajectory and like stitching together step-by-step instruction following like, you know, there will need the type of data we're going to need is going to evolve a lot.
1:01:25
>> And we haven't even talked about like multimodal and video and text and audio like audio is is is a huge demand for audio data right now.
1:01:36
So, the type of data is going to evolve.
1:01:38
>> Yeah, I use voice mode all the time.
1:01:39
That's my default chat dbt experience just talking to. >> It's amazing. It's amazing.
1:01:42
I just had a baby on we or my wife had a baby on Sunday and voice mode has been incredible.
1:01:48
I mean every night at you know every two hours his speed it's like I have more questions. Voice mode's been huge.
1:01:54
So I shout out voice mode and yeah so the type of data is going to collect a lot or change a lot.
1:01:58
Um I think synthetic data has a role to play in like in verifiable domains but like what we consistently hear from companies is like you know there synthetic data is not going to dominate like it's not going to be like there there there's an there's there's billions and billions and billions of dollars of value to uh extract as a company over the next decade and following the frontier of AI development.
1:02:23
Let me first say just huge kudos to you for uh just having a kid, your wife just having a kid a few days ago and building this business that is growing bananas and doing this podcast conversation.
1:02:34
I really appreciate you making time.
1:02:37
>> Is there anything else that we haven't covered that you think might be helpful for folks to hear or a part of your story that you think might be helpful folks to learn from or something you may want to just double down on that we've talked about before we get to a very exciting lightning round?
1:02:50
I mean, the thing I always love like talking I'm really passionate about like people starting companies and helping them do so.
1:02:57
And like I just think in this moment right now with AI like for young entrepreneurs that listen to read this podcast because I've been a reader since 2020.
1:03:05
We looked >> Yeah, we did check.
1:03:07
That's >> a long-term reader.
1:03:08
I'm just like so curious and love up your interviews.
1:03:12
But it's like you just focus on doing something like of meaning like that really helps people.
1:03:15
And I think with AI, there's like going to be so many opportunities to improve the way people learn like just, you know, I just really passionate about trying to make Handshake a platform that is not only, you know, incredible business, but it's also something that like really helps solve a societal problem that matters.
1:03:35
And uh yeah, it's my one one shot out here.
1:03:38
If anyone wants advice on how to do that or wants to reach out, I'm like happy to chat. Okay.
1:03:42
So, this is an offer to share advice on starting companies with an AI.
1:03:47
Is that is that the offer here?
1:03:48
Just folks, >> it'd be great. >> Okay.
1:03:50
I don't know how much time you have for the hundreds of thousands of people coming your way, but but I appreciate the offer. That's very cool.
1:03:57
Um, anything else before we get to a very exciting lightning round? >> No.
1:04:02
>> Well, with that, Garrett, we reached our very exciting lightning round.
1:04:03
I've got five questions for you. Are you ready? >> Ready.
1:04:07
>> What are two or three books that you find yourself recommending most to other people?
1:04:10
I'm uh I'm a sucker for Peter Thiel's 0ero to1.
1:04:13
I read it when I started the company and watched Peter Teal's like startup school class at Stanford.
1:04:19
He taught back in the days where there wasn't everything written on the internet about how to start companies and like just think he's was the coolest.
1:04:25
Um love love Shoe Dog like think that you know it's epitome of like starting a company.
1:04:32
Hard things about hard things obviously but these are these are all quite common books.
1:04:35
But uh also classics, Ben Harowitz is coming on the podcast.
1:04:40
Talk about hard things about hard things. >> Super cool.
1:04:43
>> The hard thing about hard things. Yeah. Okay.
1:04:44
Uh what have you seen a recent movie or TV show? You really enjoy it.
1:04:46
I imagine you don't have much time for this, but >> I'm going to get blasted for this, but I I did start Game of Thrones with my wife and I uh cannot >> for the first time. >> Yeah. >> Okay.
1:04:56
So, I got a lot of catching up to do.
1:04:59
>> Why would you get No, this is great.
1:05:00
That's like people that have watched it, >> you've loved it so far. Okay.
1:05:02
It's quite quite gruesome.
1:05:04
That's the only downside of that show.
1:05:06
Don't watch it before you go to bed.
1:05:08
I don't know how many gruesome scenes you've seen already.
1:05:12
>> Do you have a favorite product you've recently discovered that you really love?
1:05:14
>> Thene the baby automated.
1:05:19
It's like has uh really helped us a lot.
1:05:22
So, love the shout outnew team. >> Amazing. I had ane as well.
1:05:24
We never actually turned it on.
1:05:26
We just ended up using it as a bestin most time.
1:05:27
It's not turned on, but a couple cries it's been turned on. It's been very helpful.
1:05:31
M do you have a favorite life motto that you find yourself coming back to sharing with other people?
1:05:37
>> I love that like leave nothing a chance like leave it all out on the field you know >> grew up in uh you know like a really hardworking family and dad worked really hard to provide make it make it happen for us and it's like just give it your all leave nothing to chance. Okay. So last question.
1:05:52
And I've been I was researching you in prep for this podcast and there's a story that I love about your hustle early on is when you were you were going from campus to campus pitching uh schools to join Handshake and there's a story where you had to shower in the the Princeton's pool to save money because you just didn't have a place to stay.
1:06:09
Is there something there?
1:06:10
Is there a story there you could share?
1:06:12
>> Yeah, it was a tough one.
1:06:12
I I mean I almost got arrested at Princeton because I mean I guess for entrepreneurs that are traveling around all the time you you we were sleeping out of our car.
1:06:20
We had this like Ford Focus.
1:06:22
We would put 20 30,000 miles on it.
1:06:24
Sleep in the back of like McDonald's parking lots.
1:06:26
They're well lit and had good Wi-Fi back in the day.
1:06:31
And uh instead of staying in a hotel, way to freshen up ahead of your meeting is like every university has a pool and the pool's almost always it is always.
1:06:40
We never had a situation where it's always open for people to swim in the morning like fitness faculty, students and every pool what do they have? They have a shower.
1:06:48
So you could go to any pool at any university in the country and you can get a free shower and freshen up.
1:06:53
So the Princeton campus security did not appreciate me showering as a non- studentent.
1:06:59
But I think it meaningfully helped us because the Princeton campus security like called the career service center director we were selling to being like who's Garrett Lord?
1:07:08
Like is he really here to like pitch you software for your career center?
1:07:12
And uh it made the start of the meeting with the Chris Center like really stimulating and exciting because uh they were like you showered in our pool. You drove here?
1:07:20
Yeah, we drove here from Michigan.
1:07:22
You know, uh we like and so I think that uh showed a level of commitment that was exciting for them.
1:07:29
>> Fast forward to all these founders now starting to use this growth lever of getting in trouble with the campus police to get better meetings with the school school leaders. >> Incredible.
1:07:38
Garrett, this is such an insane, amazing, inspiring story.
1:07:39
Just like what you're building and the opportunity here and just how it's fast it's going and all the advantages you have.
1:07:48
Like if I was an investor in Handshake, I'd be like, "All right, 10 years. It's going great."
1:07:50
And now it's like, "Holy where did this come from?" >> Uh, incredible.
1:07:54
Uh, and it's just also really meaningful.
1:07:56
So, uh, I'm really, uh, happy that you made time for this in spite of the madness you are in right now. Two final questions.
1:08:03
Where can folks find you if they want to maybe reach out or maybe if you're hiring, let let us know.
1:08:08
And then how can listeners be useful to you?
1:08:12
>> I mean, sign up for Handshake.
1:08:12
Uh if you want to message me on there, it's the easiest way to to reach me.
1:08:15
Uh you just find me Garrett Lord Handshake.
1:08:17
And you find me on Twitter, love uh or love axe, huge uh hax guy.
1:08:22
Uh you can email me at garrettedjoinhandshake. com.
1:08:28
Um and rt and uh how can you be helpful?
1:08:32
Like we are trying to hire.
1:08:32
So many people uh we have offices in New York and in San Francisco, in London, in Berlin.
1:08:39
If you have friends that are maybe passionate about this, you want to know or you're interested in learning more, like please reach out.
1:08:44
We'd love to talk to you.
1:08:45
Uh hiring hiring is like the number one uh problem we have right now to meet the demand.
1:08:53
So, if you're talented and interested in learning more about Handshake, if you want to work on our consumer product, if you want to work on our employer product, cool PLG issues or the state-of-the-art consumer social experience, like reach out.
1:09:02
Or you want to work on the AI business, we'd love to talk to you.
1:09:06
>> To make it even more clear for folks, what roles are you most hiring for? Is it every role? Is it >> engineering? >> Engineering. All right.
1:09:12
If you're an engineer, want to join one of the best growing AI companies in the world right now. Here we go.
1:09:16
>> Uh, we'll link to your careers page in the show notes. >> Thank you. >> Yeah, of course.
1:09:19
Garrett, thank you so much for being here. This was incredible. Of course. Bye everyone.
1:09:26
Thank you so much for listening.
1:09:26
If you found this valuable, you can subscribe to the show on Apple Podcasts, Spotify, or your favorite podcast app.
1:09:31
Also, please consider giving us a rating or leaving a review as that really helps other listeners find the podcast.
1:09:38
You can find all past episodes or learn more about the show at lennispodcast. com.
1:09:45
See you in the next episode.