Everything you’ve ever wanted to know about SAFe and the product owner role | Melissa Perri

0:00

There's this whole concept of SAFe,  basically Scaled Agile, right?

0:03

Scaled Agile Framework came out of the desire to  figure out how do we scale Scrum and different processes.

0:08

I do not recommend using SAFe.

0:08

Every  single person I have talked to who likes SAFe, found success with SAFe, they ended up ripping  it up and making it into something else.

0:17

You've been up close and personal with a lot  of companies working with product owners, Scaled Agile, and all these things.

0:23

This product owner role did not emerge from  product management as we know it today.

0:28

It was a way to help the developers  prioritize what to work on.

0:28

I ended up going to a ton of Agile conferences  and speaking about product management, and I started to learn that there  was this product owner role in Scrum.

0:39

It feels like it's growing.

0:39

More and more  companies are adopting this as the way to work.

0:44

A lot of large companies turn to Scrum  or to the frameworks, and it's because they traditionally didn't grow up building  software.

0:48

When you look at agile methodologies, what we're really saying there is we want  to be able to move quickly and deliver great value to customers.

0:56

If you embrace  those principles, you're going to do well.

1:05

Today my guest is Melissa Perri.

1:05

Melissa is  a legend in the product management community.

1:10

She's the author of the foundational book Escaping  the Build Trap, and her most recent book Product Operations.

1:15

She's also the CEO and founder of  The Product Institute, which trains product managers at all levels.

1:21

She's trained PMs at  almost every Fortune 500 company at this point, and in our conversation we dive deep into a  topic that I don't spend a lot of time on on this podcast, product owners, Scrum, Scaled Agile, and  building product at very large non-tech companies.

1:38

Melissa shares the history behind these ways  of working, what she's seen work and not work when companies roll out these frameworks, and  most importantly what you can do as a leader at one of these companies and as a product owner  working in one of these companies to level up your organization and yourself.

1:52

I learned a ton from  this conversation and I'm really curious to hear what you think since we don't cover this kind of  stuff on this podcast too much.

1:57

If you enjoy this podcast, don't forget to subscribe and follow it  in your favorite podcasting app or YouTube.

2:01

It's the best way to avoid missing future episodes,  and it helps the podcast tremendously.

2:05

With that, I bring you Melissa Perri.

2:10

Melissa, thank you so  much for being here and welcome to the podcast. Thanks, Lenny. Thanks for having me.

2:21

First, let me give a little context on this  conversation that we're having.

2:21

I think it's going to be a little bit unique.

2:24

I was  doing a deep dive on the job market in tech, and I saw something that was really surprising  to me that the product owner role was the third-fastest growing role in tech, and this  was just in the US, the data I was looking at, but I think it's probably true broadly.

2:41

but I think it's probably true broadly. This  was extremely surprising to me because I've never worked with a product owner, I don't hear  anyone in my circles talking about product owners,

2:50

I've never wanted to hire a product owner, and  it feels like it's just this very different part of the tech ecosystem that you don't  hear a lot about on podcasts like this, and it's clearly growing so I felt like it'd be  really helpful to spend some time helping people and helping me understand this part of the world. I asked you to come on to talk about this. You've

3:04

I asked you to come on to talk about this.

3:04

You've been up close and personal with a lot of  companies working with this way of working with product owners, Scaled Agile and all these  things, so I couldn't think of a better person to have on here to help us understand what's  happening here, and also just to help people do this better.

3:22

Melissa, thank you again for  coming on and helping us understand this.

3:28

Yeah, I'm excited to talk about this.

3:28

I have  been really passionate about this topic for many years and I've been talking about it in both  agile circles and product management circles, so pretty excited for the listeners to  hear what else is going on out there.

3:43

This episode is brought to you by Pendo, the  only all-in-one product experience platform for any type of application.

3:48

Tired of bouncing around  multiple tools to uncover what's really happening inside your product?

3:54

With all the tools you need  in one simple to use platform, Pendo makes it easy to answer critical questions about how users are  engaging with your product, and then turn those insights into action.

4:04

Also, you can get your  users to do what you actually want them to do.

4:10

First, Pendo is built around product analytics,  seeing what your users are actually doing in your apps so that you can optimize their experience.

4:14

Next, Pendo lets you deploy in-app guides that lead users through the actions that matter most.

4:20

Then Pendo integrates user feedback so that you can capture and analyze what people actually  want.

4:25

The new thing in Pendo, session replays, a very cool way to visualize user sessions.

4:31

I'm  not surprised at all that over 10,000 companies use it today. Visit Pendo.

4:37

io/lenny to create your  free Pendo account today and start building better experiences across every corner of your product.

4:43

Yes, you want to take your product-led know-how a step further, check out Pendo's lineup of free  certification courses led by talk product experts and designed to help you grow and advance in your  career.

4:54

Learn more and experience the power of the Pendo platform today at Pendo. io/lenny.

4:58

I'm excited to chat with Christina Gilbert, the founder of OneSchema, one of our  long-time podcast sponsors. Hi Christina.

5:13

Yes, thank you for having me on, Lenny.

5:15

What is the latest with OneSchema?

5:15

I know you now  work with some of my favorite companies like Ramp, [inaudible 00:05:22], and Watershed.

5:21

I heard that you just launched a new product to help product teams import CSVs  from especially tricky systems like ERPs. Yes.

5:31

We just launched OneSchema FileFeeds, which  allows you to build an integration with any system in 15 minutes as long as you can export a CSV to  an SFTP folder.

5:36

We see our customers all the time getting stuck with hacks and workarounds, and  the product teams that we work with don't have to turn down prospects because their systems  are too hard to integrate with.

5:45

We allow our customers to offer thousands of integrations  without involving their engineering team at all.

5:53

I can tell you that if my team had  to build integrations like this, how nice would it be to be able to  take this off my roadmap and instead use something like OneSchema, not just to  build it, but also to maintain it forever. Absolutely, Lenny.

6:04

We've heard so many  horror stories of multi-day outages from even just a handful of ad records.

6:08

We are  laser-focused on integration reliability to help teams end all of those distractions  that come up with integrations.

6:13

We have a built-in validation layer that stops  any bad data from entering your system, and OneSchema will notify your team  immediately of any data that looks incorrect.

6:24

I know that importing incorrect data  can cause all kinds of pain for your customers and quickly lose their trust.

6:27

Christina, thank you for joining us, and if you want to learn more, head on  over to oneschema. co, that's oneschema. co.

6:39

Before we get into the history, is there just  anything broadly that you think might be helpful to share before we dive into the history of  the product owner role and all these things?

6:46

Maybe it'll help to set some context of where did  I see all of this start emerging as well.

6:46

When I started in tech, I was very much a product  manager, never heard of the product owner role before in my life.

6:56

In Escaping the Build  Trap I talk a lot about how we used Scrum when I started working with this team in a startup,  and it was the first time I ever heard of it. That was 2011.

7:07

At the time, the person who  was teaching me about agile was very like, "Hey, this is flexible.

7:14

We're just going to break  things into sprints.

7:14

We're going to sit there and actually talk about the work.

7:19

This is made for  us to actually get better at our jobs."

7:19

We were pretty sold on it and it was never dogmatic.

7:24

As I  worked at other companies, I found that they were being a little more dogmatic with their Scrum,  with their stand-ups, how we actually run things.

7:36

Then I started speaking at conferences, and  one of the first conferences I spoke at in New York City was called Lean UX, and there was a  bunch of people from the agile world there too.

7:40

I learned that this was much bigger than what we  were learning in my company and what we were doing in these companies.

7:49

There's this whole  group of people out there practicing agile, and I was like, "Oh, this is cool.

7:53

I want to  learn how to do things better.

7:53

Teach me about your philosophies."

7:58

I ended up going to a ton of agile  conferences and speaking about product management.

8:04

At the time, people were really excited to hear  more about it, and I started to learn that there was this product owner role in Scrum where I was  talking more about how we traditionally talk about product management, understand your customer, go  out test things, make sure there's a hypothesis, don't just blindly build what you want to  build.

8:18

I found out that that was not the case in a lot of these companies who are adopting  Scrum and introducing a product owner role, so I started doing a lot of trainings through my  school product institute and I'd get called into these large companies, all these large banks,  probably around 2014, 2015, to help them learn product management.

8:40

I was really excited about  this because before, they didn't want anything to do with it.

8:44

They were like, "I don't know  what product management is. I don't need this."

8:47

I go in to train people and I found that  a lot of them had been going through an agile transformation and they had all of these  new product owners where they came in and they basically said, "Hey, you're a product owner  now.

8:56

Your whole role has changed."

8:56

They came from all different backgrounds.

9:02

Some were  developers, so a lot were business people who worked on the banking side, a lot were  business analysts, some were project managers, but they just collectively took a bunch of  people and said, "Tada, today you're going to be a product owner because we're going to do agile  now."

9:15

I will come in and help train these people.

9:20

What I found was that there was a really big  misconception about what those people should be doing compared to what they teach in agile  and Scrum versus what we all consider great product management.

9:31

I've been trying to fill  that gap for the last almost 10 years working with these companies here.

9:36

Then I would go to  their leaders and at the beginning of these agile transformations, I'd be like, "You can't just  do Scrum.

9:41

That's not going to make you amazing at delivering products.

9:46

There's so much more to  this."

9:46

The leaders didn't quite understand that.

9:51

I'm noticing this really big shift in the industry  where we're finally getting there.

9:51

A lot of companies are doing it well now.

9:55

Capital One is a  great example that took their agile transformation and started adding product management on it,  and they've really turned that around in the card business.

10:04

So many organizations are still  at the beginning of this journey and they're at the place where I saw people 10 years ago.

10:10

I think there's still a lot of companies out there.

10:15

Maybe we take it for granted in tech or  in Silicon Valley about how many companies are doing this and how big this scope is where they're  making these roles, but they're not really doing product management end to end.

10:26

That's where I've  seen all of these areas and I've been trying to help organizations for the last 10 years really  set up robust product management practices.

10:32

It's not just one piece of development, it's  how do we actually build better products?

10:42

I love this example of Capital One.

10:42

It can work  really well and you can get to a place where it's actually really productive.

10:46

There's a few ways  we can go about this.

10:46

Do you think it would be helpful to talk through the history of the product  owner role just like where it initially emerged?

10:56

Yeah, I think that's a great place to start.

10:56

I think it brings a lot of context too to what's happening.

11:00

People forget about the  history here.

11:00

When I explain it to people, I say we had product managers in Silicon  Valley, right?

11:04

They were in Google, they were in all of these companies, Amazon, and  they were born out of this business role.

11:09

From a software native company, your software is the  business, right?

11:15

It's what you sell, it's what you actually look at.

11:20

Our product managers in  Silicon Valley, they're doing market research, they're talking to customers, they're  working with developers, they're iterating, they're doing the end-to-end product management.

11:28

What happened on the other side of things, especially in large companies, is the  emergence of product management from Scrum, from product ownership.

11:38

That's usually the  first time these companies were introduced to product management was from implementing a  product owner role and then going, "Hey, we're still not meeting our goals.

11:48

Are we building the  right thing?"

11:48

Then they started thinking product management.

11:53

Where that role came from is Scrum.

11:53

If we go back and talk about the history of agile, agile was a movement that got started by software  developers.

12:01

In 2001, the Agile Manifesto was written.

12:07

A bunch of developers got together in  Park City, Utah, they were all skiing together and they said, "Hey, we've been independently  all working on how to develop software better."

12:18

Some people were practicing Scrum as we  know it today.

12:18

That was Ken Schwaber, Jeff Sutherland.

12:22

There were people who were doing  different types of agile frameworks as well, Kanban, where you were moving it through a Kanban  board.

12:26

There was behavioral-driven development, there was feature-driven development.

12:34

That was the  style of agile.

12:34

There was XP, extreme programming, that was started by Ron Jeffries.

12:39

All of these  people found each other saying, "Hey, we've been trying to push the boundaries of how do we develop  better software," and they got together and they wrote the Agile Manifesto as we know it today.

12:48

The Agile Manifesto is really just a guideline on how they're striving to not just be people  who code what people want, but building better products.

13:01

How do we build better products through  software development?

13:01

The premise to remember this is, and I keep saying it, but they're all software  developers.

13:06

Nobody was a product manager who went to that meeting.

13:11

Nobody who wrote the Agile  Manifesto was actually a product manager.

13:11

I've spent a long time talking to these people as well  over the past 10 years just saying, "Hey, how did this come about?

13:20

Where did this come from?"

13:20

The one person who was really close to them who was a product manager was Jeff Patton, but  he never signed the Agile Manifesto, he wasn't at that meeting.

13:29

He talked to them a lot, he was  able to see what was going on, but all of this was a purge from how do we build better products from  a development perspective.

13:36

That's really important to know.

13:39

Two of the people who signed the Agile  Manifesto, Jeff and Ken, as I was talking about, they were independently coming up with Scrum  on their own in their different companies, and they got together and started to codify  it and they said, "This is how I'm doing it, this is how I'm doing it."

13:54

They ended up writing  the Scrum Guide.

13:54

The Scrum Guide is what a lot of people base their agile practices off of today.

14:00

In  the Scrum Guide, it outlines a bunch of roles that you would do on the development team, and then  it says how you should be developing products.

14:11

Most people out there are working in Scrum  today, and what they say is, "Let's break things down into two-week sprints."

14:15

You can  change the length of your sprint if you want to, but two-week sprints is pretty standard at the  beginning.

14:19

We define what we're going to work on in the backlog.

14:23

It's the product owner's  responsibility to define what goes into the backlog, write down the user stories for it, do  all that.

14:28

Then the development team comes in, they discuss it, the product owner prioritizes  it, they ask questions, and then the development team commits to what they want to build  and they go out and do it.

14:38

At the end, the result is a potentially shippable product, not  necessarily shippable, but potentially shippable.

14:48

They're trying to break it down into small  chunks and build things instead of what they had been doing in a lot of companies, which  was building stuff for three years and then releasing it in a big bang.

14:56

What all of  the people who signed the Agile Manifesto realized was if we do it the other way, if we do  a waterfall type environment, agile waterfall, that's where we go across, there's a lot of risk  because we don't test it with the customer and we don't get feedback on it if we spend three years  building it and never show it to somebody.

15:10

It really approached a different way of building  software.

15:15

It said let's chunk it down and try to get feedback faster. Really noble intention.

15:20

In the Scrum guide though, it introduces these new roles.

15:27

We have developers as we know  and love them, we also have a product owner, then we have a Scrum master, and the Scrum master  is in charge in Scrum of actually helping people do Scrum better.

15:38

That's literally their job.

15:38

How  do I do Scrum better?

15:38

How do I make sure that the team is working well together?

15:43

They host things  like retrospectives where at the end of a sprint we say what went well, what didn't go well, how  should we actually inspect and adapt our process.

15:54

The product owner is where things get murky.

15:54

The product owner in general first showed up with Scrum, and if you go and you read the first Scrum  guide, which I pulled up and started reading, because I've been very fascinated about how  this is described, it says that the product owner is responsible for maximizing the value of  work done, the team does the work.

16:10

Interesting, because now the product owner is not quite  part of the team.

16:16

The team consists of developers with all the skills to turn the  product owner's request into the potentially shippable increment each sprint.

16:24

The team  is usually seven plus or minus two members.

16:29

Then when you go further into the first version  of the Scrum Guide, it does say that the Scrum master works with the customers and management  to identify and instantiate a product owner.

16:39

The Scrum master teaches the product owner how  to do his or her job in order to optimize the value of the use of Scrum.

16:43

If they don't,  the Scrum master is held accountable.

16:43

Then it's got another tip if we go deeper into  this.

16:49

It says per commercial development, the product owner may be the product manager.

16:53

For in-house development efforts, the product owner could be the user department manager.

16:57

What's interesting is that that was the first version of the Scrum Guide, and I get into  arguments about the Scrum Guide with people all the time.

17:07

2013's version though, the more  updated one that you could go and find is the one that almost every company has run an agile  transformation off of.

17:12

It loses that thing that says the product manager could be the product  owner.

17:18

It doesn't say it anywhere in that guide.

17:23

This was the first version, and you can kind of  tell it was an aside.

17:23

It's like, "Oh, by the way, the product owner in Scrum doesn't need to be  a product manager, it could be the customer, it could be a developer."

17:31

It's usually the customer.

17:31

When they were writing this too, sometimes the customer was an internal person at a bank or  somewhere where we were building software who was asking for the software.

17:42

They were like, "Go  build me an internal tool. Go do this."

17:42

Now we're just asking for requirements inside a company,  and that's where you can start to see how the product owner role kind of evolved into somebody  going to ask, "Hey, what do you want me to build? What's required here?

17:59

," and then just listening to  somebody come back and say, "I need this feature, I need this feature, I need this feature."

18:03

Scrum  doesn't describe how to get the stuff into the backlog, and it didn't in the 2013 manuals.

18:09

The manuals have all been a little bit better, they've all kind of been updated since then, and  they do describe it has to start with the vision a little bit more, you have to break down the  vision for the product and get in there, but none of that existed in the early versions of Scrum.

18:25

When people got trained on how to be a product owner, what was happening here is, and this is  the whole other world of Scrum over here, when people get trained to be a product owner, it's  usually a two-day class where they teach them, "Hey, this is how you break down a backlog.

18:42

This is how you do stand-ups with your teams.

18:46

This is how you think about prioritizing  work.

18:46

This is how you manage your backlog, prioritize it for the developers.

18:50

This is how  you work with the retrospectives," but it doesn't teach them about experimentation, it doesn't teach  them about market research, it doesn't teach them about data, it doesn't teach them about any of  the things that we need to be a product manager.

19:06

Then what happened was we went into these agile  transformations at these companies and they said, "Hey, let's adopt Scrum because Scrum was built  as a way to build better products faster."

19:15

It's literally the tagline.

19:21

Everybody was like, "Yeah,  I want to build products faster. Okay, great. Let's do Scrum."

19:26

All these large organizations  back in the early 2010s, in the 2000s said, "Oh, we got to be better at software.

19:32

How do we do  this better?

19:32

Otherwise, we're going to lose when it comes to innovation."

19:36

They adopted  Scrum as a way to build software faster.

19:42

Now, what happened is in order to do Scrum, Scrum  basically sells training. That's what Scrum does.

19:49

All of these agile coaches would come in and teach  the product owners, newly minted product owners, took all those people, made them into product  owners, put them through a two-day class and then say, "Go."

19:58

That was the beginning of  all the agile transformations, and that's where a lot of companies still are today.

20:02

This  product owner role did not emerge from product management as we know it today, it was a way to  help the developers prioritize what to work on, but that was it.

20:15

The product owner was  held accountable for making sure that they were working on the most pressing things or the  highest value things, they do say that, but to me, if you look at it from a developer perspective,  it's also the person where you can say, "Hey, well, you told me to build that, right?

20:30

We didn't  build it wrong.

20:30

You told me to build that."

20:35

It almost gets into consulting territory  where you're like, "Okay.

20:35

If the product owner prioritized all this stuff for me and told  me what to do, I can't be held accountable if it was the wrong thing to build."

20:44

Some of that stuff  does come up in a lot of teams that struggle to adopt agile, to adopt Scrum.

20:50

I feel like there's  a big misunderstanding out there about what is this role and what should we be doing, but the  premise of this is when we talk about Scrum, it's just one piece of the puzzle,  and when people talk about agile now, they almost always associate it with Scrum.

21:08

I was actually Googling agile methodologies, and like I said, the other ones, Kanbans is an  agile methodology, XP is an agile methodology.

21:18

They don't have product owners, they do not exist  in those methodologies.

21:18

There are four developers to work on things, or teams to work on things.

21:23

XP would consider product managers in the teams as far as I know it, but Scrum kind of sees  it as a separate thing.

21:30

Agile methodologies, everybody says, "Oh, they're Scrum now," so it  gets a bad connotation out there about what to do with it.

21:41

I think Scrum if you do it well is  bad, but you have to understand that it's just one piece of building great products, it's not  the whole thing, and companies will adopt it like it's going to radically transform everything.

21:52

To  be fair, a lot of times it's sold that way too.

21:58

There's a bigger picture question that's coming  to mind as you talk about this.

21:58

I'm imagining founders listening to this and smaller companies  listening to this be like, "Why do we need any of this?"

22:07

, especially Silicon Valley startups,  "We're just going to build stuff.

22:07

We don't need these frameworks, we don't need a Scrum master.

22:14

We  just have awesome developers and product managers and we're just going to build awesome stuff."

22:19

I  don't know anyone that has worked this way that has built amazing things.

22:23

Can you talk a bit  about who ends up looking for solutions here, where this even comes from, what companies need  help here versus, "I just don't need any of this?"

22:36

A lot of large companies turn  to Scrum or to the frameworks, and it's because they traditionally didn't grow  up building software.

22:39

They're looking at how do I implement something that has rigor at scale, and  that's where you see a lot of Scrum come up.

22:44

Now, I've seen startups using Scrum.

22:49

Some of them  do it fine, they understand that it's just more about trying to get things out the door every  two weeks to test it with customers.

22:55

I think if you keep that philosophy, like I said, I used  it and we didn't have a lot of rigor around it, that was fine.

23:04

When we were doing Scrum, when I  did it with my team back in OpenSky, we got to this point where we were like, "Two weeks is too  long.

23:09

We're just going to ship things every week."

23:12

We just talked to each other, we skipped  stand-ups, which is sacrilege in Scrum, but we kipped daily stand-ups.

23:17

We didn't need  to stand around and talk about it, we talked to each other every day.

23:21

For me, what was amazing and  where I see teams actually thrive when they start using Scrum is when you go and talk to people.

23:27

You're having the conversations about the work, you're breaking it down, you're understanding  it, so the developers and the rest of the team can go hit the road running and people can ask  important questions.

23:36

If you're not doing that, that's where I think things like a framework  help, but if you already are doing that, you don't need a framework, you don't need  Scrum, you don't need to be prescribed to this two-week sprint or anything like that.

23:49

As long as you have a methodology, it doesn't even have to be a defined methodology.

23:54

As long  as you have a way of working that gets things out to customers, well, who cares? Who actually  cares?

23:59

Where there's a lot of, I think, baggage in the industry and where I hear product managers  get really frustrated and other people as well, developers too, is that when you do Scrum by  the book or how people teach it and how they write about it, it's a million meetings.

24:16

I know  they were put in there so that people were forced to talk, but when you already know what you're  supposed to work on, why do you need to keep doing meetings?

24:26

Shouldn't you just go do some work?

24:26

A lot of developers complain, a lot of product managers complain that Scrum has too many  meetings and they don't actually get to do work.

24:33

That's where I think you have to go  back to the inspect and adapt part.

24:33

A lot of people who are very religious about Scrum will  come and yell at me about this.

24:39

They're like, "Oh, well, that's not how it's supposed to be.

24:43

You're supposed to inspect and adapt."

24:43

Agree, but a lot of people aren't doing it and  that's the piece where you go and you say, "Is this serving us?

24:50

If not, let's get rid  of it.

24:50

Let's not do those types of things."

24:55

When you're a small startup, I don't think you  need a lot of this overhead.

24:55

It's really much designed for larger scale companies, and those  are the ones that you see really adopting it.

25:06

From what I've seen on the data, it's  also companies that are as you I think alluded to at the beginning,  not necessarily software first, product first companies.

25:12

Feels  like it's very common in banks and telecom companies and companies that  aren't product First and software first.

25:21

There are SaaS companies that do  Scrum out there and they like it, and I don't think they're very dogmatic about it. Got it. Yeah.

25:28

They do it for a reason of just trying to  provide some more context to their teams about how to work together at scale.

25:33

I've  also seen places where they don't prescribe whatever methodology you want to work with for  the teams, but instead they'll spend a lot more effort breaking down the road maps, thinking  about what are we going to do each quarter, trying to set those themes, and then they just  let the teams run, and that works as well.

25:48

I think it really depends how they adopt it, but  I would say it's not a hard and fast rule that no startups are doing this.

25:59

Some are doing it, I  just don't know how it's going for them.

25:59

To me, it might be overkill if you're doing that with  a team that's pretty experienced in doing this.

26:13

What I was insinuating is less just  Scrum as a general idea and more very structured rigid processes and also product  owners.

26:17

Then there's this whole concept of SAFe that we can talk about.

26:23

Should  we get into that or should we talk about product manager versus product owner  and just the challenges people have there?

26:33

Let's talk about SAFe because that's where  a lot of this started to get Confusing Okay, cool. Let's go there. Yeah.

26:37

Scaled Agile Framework came out of the desire to  figure out how do we scale Scrum and different processes and bring it to organizations at scale.

26:42

It originated from a more structured approach to agile too called Rational Unified Processing.

26:50

Now, SAFe wasn't the first thing that started at scale.

26:58

There was also LeSS, which is a Scaled  Agile Framework, and then Jeff Sutherland who did Scrum has Scrum@Scale.

27:04

It's not the only  scaling framework out there.

27:04

There's a lot, there's actually a lot out there, but SAFe  was one that was marketed the best.

27:10

The way it's marketed is will tell you everything  you need to do, to do all of your agile teams with Scrum and put them all together.

27:19

The idea behind SAFe was that Dean Leffingwell came up with it.

27:25

He wanted to really show how  you tie multiple teams together at scale in an organization and how do you bring some rigor and  process to that.

27:31

The executives at really large enterprises, we're talking tens of thousands of  people, they love SAFe because it prescribes a lot of an operating model of what to do when it comes  to development, but it also gets billed as like, "Hey, this is the whole model for you  to go do software."

27:50

If you look at it, it's a big map that everybody kind of makes fun  of a little bit, and it describes all different things on it if you look at the map.

28:03

You can  click in and you can see the definitions and you can see what's going on in the areas.

28:06

The SAFe image has gotten bigger and bigger over time. I think, what is this? Version six.

28:11

I do know a lot of people who worked on SAFe, so I know a lot of trainers and I've worked with  companies.

28:16

The first time I was introduced to SAFe was when I was working with a bank back in  2015.

28:21

I came in to train their product managers, I'm doing my training, we're setting them up  on how to go talk to customers, talk about hypotheses, MVP, and somebody came up to me and  they said, "Hey, Melissa, all of this is great, but I don't have time to go talk to customers  because I'm a product owner."

28:39

I was like, "Well, what are you doing on a day-to-day basis?

28:44

What don't you have time for it?"

28:44

, "I got to write my user stories." I'm like, "Okay.

28:47

How many user stories do you write per day?"

28:53

This was for the developers to have a full backlog  so they could all work, right? She's like, "Oh, yeah.

28:58

I spend pretty much 40 hours a day writing  user stories." I'm like, "On what?"

28:58

We're like, "What are you controlling?"

29:03

She's like,  "The login API for a bank."

29:03

I'm like, "Can you log in?"

29:07

She's like, "Yeah," and  I'm like, "So what else are you working on?

29:12

Is there a new initiative? Is there a new  thing?"

29:12

It's like, "No, I was reorganized into a team where I became the product owner.

29:17

I have a  product manager who goes and talks to customers, but then she comes and she tells me what to build,  and then I write the user stories around it and I put it into the backlog for the teams."

29:26

I  was like, "What is this?"

29:26

Then they said, "That's SAFe.

29:32

This is what we're working towards."

29:32

This was my first experience with SAFe, and then I ran into another company that did it, another  company, same thing over and over and over again, where all these product owners were just basically  trying to keep these backlogs full for developers, and they were working on such a narrow level.

29:47

When  a lot of organizations too I saw it reorganized into agile teams, they did it by component.

29:52

Everybody was over every tiny little feature, and these teams were massive, super huge scope,  and some of the stuff was just not prioritized.

30:03

It was done, you didn't need to work on it.

30:03

They  were finding work to do so people wouldn't get fired.

30:08

That's how the product owners operated.

30:08

There was all this legacy baggage sometimes in companies where they were all re-put on things by  component, and they're just making up work to do.

30:20

SAFe introduced this kind of split between product  manager and product owner, and if you look at the map, the product owner is part of the agile  team where they sit with the Scrum masters, which is a team coach that they call here  and the developers, and then the product manager is sitting with a system architect and  what they call a release train engineer.

30:35

What SAFe does is they pull a bunch of agile teams  into a release train and you get on the train when you're ready to ship things and you make  sure that it all goes pretty smoothly to get to that potential shippable increment or that big  feature launch that you would be doing with SAFe.

30:58

SAFe's really good at prescribing how to do that,  they're great at describing how to do the release trains, how to bring those teams together, how to  put them on it.

31:02

Then they do this thing called big room planning where they get the entire release  train together, all these teams, they put them in a room and in every quarter you're breaking down  what we're all going to work on.

31:12

Where I hear frustration from teams every time I come in and  train them is that when you do big room planning, a lot of times it's a commitment.

31:21

You start at the  quarter, they haven't been doing good discovery because remember, these people have not been  trained on good discovery so they don't really know what they should be working on, they haven't  been out talking to customers a lot of times.

31:30

They kind of scramble, they figure out what needs to  happen.

31:36

Usually they have a backlog of stuff that does need to happen, it just has to get done.

31:40

They map it all out in a big room together, they commit to it, and then that's the quarter.

31:44

They ask me, "When am I supposed to do discovery?"

31:50

I'm like, "Well before that ideally you should  have a vision.

31:50

You should be breaking it down, you should be putting discovery into that vision,  talking to customers, feeding that in there."

31:58

Then I hear, "We don't have time to do that  because we sprint back to back."

31:58

I was like, "What does that mean?"

32:03

, and they're like, "As  a team, we go and we basically do two-week sprint into two-week sprint into two-week sprint,  and I got to make sure my developers are full.

32:10

I got to make sure they have things to work on.

32:15

If I go take time off to go talk to customers, which also is not my job as a product owner, it's  my product manager's job, they'll feed me in what the customers are saying, then I break those down  into features and I can work with the developers on it."

32:27

That's how all of this stuff starts going.

32:27

What happens in organizations that they don't understand here is that it's not the most  efficient way to work.

32:34

I see a lot of developers out there become almost ... How do you describe  it?

32:42

Reliant on the product manager or product owner to tell them what to do.

32:50

Even though you  build them this great vision and you explain what needs to happen, they go, "Oh, I can't work on it  because the product owner hasn't prioritized it."

33:02

Then they asked me, "If I don't have enough  for the developers to do on feature work, what are they supposed to do?"

33:05

I said, "I  guarantee you there's a ton of tech debt they could be working on.

33:09

You don't have  to scope that out.

33:09

Let them choose what's the most important thing.

33:13

They should be working  together as developers and architects to figure out how to tackle some of that tech debt,  how to get into it while you're figuring out is this the right thing to be building."

33:21

is this the right thing to be building." With all of this stuff, people feel like they don't have time because they're in a  million meetings, and the expectations of these companies is that every sprint, we're  delivering software towards these roadmaps that we promised in the last quarter and  we're not checking to see if they're right,

33:39

we're not checking to see if they're actually  helping us move it forward, and a lot of times the organizations are not set up with the right  feedback mechanisms, the right user research and the right data to tell us if everything is  working so they can feed that in to the next release planning. They're just planning, planning,  planning, breaking it down into sprints and going.

33:53

They're just planning, planning,  planning, breaking it down into sprints and going.

33:58

SAFe is not good at describing how you do all  that other work.

33:58

In a lot of this stuff too, there's pieces that they put onto this map of  SAFe where they're like, "Hey, you should do OKRs," and it's like, "This is what OKRs are.

34:11

You  should do a roadmap.

34:11

This is what a roadmap is."

34:17

How all of that cycle works together where you're  balancing discovery and delivery and feeding it in is really confusing in organizations.

34:22

Then  what it's basically saying is a lot of the discovery work goes into the product managers,  and the product managers, the product owners report into the product managers.

34:31

What I've seen  that doesn't work here is that you're basically making these product owners order-takers.

34:37

They  are extremely tactical, and then when it's time to actually be more strategic, let's say  you want to be promoted to a product manager, some organizations, that's not even the same  business line, not even the same career path.

34:47

It's product owners go over here and product managers  go here and they report into different people.

34:58

If you ever want to move from product owner  to product manager, a lot of times you don't get experience with the strategy, figuring  out what customers want, breaking it down, looking at the market research, determining  is this valuable, is this what we should be working on.

35:09

They're not even getting exposure  or a chance to do that because SAFe is like, "No, that's the product manager's job.

35:14

Your job is  to go really deep and work with the developers." Wow, okay.

35:21

A lot of this sounds quite absurd as  someone hearing all of the details and looking at this image.

35:28

That being said, many companies are  adopting this.

35:28

It feels like it's growing.

35:28

More and more companies are adopting this as the way  to work.

35:36

I imagine the incentive is we just want to build great software and we don't know exactly  how, and there's this process we can plug in and it'll help us do it.

35:47

I guess thoughts on that,  and do you find it can work or often works or often doesn't work?

35:55

What is your experience  with people adopting this and how it goes?

35:59

I know a ton of companies that adopted SAFe  about eight years ago and have gotten rid of it.

36:04

Capital One just came out and said they  got rid of all their agile roles, all their Scrum roles.

36:09

They were early adopter of SAFe, they  don't do it anymore.

36:09

They wrote about that in the newspaper.

36:15

I've seen it happen more often.

36:15

Now, in  a lot of our organizations too I'll see parts of them do SAFe and other parts not do SAFe.

36:22

It  could change business line to business line.

36:28

I don't think though that people grasp how much  it's still out there.

36:28

I get questions on SAFe every single day on the podcast.

36:35

Everybody asks  me, "Why are we still doing this?"

36:35

It's for what you said, executives buy SAFe because it's the  only framework out there that basically draws them a map and says, "Plug and play, do this."

36:46

That's why everybody's so excited about it because it's the only thing that specifies things to this  level, and they went, "Oh, it's something I can understand, it's something that actually  has definitions around it."

36:57

To be fair, that was a great thing for SAFe  to do as a marketing tool.

37:01

Bravo, they created this thing that everybody wants,  a good product to sell, but it's overkill, and that's what I keep hearing from organizations  is it's basically taking the responsibility away from leaders to go figure their stuff out  themselves as well.

37:17

If you are a new leader and you've just been dropped into this role,  I have tremendous empathy for them because yeah, where do you get started?

37:28

How do  you try to run a technology organization?

37:33

Somebody came and told me, the CIO came and told  me I'm in charge now.

37:33

I'm in charge of all of the developers, or I'm in charge of all the product  managers. Now, where do you start?

37:38

I can totally tell why people adopt SAFe because you're like,  "Oh, I've been looking for the handbook.

37:44

I've been looking for something to do here."

37:49

The problem  is it's only solving a little bit of the puzzle, which is bringing those teams together.

37:55

People do say it does really strains well, but it doesn't tell you also how to do your job  as a leader, it leaves it all out.

37:59

They talk about portfolio visions and portfolio management  and SAFe there too, but more often than not, I come in and I find everybody above product  owners and product managers, let's talk about directors of product, VPs of product, they don't  know what they should be doing as a VP of product or a director of product.

38:17

It's like, "What's  my role?

38:17

What should I be feeding in here?"

38:23

SAFe doesn't even have that in there, that's not  even a role.

38:23

Product manager going up into those levels is not really there.

38:27

What do you  do when you own a whole product line in an organization?

38:34

What you do when you're the  head of product for a credit card at a bank, right? What's my job? Doesn't say that.

38:38

There's  a lot of people out there in these organizations that I've been working with who I'm like,  "You are supposed to be doing strategy, and this is how you do strategy.

38:49

This is how you  go out and talk to customers.

38:49

This is the patterns that we have in software.

38:53

Are you doing a platform  strategy? Do you need APIs?

38:53

How do you think about your app strategy, rolling it out?

39:00

How do you do  this here?"

39:00

All of that stuff doesn't quite come from ways of working, which is what SAFe is doing.

39:06

It's about how do you do your jobs in those areas?

39:12

A lot of organizations who adopt SAFe don't  realize that you need a head of product, you need somebody to actually be feeding that vision  all the way down and make sure it's breaking up around the teams and controlling that portfolio  vision and doing all of these things into it.

39:28

I have not seen SAFe slowing down by any  means out there for people adopting it, I see more and more organizations adopting  it.

39:33

I think we take for granted too in Silicon Valley how many people are just starting on  their journey for digital transformation.

39:45

There's a lot of pharmaceutical companies,  banks, insurance companies, they outsource their development or they had an IT team, but  they never had to really think about it before because digital wasn't as important. Now they do.

39:55

Some of these companies, most of these companies are Fortune 50 companies, right? Fortune 100  companies.

40:01

I think a lot of the ones I see, at least banks, realized early on, "Hey, when  it comes to apps and how people interact with our stuff, software is important," but there's  a lot of companies that did not catch that train and they're just starting, and then they  turn to things like SAFe because it gives them a guideline.

40:22

"Hey, I've never done this  before.

40:22

I've been in this bank for 40 years.

40:27

All I know is waterfall type development. What do  we do?"

40:27

Then we'll go, "We'll go look at SAFe."

40:33

I love that we spend time on that because I think  it's really important.

40:33

You can be cynical about all this and be like, "What the hell are people  thinking?

40:38

This is crazy," but as you described, people just have a problem to solve, they've  never done this before, they look for solutions, they find something that seems right, they see  other people doing this and like, "Okay, let's try this thing."

40:51

What you've seen is it rarely  actually works out the SAFe specific approach.

40:59

There's a few ways I think we can help folks.

40:59

One is someone trying to do say an agile transformation or a digital transformation, your  advice for how to actually do that better.

41:05

Then I want to talk about say you're a product owner  or a PM within an organization that works like this. What can you do?

41:14

Maybe let's start with  the first.

41:14

Say someone's trying to figure out, "We need to build better products.

41:19

Something's  not working right." SAFe is an option.

41:19

Your suggestion is don't maybe do that. What  should people do?

41:23

I know you're not going to have the answer in a short answer, but  generally, how should people approach this? Yeah.

41:33

When I've worked with companies  on digital transformations, you want a development operating model.

41:38

That's where a lot  of these agile methodologies came out of.

41:38

You have to understand that's just the development  operating model, that's not actually going to help you with go-to-market, with launching your  products and with product management.

41:46

What I advise for companies to do is first sit down  and say, "Hey, how do we think about building our operating model?"

41:56

When I think of product  operating models and what I do with companies is we break out how do you determine product  strategy?

42:03

Do you have a good product strategy?

42:08

You look at your organizational design.

42:08

How are we actually organized around our products?

42:14

Do we have good coverage of  product managers and do we have skilled product managers up and down the organization?

42:17

Then we want to look at product operations.

42:17

Do we have the infrastructure in there to help  support these teams?

42:22

Can they get the data to make decisions?

42:26

Can they actually be in touch  with customers?

42:26

A lot of these large organizations haven't actually thought through many of those  steps as well that enable product managers and development teams to be successful.

42:36

They don't  have ways for them to go and talk to customers.

42:42

That's why they're not doing it.

42:42

I have a lot of  empathy for people in these organizations as well who can't do product management well because of  the bureaucracy or the things around it.

42:47

Leaders need to solve that, right?

42:53

They need to understand  what the role is and they need to open it up.

42:57

Then we got to look at our culture and incentives.

42:57

Are we just rewarding people for shipping as many things as possible, which is like, "Hey, just  put everything you possibly can into that release train or that backlog," or are we coming back and  saying, "Hey, is this valuable?

43:08

Is this tying it back to our business?"

43:14

Many organizations  do not have a great product strategy, many large organizations that I've worked with,  and it's that tying it back to the value piece, tying it back to, is this going to reach our  company goals?

43:27

If you are a huge organization and let's say making billions of dollars a  year, and your goal is expand geographically, what are you doing in your portfolio to actually  enable that?

43:37

What products are you building to expand geographically?

43:43

So many organizations don't  have the transparency to actually even see that.

43:50

One crazy thing, a lot of people give large  organizations a lot of flack for, and I know Marty does this too, for focusing on processes.

43:56

I don't  think processes are the enemy here.

43:56

For example, if I hear somebody really worried about getting a  roadmapping tool in there or something like that, I'm like, "Yes, you need that because you have  no idea what your 4,000 teams are doing."

44:06

If they're actually coming back to the business  goals, you have no infrastructure in there to be able to see that transparency.

44:16

Those types of blocking tackling is absolutely necessary for a transformation  for a organization to be stood up around software product management.

44:25

You have to have  the transparency to actually see those things.

44:29

You do need to have enough process so that you as  an organization can be efficient in getting things out the door, and that's what I think SAFe was  trying to do, but it's not working because it's not solving the problems of the product management  and it's not solving that problem of connecting the value back to the product teams.

44:45

Instead, it's  seen as a role that almost babysits developers or tells everybody what to do. Where's the discovery?

44:53

Where do those things come in?

44:53

I know with the SAFe image that we got over here, they try to drop  things like Lean UX in there, which Jeff Gothelf thinks it's hilarious, but it's not really pulling  it all together of how do we do this on a cadence?

45:09

How do we help people go out there and actually  talk to customers?

45:09

How do we enable them to do it?

45:14

If you're starting a transformation, it's not  just thinking about how do we build the product, but you should also be thinking about how do we  launch the product and how do we make sure this is the right product to do.

45:23

That's the big pieces  of it, and that's where all that product strategy comes in.

45:29

You should also look at the career  paths.

45:29

This is what really bothers me about agile transformations and what bothers me with Scrum  and SAFe is that when we organized in these large organizations into agile teams, we made all these  new roles called a product owner, and so many organizations don't have a career path for them so  they email me and they go, "What's my career path? What do I do next?

45:56

Where am I supposed to go?"

45:56

I've been saying for 10 years, this is not a team role, it's not just a team role, it's a business  role and it rolls all the way up to helping you further your business.

46:08

You have to make sure  that people on teams can be promoted to running multiple teams, can be promoted to running an  entire product line.

46:14

To us, that's so simple in Silicon Valley native software companies, but  it's still unheard of in other organizations.

46:20

What happens too, and this is where I think leadership  and C-suite needs to really pay attention, because we're transforming in this way of working,  what happens is some of the roles that we had before do not serve us now.

46:38

Maybe we don't need  a million project managers, maybe people in the business who decided what we're going to build,  are they the right people to bring with us on this next phase into product management? Can they  learn? Can they grok software?

46:50

Do they understand those pieces?

46:55

That's what we have to ask.

46:55

Organizations are so afraid sometimes to put these career ladders in because it kind of  overhauls their traditional ways of working, and then they've got people who've been in these  organizations for 40 years and now you're saying, "Hey, you're actually not in charge of that, the  product manager is in charge of that," and that's scary.

47:14

A lot of them get in the way because of  that.

47:14

If you really want to transform though, the C-suite has to be like, "Hey, we're going  in this direction," and just put it down because I've seen it run by a lot of middle managers, a  transformation run by tons of middle managers, and those are the jobs that are usually in  most jeopardy when you start transforming and you have to re-skill and you have to figure  out what to do, and they don't want to do that.

47:37

They're not going to be the ones who jump  up and down and say, "Hey, let's do this."

47:41

There's a lot of people out there, I think,  pushing organizations to try harder and to internally as well.

47:46

I've worked with a lot of  people who run these transformations who just really want it to work, and I think they do it  with the best of intentions, but the C-suite has to understand this is not just a transformation  project, this is a whole new way of working, and if we want a whole new way of working,  we have to really rise to that occasion.

48:07

This episode is brought to you by Coda.

48:07

I use  Coda every day to coordinate my podcasting and newsletter workflows, from collecting  questions for guests, to storing all my research, to managing my newsletter content  calendar.

48:16

Coda is my go-to app and has been for years.

48:22

Coda combines the best of documents,  spreadsheets, and apps to help me get more done, and Coda can help your team to stay aligned and  ship faster by managing your planning cycle in just one location, set and measure OKRs with  full visibility across teams and stakeholders, map dependencies, create progress  visualizations, and identify risk areas.

48:42

You can also access hundreds of pressure-tested  templates, everything from roadmap strategy to final decision-making frameworks.

48:47

See for  yourself why companies like DoorDash, Figma, and Qualtrics run on Coda.

48:52

Take advantage  of this special limited-time offer just for startups. Head over to coda.

48:57

io/lenny and  sign up to get six free months of the team plan. That's coda.

49:03

io/lenny to sign up and get  six months of the team plan. Coda. io/lenny.

49:13

There's a few things I want to pull out from  what you just shared.

49:13

One is, just to clarify, you recommend not using SAFe, you  don't think that's a good approach?

49:21

I do not recommend using SAFe. Yeah. Great.

49:25

There are people who like SAFe.

49:25

Let me just  say this, there are people who found success with SAFe.

49:29

Every single person I have talked  to who like SAFe found success with SAFe, they ended up ripping it up and making it into  something else.

49:35

It's not actually SAFe by the book.

49:40

If you do that, fine, that's any process.

49:40

If you ended up adopting SAFe and you want to go back and look at it and say, "Actually let's just  get rid of all the stuff that's not working and keep the stuff that is," fine, but being open to  understanding this is not the way that we do good product management.

49:59

There's not a lot in SAFe  about doing good product management.

49:59

That's the stuff that we have to understand.

50:04

It could help  in certain areas, and I do think it does help in certain areas, bring some rigor to things, but  if you take it too far, it will destroy things.

50:17

There's actually a great story about a water  company in the Netherlands and they decided to adopt SAFe, and this was on the news a couple  months ago.

50:26

They decided to adopt SAFe in their IT teams and start working with it.

50:32

They  ended up going bankrupt, and the reason they ended up going bankrupt is because the  teams were learning the processes for SAFe, they were taking so long to deploy their new  invoicing system and payment collections that they couldn't collect payments from customers  because they got so caught up in the process.

50:53

That's what I see happen a lot in these  organizations.

50:53

Instead of talking about what's really important, which is, "Hey, how are  we serving our customers?

50:57

How are we winning in this market? How do we stem churn?

51:01

How do we do  all these things?"

51:01

, we're talking instead about, "What stand-ups are we doing?

51:07

Oh, how do  we do this release planning?

51:07

Oh, my God, you guys didn't sprint back to back, you did  it wrong."

51:12

We're talking about work about work, but we're not actually getting  into what are we achieving here, and that's the part I do not like about  rigid processes when it comes to this.

51:28

That touches on the other theme I wanted  to bring up is it feels like the stuff is a kind of replacement for skilled, talented  people, a product leader that understands how to do these things and has product taste and  has organized teams to build great product.

51:48

It feels like people are just, "We don't  have that so we're going to create this.

51:51

This process is going to fix all our problems."

51:51

Can you talk about just the importance of that, the people you hire to run these  things as key to this, if that's true?

52:00

In a lot of organizations, the people  who buy SAFe, they have not run large scale technology organizations before, or  they're new to this way of working so they adopt SAFe and they hope it works because  it looks like a nice plan, like we said, to go out and do things.

52:14

When you're doing  a transformation, a lot of companies are pulling people into these roles for the first  time.

52:19

I've said since day one that I've been working with companies, it's okay and I think  it's noble to want to train people and put them in different roles. Cool.

52:28

If you're going to  spend money upskilling your people, do that, but you also have to intersperse people who know  what they're doing.

52:32

I think at leadership it's really important to bring in somebody who knows  what they're doing to help run this type of thing.

52:44

There are more people out there and more  leaders who have done this before because we've been doing this for 10 years.

52:47

There's  Shruti Patel, she's chief product officer at US Bank for small business banking.

52:52

I just had her  on the podcast.

52:52

She worked at Shopify, she saw how great teams worked, and then she was able to come  and help apply that at a bank.

52:58

She's experienced, right?

53:05

She's an experienced product person who  comes in to help.

53:05

Melissa Douros is the CPO of Green Dot Bank and she had worked at Discover  Financial leading the transformation there, did all that work, and then could bring it to  Green Dot Bank.

53:16

She can see what needs to happen, what needs to actually go on here.

53:21

We've got more and more people out there who have done this before who are looking  for these opportunities to do it in the bank, and I think it's important for C-suite to bring  them in to actually look at that.

53:28

Where I've seen transformations be the most successful in all  these organizations is when you do that mix, you keep some of your people, but you also  bring people in to learn.

53:42

I get hired all the time to come in and train.

53:47

I've worked with  almost every Fortune 50 company at this point, fortune 100 company too, and I get in, I  come in to train a lot of product managers.

53:56

We do it through Product Institute and we'll train  everybody.

53:56

What used to happen about eight years ago is they train everybody and they would say,  "Go."

54:04

Where do you go after you bring in the consultants to do training to keep learning?

54:09

How  do they watch other people in the organization do great product management if there's nobody  in the organization who's done it before?

54:20

Luckily I think a lot of organizations are  realizing that, so more leaders are out there who are saying, "Hey, I've got to actually  intersperse skills here.

54:25

I need to bring in some more directors who are experienced here, some  more individual contributors who are experienced here."

54:33

Those organizations I think are wildly  successful because they recognize it and they say, "I've got to make sure that people can learn  from others."

54:39

That's how you keep developing, that's how we all keep developing, it's not  just doing all external classes.

54:43

That's where I think these things become powerful.

54:47

You  could do that at all levels.

54:47

You don't have to just do it with the teams, you could do it  at director level, you could do it at VP level.

54:55

That's how we should be thinking about this.

54:55

Now, there are some CPOs out there and some VPs of product in these large organizations who are  new to this way of working, but they've committed themselves to learning and to trying to figure  out how to do it best.

55:06

They're not saying, "Hey, I'm just going to adopt SAFe or I'm just going  to do whatever is over here," they're actually saying, "What don't I know?"

55:16

I'm watching them  go out to talk to other CPOs, do all these other things.

55:21

They usually have great market knowledge,  great business knowledge, and they're fantastic at strategy, and then they hire people underneath  them who are great at the other pieces like the execution and getting the software at the door.

55:30

I think those people are successful in it as well because they notice their skill gaps and they  hire for it just like any great leader would.

55:41

In these organizations, I do see sometimes SAFe  for something being a crutch for people who don't know what they're doing to bring in.

55:48

If you really  think about, "Hey, how do I make this better?"

55:48

, and have that continuous learning mindset and that  way to want to propel this forward, I think you'll consider other options and start to think about  broader than just SAFe, broader than just agile, what do we need to make this successful?

56:04

The key part of this too is recognizing that product management is not just this  role in Scrum.

56:09

I say this in my talk too, I say Take Scrum away.

56:15

You still need product  management, right?

56:15

Product owner doesn't exist without Scrum, that's not a thing, but you still  need product managers and that's why all product owners should be product managers, they should be  fundamentally product managers.

56:26

That's why I do not like these career trajectories that keep them  separate.

56:31

Sure, if you want to have a principal IC product manager like they do in a lot of large  Silicon Valley companies, perfect, let people keep working on those things.

56:43

They don't have to  go into management, but that doesn't mean they're different.

56:48

Between an IC product owner and an IC  product manager, it shouldn't be different there.

56:54

Perfect segue to where I wanted to go next,  which is say you are a product owner today listening to this and you're like, "Man,  this is exactly my life. What can I do?"

56:59

, what's your advice to folks in that role right now  about how to potentially become product managers, build the skills they need to not just be stuck  in this career path that doesn't go anywhere? Yeah.

57:14

I think the first thing is bringing  awareness to that your role is more than just working with the developers.

57:19

A lot of leaders  argue with me that we need product owners because it just doesn't scale.

57:24

You've seen massive  companies at scale where they don't have any product owners.

57:30

I do not understand that.

57:30

It's a  weak argument to me, it's a very weak argument.

57:30

It just means you don't know how to distribute the  work evenly and give a little bit of strategic guidance to product owners so that they can gon,  or product managers, on a team so that they can go and build visions and cut down features and  stuff like that.

57:45

If you're a product owner and you're like, "Hey, I don't have the opportunity to  talk to customers, my product manager does that.

57:50

I am just working with the teams.

57:55

I want to be more  strategic, I want to think longer term," I'd say try to take some ownership over that and push  back on the things that are being given to you.

58:04

I was doing a workshop for Mind the Product  back in the day, and I had a product owner in my workshop and she said, "I don't think that  things we're working on," they were doing SAFe, "are the right things to work on."

58:12

I said, "You  should bring this to your manager," and she was like, "I don't know. I'm going to get fired.

58:17

I don't think it's the right thing.

58:17

What am I going to work on if we're not going to work  on this?"

58:20

I'm like, "Well, this is the beauty of product instead of project, we stay with the  product."

58:24

Just because your project ends doesn't mean that you lose a job.

58:30

She put together this  whole thing, went and said, "I don't think we should be working on this," and they promoted  her.

58:34

They were like, "Fantastic."

58:34

She took this leap of faith and went out there and started  saying, "This is more. We need to do more."

58:44

I think if you're a product owner  and there's no career path for you, start asking leaders what your career path  is because it's going to make them go, "Oh, great question.

58:52

What should the career path  be?"

58:52

There's a lot of literature out there about how we make career paths, so you can start  there.

58:56

Ask what's next for you after this product owner role.

59:01

I would ask the product managers  if they're doing all the customer research, see if you can do some customer research with  them. Go sit in on this.

59:06

A lot of them will say, "I don't have time.

59:11

I don't have time to do this."

59:11

Strip back all the user stories you're working on, stop thinking about it as a quantitative metric  that needs to just go up and up.

59:16

Instead, really think about the value you're delivering  with your team. Is this the right thing?

59:24

When you talk to leaders and when you  present your case, you say it in a way of, "Hey, I'm working on X, Y, and Z feature. What's the goal here?

59:29

When we release this, what do we hope will happen?"

59:34

I think that's  one of the best questions anybody can ask if they're worried their company is not  focused on outcomes.

59:39

What do we hope will happen when we release this?

59:42

What  metrics are we going to change?

59:42

How do we instrument it to make sure that's true?

59:46

Then we can go back and actually see if it changed.

59:50

One simple question to get alignment  on it, and then you can start to say, "Oh, that didn't work or this did work." Great. Why  did it work?

59:55

You can open up those conversations.

1:00:01

I'd say there's a lot of things you can do to help  move your companies forward, and I have seen in a lot of these organizations too, a groundswell of  product owners and product managers saying, "Hey, what's next for me? What's going on?"

1:00:12

That makes  the organizations go and figure it out.

1:00:12

I was working with one Fortune 10 company not too long  ago, their C-suite, I've been working with them for a very long time and they're finally like,  "Hey, we're going to codify the product manager role and we're going to have it all the way up and  down our organization, we're going to make roles, we're going to make responsibilities."

1:00:32

To me, that  was music to my ears, but the reason they were doing it too is because they noticed there was  a lot of churn in the organization in that role, and they also realized it's a critical role.

1:00:42

They're losing good people because people from the outside are coming because they want to  work for this great big organization that's doing super well, fantastic, but they get in  there and they go, "Where's my career path?

1:00:56

What am I supposed to do?

1:00:56

Where am I supposed to  go?"

1:00:56

A lot of leaders are out there now realizing, "Hey, we do have to get our stuff together," and  the only reason they're coming to this conclusion as well is because they're looking around seeing  other people doing it and they hear it from the teams, they hear it from the product managers.

1:01:10

I don't want people to think, "Hey, I have no power.

1:01:15

I'm in a 10,000 person organization."

1:01:15

The  more you bring this up, the more your leaders will respect it because they don't want to lose  you, they don't want to lose good people.

1:01:25

If you want to be great at your job and you  need more support there, speak up, speak up.

1:01:31

At a certain point, I do tell people this.

1:01:31

If you feel like you can't do great product management in your organization, try to find  another organization.

1:01:34

I know that is hard to say and I respect people are tied to insurances  and it's hard to change jobs, but if you do have the opportunity to look for another organization  that does it well, I would go there.

1:01:47

I would also say in large corporations too, I've seen certain  business lines and certain divisions do it super well and then others not.

1:01:57

If you are in a large  corporation, maybe think about moving internally, laterally to a different team and seeing if  you can work there.

1:02:04

I'd find the leaders who know what they're doing and go work for  that.

1:02:07

That's usually the best move here.

1:02:11

The point you made about how a lot of companies  don't have any product owners and have scaled very wide, just to reinforce that in the  data dive that we did on job market trends, no tech company has a product owner basically,  no top tech company.

1:02:21

I know there's an important distinction here.

1:02:28

These are tech, software first,  product first businesses where their business is the software they're building, and a lot of  the companies we're talking about here are not that.

1:02:36

They're banks and telecoms, pharmaceutical  companies.

1:02:36

I get that it's a very different world, but I think it's important to highlight, "You  can become very big."

1:02:42

Google has no product owners as far as I know, Amazon, Microsoft,  Netflix, no company you've heard of that's a tech company has a product owner.

1:02:52

They're all  product managers, they're all product managers. Yeah.

1:02:56

I don't want people to think that there  aren't people who build great software in these large corporations too because there are.

1:03:02

There's pockets of people who are doing it super, super well.

1:03:06

If you are one of those people who's  been pushing the boundaries, doing great work, and your title is a product owner, what I always  tell people on your resume, if you're looking for your next job so that you're not pushed out, let's  say, of these large corporations like a Google or somewhere like that, and that's where you want  to work in a tech firm, make sure you describe how you did your job from a value perspective.

1:03:28

Do  not talk about your agile cadences. Get Scrum out of there.

1:03:33

Talk about what value you brought  to the users and what metrics you moved, and that's how your resume should be laid out.

1:03:38

I do read tons of resumes to hire people, and also chief product officer, same thing.

1:03:43

If I  see immediately implemented Scrum processes across the organization, I'm like, "No, that's not what  I need.

1:03:49

That's not what I was looking for."

1:03:49

I was looking for what are you going to do to push the  strategy in that part of the organization?

1:03:53

What are you going to do to actually build better  products for customers?

1:03:58

Then when you get into the interview, you can talk about what things  you did to do that, but you want to make sure that you're focused on really understanding the  customer and translating that into great products, and the outcomes that we were looking for when you  do it on your resume, I think that's important. Okay.

1:04:15

I want to spend more time here because  this is so important.

1:04:15

This is highlighting here's the difference between a product owner  and a product manager.

1:04:19

If you want to move into product management and become a great PM, if  you're a product owner today, even if you're not a product owner and just want to get into product  management, can you again just highlight here's the big difference and here's the skills that  people value most in a PM versus a product owner. Yeah.

1:04:38

When I see product owners write out  their resumes or describe their job functions, they always approach it from a process standpoint.

1:04:44

I prioritize the backlog, I worked with the developers to break down the work, I checked the  developer's work and did the acceptance criteria, I wrote the user stories, all those functions is  what I see over and over and over again in product owner resume.

1:04:59

What you want to do instead is say,  "I led the," we can even do the login API,"I led the work around the login API.

1:05:07

The problem  that I was solving around it was trying to enhance security for our login protocols to meet  regulatory requirements.

1:05:12

enhance security for our login protocols to meet  regulatory requirements. I interviewed a bunch of users, I got up to speed on the regulatory  requirements, I worked really closely with our

1:05:21

legal teams and our compliance teams to translate  that into something that was going to secure our bank, and when we launched, we were able to meet  our compliance, save our bank a couple million dollars, and we smoothly transitioned into these  new security requirements without disrupting any service for customers for four million customers." Way different story than I prioritized backlog and

1:05:36

Way different story than I prioritized backlog and I shipped it off to developers. Take it a step  further.

1:05:42

If you're working on customer-facing things, who are your customers?

1:05:47

Did you  go out and talk to them?

1:05:47

By interfacing with customers and understanding them, I was  able to solve XY, and Z problem with them, which resulted in a measurable amount of XY  and Z metric going up for the business.

1:05:57

I ran this function, I ran this feature, I launched this  feature, I watched it through, I iterated on it, I did the stuff that was needed to make this  successful.

1:06:08

That's what I want to see on a resume.

1:06:14

Even if you have a product owner title, I'll still  read the details and everybody else will too, but I will say there's sometimes a poor  connotation when you have that title unfortunately because of the baggage that's  associated with agile.

1:06:24

Even just on resumes, I would say do product owner/product manager  in there just to let people know that I know how to do this and I've been doing this  well.

1:06:35

If you do that in your bullet points, that shows up as well.

1:06:40

There's also this whole  concept that we didn't even get into about certifications.

1:06:45

People keep asking me if I want  to transition into product management, should I get a certification, an agile certification?"

1:06:51

I  feel like these were bigger a couple years ago, but they're still big.

1:06:55

If you ever see somebody  with a CSPO on the end of their profile, which you probably have seen on LinkedIn,  it's a certified Scrum product owner.

1:07:05

Now, one thing to remember, and this is about all  agile stuff, is we call it the agile industrial complex, agile coaches and agile trainers,  the whole Scrum team, scrum.

1:07:13

org, Scrum Inc, SAFe, everybody, the way they make their money is  through consulting to teach you these processes and by having people be trained to get these  certifications.

1:07:26

They come in and they say, "All your people need to be certified Scrum  product owners.

1:07:31

Give me 2,500 bucks per person," and then they get a certificate at the end of  a two-day class that says they're a certified Scrum product owner.

1:07:40

It doesn't necessarily mean  they could do the job, it doesn't necessarily mean they could do product management, but let's think  about when we're talking about too should we adopt SAFe in general, should we adopt these things,  think about how these organizations make money.

1:07:56

They're selling certifications.

1:07:56

Of course they  want more and more people to adopt it. That's the idea here.

1:08:01

They're selling you this dream that you  just certify all your people and then you could be working on it.

1:08:07

They take all these people,  they put them in two-day classes or whatever, and they turn them out and then they say, "Go,  you're a completely new role."

1:08:13

It doesn't work that way.

1:08:17

That's not in the best interest of your  company, that's not really what we're looking for here, and that's why all of this stuff needs to go  deeper.

1:08:20

If you've done a CSPO class and you have that certification, it may help you get hired at  another large enterprise that is adopting Scrum and SAFe.

1:08:32

That will probably help you there.

1:08:32

If you want to transition into tech and go into the companies that we talk about, they're  probably going to look at that and say, "This person doesn't know what they're  doing. This is not here."

1:08:41

If you do know what you're doing and you did that for a reason,  because some people need that to get promoted, some companies actually require it, which is  crazy, but to get promoted or be that thing, I have tremendous sympathy for that, but you're  going to have to do a lot of work explaining in your resumes and stuff as you transition that  you know more than that.

1:08:59

You're not just a CSPO with a two-day class, you have done the work.

1:09:04

That's where all of this building up on your resume becomes really, really important.

1:09:09

It's not just about getting certified.

1:09:14

I had people ask me, they're like, "Can you  just certify product managers?" I'm like, "No.

1:09:18

If people take my course, I give them a  certificate of completion and as a completion."

1:09:22

You finished a course just like any other course,  but I will not certify product managers because I do not think you can ever say somebody is prepared  and able to do their job from a short class.

1:09:27

Now, there are some agile agencies that do a lot more  training where you have different levels, and what they would do is they would train people, but then  they would make them go do work and they had a coach that they worked with, and they go back and  forth and they could demonstrate that they could do the work over time to get to the next level.

1:09:52

It's almost like the PMP, the project management certification where you have to have time  actually doing the job.

1:09:58

That's different, that's a different type of skill, it's a different  type of certification, but if you see any CSPOs, it's typically a two-day workshop that they  went to and then got certified.

1:10:08

That's the difference with this.

1:10:13

I would say be careful if  you are a product owner wanting to be a product manager of just certifications.

1:10:18

All the large tech  organizations I know too, they're not looking for certifications in product management or product  ownership to hire people, they're looking for experience, but the organizations that might  not know what they're doing, they are looking for CSPOs, they are looking for that.

1:10:34

If it's required by your organization, you might have to ask, "Are we all well set up  here to do our best job?

1:10:39

Is this the place where I'm going to learn how to be a better product  manager?"

1:10:47

I also feel bad though for people because it's hard to be a product manager,  it's hard to get your foot in the door.

1:10:56

I'm so torn on it because there are organizations  that hire people with a CSPO and they require it, so of course if it gets your foot in the door and  it helps you do it, but if it's not going to help you and it's not going to put you on the career  path you want, I don't think it's worth money.

1:11:14

I think one interesting thread throughout  this whole conversation is rarely is a plug-in play-ish easy solution going  to be the answer to your problem, whether it's plugging in SAFe and it's  going to help us build great software, taking a class helping you become a great  product manager, be skeptical of that. Yeah.

1:11:32

There's no quick way to doing any of this, there's no fast track.

1:11:34

You don't get  to skip over all the hard things. Yeah. Bummer. Yeah. I wish. Yeah.

1:11:42

One question I wanted to clarify.

1:11:42

When you  come into an org and they have product owners, do you encourage them to get rid of  product owner as a title and role and make them product managers  or do you keep product owners?

1:11:53

I say that we should have a hierarchy.

1:11:53

I say that we should have a hierarchy. You  would have all product managers on a team, they would be an IC, individual contributor, so  they're either an associate product manager and that's if they don't have all the discovery  experience or maybe they know basic Scrum,

1:12:10

totally fine, you can be an associate product  manager, but if they don't know how to talk to customers, digest what the customers are  saying and turn that into a feature direction and a backlog and this is how we're going to  work, all that stuff needs to be in there. If they don't know how they should be measuring  things, you're not quite a product manager yet.

1:12:23

If they don't know how they should be measuring  things, you're not quite a product manager yet.

1:12:28

Associate product manager, and then product  manager, and then a senior PM.

1:12:28

A senior PM can work on a Scrum team as well or a  development team.

1:12:31

I do encourage them, I say, "Get rid of these two different titles  because it's confusing everybody."

1:12:35

I help a lot of people with career paths too.

1:12:42

I've  seen companies with 47 different titles for product managers because somebody in this  organization is called a product associate and somebody over here is a product manager and  that person is a platform product manager, and that person is a platform product owner,  and this person is an API product owner.

1:12:55

You can have product manager, senior product  manager, all that stuff, but I would not confuse people with the two different titles  of product owner versus product manager.

1:13:11

But importantly, there's a bar for who  is called a product manager because if you take a product owner as you've  said, and say you're a product manager, they're going to be a terrible product manager.

1:13:20

Your advice is make them an associate PM, and then once they reach a certain level,  they've graduated to product manager. It depends.

1:13:28

I don't say this as a hard and fast  rule because there are product owners out there who've been doing their job very well.

1:13:32

Just  because they have a title of a product owner doesn't mean that somebody can't do the job of a  product manager.

1:13:35

There are plenty of people out there who were just named this because a company  names them that and they know what they're doing, so don't look at that hard and fast.

1:13:44

When we  do this, we typically will say everybody's got product owner on their title, change  it to product manager, but we will go back and look at what is the actual skillset.

1:13:53

and look at what is the actual skillset. When I've come in to work with companies on transformations, what we typically do,  the way I get introduced usually is we come in and they're looking for some kind of  training for all of their product teams,

1:14:06

and then we bring in Product Institute and  we do our online training, Then afterwards I work with the organization, I say, "Now that  everybody's been baselined and trained, we have to figure out who is going to be a great product  manager and who's not," so there's an awareness. You know what's interesting? Once people figure  out what the job's about, a lot of them opt out.

1:14:19

You know what's interesting?

1:14:19

Once people figure  out what the job's about, a lot of them opt out.

1:14:24

When I did the transformation at Athenahealth,  we had 365 product managers and they all had different titles too, product innovation, all over  the place.

1:14:29

We turned them into product managers, we trained everybody, we gave everybody the  opportunity to learn, which I think is great, and then we gave them opportunity to  practice their skills.

1:14:38

What happened is at the end of the training, a lot of  people raised their hand and said, "Oh, no, no, this is not what I wanted to do.

1:14:44

I thought  it was very different.

1:14:44

I did not realize how much people work it was.

1:14:50

I have to go influence  these people, I have to do all this stuff.

1:14:50

This is actually not really what I wanted to do."

1:14:55

We found other roles for them that were what they wanted to do or they decided to leave.

1:15:02

That was up to them, we didn't cut anybody, but we moved some people into operations because  they wanted to be a little more heads down to find process. That was their thing.

1:15:12

We moved  people into data roles who were good with SQL and were good with data analysis.

1:15:17

We moved  people into user research roles because they wanted to talk to customers, but they didn't  want the responsibility and the accountability that came with the product management piece  because they realized it was so intense.

1:15:29

I've seen this happen a lot in large  organizations.

1:15:29

You baseline everybody, you show them what the role is and then you  let them go practice it, and then at that point some people will opt out and then you have to go  back through your people and say, "Okay. How do we level-set now? Who's doing really well?

1:15:43

Who's  not doing so well?

1:15:43

Which teams need to have more experienced people on it because they don't have  anybody to learn from?"

1:15:50

That's where we would say, "Hey, let's hire some ICs over here or a director  of product management who can help train these people and help them keep growing."

1:16:00

That's been  super successful.

1:16:00

I've seen people bring in some more directors, scattered them around,  and they've leveled up these product owners who were not necessarily doing great product  management and now they're doing fantastic.

1:16:13

I've watched fantastic leaders in these  organizations that are not software native or doing these transformations.

1:16:19

Bringing the right  person, you can make amazing product managers.

1:16:25

Give them a year or two and completely  turn it around. It's totally possible.

1:16:30

It's totally possible to take people and  train them, and I firmly believe in that, but you got to get them exposure  to what good looks like.

1:16:33

If you are in an organization and you cannot  see what good looks like anywhere, that's a red flag.

1:16:40

That's where leaders  need to look at their organization and say, "Do I have people with these skills interspersed  around so that everybody can start to learn, so that everybody can actually be on the uptake  of this and make sure that we are well-balanced?"

1:16:56

That was an awesome nuance and addition.

1:16:56

I'm just  looking back at all the things we've talked about.

1:17:02

We've covered so much ground, the history of  agile and Scrum and SAFes and product owners, we've gotten into all kinds of advice on  how to do this better as a company leader, as a product owner, as someone thinking about  even moving through product management.

1:17:14

Is there anything else that we have not covered that you  think might be helpful to touch on or wrap up on?

1:17:25

I think I would tell people to remember  that when you look at agile methodologies, and if you look at it with small agile, what  we are really saying there is we want to be able to move quickly and deliver great value  to customers.

1:17:33

If you embrace those principles, you're going to do well, but if you think  of agile as just a defined super cut and dry process where you have to follow  every single little step here and there, that's not going to serve you because you're  not getting back into why are we doing this.

1:17:54

There are some great agile coaches out there.

1:17:54

There are first principle approaches to doing great product work and doing great development  work.

1:17:58

They're there because they are not just selling Scrum, they are there to make people  better.

1:18:03

Those agile coaches I think can make great fantastic teams, and I've worked with a  lot of them, and I think they are really there to just make it a better environment for the  people who are working and to help the company produce better products. That's their whole goal.

1:18:18

Then there are people too who are wedded to this is SAFe and you will do it by the book.

1:18:24

This is  Scrum, you will do it by the book.

1:18:24

I'd be very skeptical of that because what's the end goal? What's their end goal?

1:18:28

Like I said, a lot of people out there get paid by certifying people  and by consulting on these processes.

1:18:36

McKinsey made a huge division to do this, and a lot of  SAFe was actually introduced to organizations from McKinsey and from large organizations,  consulting organizations like that.

1:18:47

They came in and they said, "Yeah, this is what you do.

1:18:52

I'll teach you how to do SAFe, I'll teach you how to do Scrum."

1:18:55

They have been building those  consulting agencies off of agile transformations.

1:19:03

We always laugh when I talk to other people who've  been doing transformations and coaches.

1:19:03

I go, "Why is McKinsey always coming in here  and doing this?"

1:19:08

I've followed them into so many organizations and I've been like, "Oh,  wow, they screwed this up. Let me go fix it."

1:19:17

There's always a saying that nobody gets  fired for hiring McKinsey.

1:19:17

McKinsey's big, people trust their name.

1:19:22

A lot of the people at  McKinsey haven't done this before, they've never been inside the organization trying to transform  it and stay there for a long time.

1:19:28

That's why I'd be really skeptical of who's selling that.

1:19:34

If you approach agile from a perspective of I want to be agile because I want to release  things quickly and get feedback from customers and make sure that that's great, look at  all of your processes like that and say, "Is that serving the best interest of our company  and our culture and our customers?

1:19:48

Is this making our customers proud of us?

1:19:55

Is this helping our  customers receive good value?"

1:19:55

If your processes aren't, fix them, change them, inspect and adapt,  ease a lowercase agile principle.

1:20:02

We should be looking at every process we do and saying, "Is  it working?"

1:20:09

, and not be afraid to change it.

1:20:15

I think it's important to highlight this can  work.

1:20:15

There are ways to reorganize the way you build product at a very large company where you  can actually deliver great product consistently.

1:20:26

You've seen that happen a lot.

1:20:26

Anything  you want to add there to give people hope? Yeah.

1:20:30

The biggest pushback I hear from large  organizations, especially ones that are not software native as banks or insurance companies,  whatever it is, is that we're not like Google, we're not like SaaS companies.

1:20:40

It's true, you're  not a SaaS company.

1:20:40

The way that you do it is going to be slightly different than the way that  Amazon runs or the way that Google runs.

1:20:46

I don't see many companies actually run the same, and just  because it works at Google doesn't mean it's going to work at an insurance company that's a hundred  years old.

1:20:56

That's okay, but you could still learn from people who've been producing software at  scale for many, many years.

1:21:04

You can still learn what makes them successful, and then you could  take some of those principles and apply them to your organization and then figure out where  we need to adapt.

1:21:14

That's what I would look at.

1:21:21

I see software strategies and digital strategies  becoming so intertwined into the strategies of companies in general, whether you're an  insurance company or a bank or anything.

1:21:32

They're becoming so heavily entwined in the  C-suite strategies.

1:21:32

The first thing I would say, and where I see a lot of companies struggle with  this is you have to make sure that it is thought of at the C-suite.

1:21:42

What some organizations do is  go, "Oh, no, that's IT work.

1:21:42

Let me push all the software strategy down."

1:21:49

If you're doing that,  you're missing out on innovation, and this is where the product role comes in and where I think  more organizations need chief product officers because they're the person in the C-suite saying,  "How can software enable us to be 10 times better and crush our competition, whether we're a bank  or insurance company or a pharmaceutical company?

1:22:10

What can we do with our software that's  going to put us ahead of the competition, that's going to put us ahead of the market?"

1:22:14

If you're not having those conversations when you're thinking of your long-term  company strategy, you're behind, you're behind because that is what every small  high-growth startup is doing that's coming out to try to disrupt these big companies.

1:22:28

The  big companies are successful, they have a lot of money so they don't have as much urgency as  sometimes these smaller companies do to change or somebody who's failing to change.

1:22:37

That's why  things are going so slow, but at the same time, if we don't pay attention to that and we're not  considering it, that's where the danger comes in.

1:22:46

I imagine people are going to have a  lot of questions and hope to get even more advice.

1:22:50

A couple of final questions.

1:22:50

Where can folks find you online if they want to ask more questions along these  lines, maybe get your help on some of this stuff?

1:22:57

Then finally, how can  listeners be useful to you, Melissa.

1:23:02

You can find me on LinkedIn.

1:23:02

If you go search for  Melissa Perri with an I, P-E-R-R-I, you'll find me there.

1:23:08

My LinkedIn is /melissajeanPerri.

1:23:08

I'm happy to connect with people there.

1:23:08

My school is called Product Institute, so if you're  interested in doing product management training or getting help with some of this stuff, go to  productinstitute. com and reach out to me.

1:23:16

I run a podcast too called The Product Thinking  Podcast.

1:23:21

We answer questions every week, and a lot of them are around SAFe, agile  and all these topics, so if you have a question and you're saying, "Hey, how do I do  this?"

1:23:30

, definitely reach out and let me know. Awesome.

1:23:35

Melissa, I learned a lot.

1:23:35

I feel like  a lot of people who listen to this podcast, they're like, "I had no idea about any of  this, and now I understand all these terms that I kind of hear occasionally."

1:23:41

Thank you  for coming and sharing all of this with us, especially the advice for folks  that are in this world right now. Yeah. Thanks for having me. Bye everyone. Bye.

1:23:55

Thank you so much for listening.

1:23:55

If you found  this valuable, you can subscribe to the show on Apple Podcasts, Spotify, or your favorite  podcast app.

1:23:58

Also, please consider giving us a rating or leaving a review as that really helps  other listeners find the podcast.

1:24:04

You can find all past episodes or learn more about the show at  lennyspodcast. com.

1:24:09

See you in the next episode.