Episode 208: Scaling Research Ops to Drive Organizational Change with Kate Towsey
In this episode, I sit down with Kate Towsey, an authority on research operations and author of "Research That Scales." We dive into the significance of research ops in aligning product strategy and operations within a company, emphasizing how research can provide strategic insights essential for product development and organizational growth.
Kate discusses the evolution and necessity of research ops, sharing her journey from content strategy to pioneering the field. She highlights how effective research ops facilitate knowledge management, ensuring that valuable insights are not just gathered but are used to inform business decisions across an organization.
Tune in to discover how Kate's insights can transform your approach to integrating research into product strategy and the benefits of a well-structured research ops framework.
You’ll hear us talk about:
08:20 - Solving Recruitment Pain Points
Kate elaborates on the common starting point in research ops: participant recruitment. She discusses how managing this aspect effectively can impact product managers, researchers, and designers by enabling more seamless customer interactions.
28:52 - Democratizing Research through Collaboration
Melissa and Kate explore the importance of collaboration between product managers, UX designers, and researchers. They argue that while each role has its specialties, working together can democratize research and lead to better product decisions.
42:40 - Breaking Down Silos Between Teams
The discussion turns to the silos that exist within organizations, especially between product marketing and product management. Kate and Melissa share strategies for overcoming these divides to improve customer insights and product outcomes.
Episode Resources:
Kate's book, "Research That Scales," on Amazon
Other Resources:
Follow/Subscribe Now:
Facebook | Instagram | Twitter | LinkedIn
Episode Transcript:
[00:00:00] Kate Towsey: It's like saying that water is your most valuable asset, which most organizations they'll say knowledge is our most valuable asset, but they're not building a dam for it and thinking of tributaries and understanding where it's going. It's just leaking and you don't even know where it's going. And then you're all sitting there thirsty all the time.
[00:00:15] When you're making the big decisions, you really need robust, reliable knowledge, being well, tested. And there are definite, like highly skilled people who know how to get that. But what we need to do as researchers look down the line and go there, lots of different forms of learning and forms of gaining knowledge, we cannot monopolize the relationship with the customer. What we need to do is operationalize it.
[00:00:34] The trick for an operations person, I'm sure you've experienced this too, is deliver some quick things, keep people on board, show them the long term vision and constantly try and encourage patience in getting there, because what you're building is not just something that's going to fly away the next day. It's like some real robust structuring that you hope is going to be valuable for a decade or two or three, even.
Intro
---
[00:00:56] PreRoll: Creating great products isn't just about product managers and their day to day interactions with developers. It's about how an organization supports products as a whole. The systems, the processes, and cultures in place that help companies deliver value to their customers. With the help of some boundary pushing guests and inspiration from your most pressing product questions, we'll dive into this system from every angle and help you find your way.
[00:01:25] Think like a great product leader. This is the product thinking podcast. Here's your host, Melissa Perri.
[00:01:34] Melissa Perri: Hello, and welcome to another episode of the product thinking podcast. Joining us today is Kate Towsey, an independent research ops advisor and educator. Kate formerly was a research operations manager at Atlassian, and she started research ops at the BBC. She founded the research ops community and the Cha Cha Club of global operations professionals.
[00:01:53] She recently published a book all about the great work she has been doing called Research That Scales: The Research Operations Handbook, which we're going to dive into today, as well as talk about how research ops helps product managers and how it works well with product ops. But before we start to talk to Kate, it's time for dear Melissa.
[00:02:11] So this is a segment of the show where you can ask me any of your burning product management questions. Go to dearmelissa.com and let me know what they are. Here's this week's question.
Dear Melissa
---
[00:02:20] Melissa Perri: Dear Melissa, in the early days of our product, our CEO and sales team pushed us to have a broad, complex system. The problem was that we were always being lean and not raising a series A or B.
[00:02:31] This put a lot of pressure on the team at the time, but we've managed to make it a relative success with some high profile customers, good retention and good ratings. Now we have customers who expect us to keep deepening in all areas. We still get pushed to build more features in more directions. What advice would you have for narrowing the focus without alienating customers and prospects?
[00:02:50] So one thing that's interesting to me here is that you say that all the customers want you to deepen in all the areas I would try to dig in here and try to figure out why, right? Like, what are they trying to achieve with the deepening? What are they, what can't they do right now that they would like to do?
[00:03:07] Figure out what that value is. See what you can actually deliver on for the company too, you need to have a strategy. If you were basically just building what the customers asked for forever, you're kind of setting the tone that you were like a consultancy, right? An agency that we're building them customer software.
[00:03:22] You have to change that relationship. Now it's still about understanding their problems and helping them get what they need from it. But you have to have some expectation about how you're not going to do everything. So your company needs to have a strong vision. And a strong statement about what you are going to handle and what you're not going to handle.
[00:03:38] So that comes from a strategy and from communication on that. And it sounds like that might be missing in the organization. I see a really common theme with a lot of startups where they'll build something and they might build something super complex, like you're talking about, and they'll go out and they'll try to sell it to everybody.
[00:03:53] You get a couple really big clients on there. And now those clients, so may have some similarities, but they might actually be different needs as well. So now you've got like client a saying, Hey, I need you to deepen in X, Y, and Z over here. And then you've got client B saying, you know, feature is one, two, three over here.
[00:04:11] This part of the thing is my problem. You want to go back and study what kind of people are actually using your product and what they're using it for and make sure that there's a firm direction there. Are you solving the same jobs to be done for everybody in a way where it's going to scale to a lot more users, or are you just kind of building piecemeal for the biggest users who are yelling right now?
[00:04:31] That's what you really want to figure out. Now, I've been in this situation too. I've worked with a company where I was setting the product strategy. And when we looked at all their customers and how much money we were spending on custom software, let's say for them, or responding to their needs, which weren't super strategic, we ended up putting together this document, which we called the sales debt of the organization.
[00:04:53] And we said, what did we contractually commit to that was off our roadmap or straying away from our vision? And when we looked at it, the. Largest company that we had was a huge amount of sales debt. Like we were building custom features for them because they were yelling the loudest. Now we still wanted to protect that revenue because we didn't want them to churn.
[00:05:11] It was a significant portion of it, but we had to go back and start to have hard conversations with them about what they really needed or start charging them more. So we said, okay, you could still have that, but the price is now increasing, right? This has to go up. So use the tools that are at your advantage here.
[00:05:25] If they want custom software, or they're asking for things that are off roadmap, can they pay to play if it's something that's in line with your vision? And if it's not in line with your vision, you have to be firm and say, we're not really going into that. That's not where we want to look at. So I would look at all of your customers and again , make sure that you have a good ICP, make sure you know who that ICP is and make sure that you're not just building for anybody who wants your product, but people that it's going to scale to, right? You want to make sure that there are other people who are going to want the same problems to be solved.
[00:05:55] So you can keep scaling in that direction. Having these hard conversations to a customers, they're, they're used to it. People who buy software, they're told no, no by other people all the time. Right. So you have to expect that they've had these conversations before. If you're solving their biggest problems, they're going to stay with you.
[00:06:13] If you're not solving their biggest problems, they will start to look elsewhere. So I'd look at your competition. I'd look at what else their alternatives are, but I'd also try to figure out if they're asking for all of these things, what's the value they're going to get from them and are they willing to pay for it?
[00:06:27] Right. That's really, what's going to come down to, that's going to help you prioritize a little bit more. But again, go back and make sure all those customers are not just a bunch of very distinct, very different types of profiles. Make sure that they're, they're a target customer that you can scale this stuff to others, and that's going to help you prioritize what to actually build.
[00:06:47] So I hope that helps good luck with this challenge and anybody else listening out there, please go to dearmelissa.com and let me know what your questions are. Now it's time to talk to Kate.
Kate Towsey's Journey into Research Ops
---
[00:06:57] Melissa Perri: Hi, Kate, welcome to the podcast.
[00:07:00] Kate Towsey: Hi, Melissa. It's so great to be here.
[00:07:03] Melissa Perri: I'm really excited to talk to you all about research ops especially because I'm getting a lot of questions about product ops and research ops. And I'm a huge fan of this field. So, Kate, you have deep expertise in research ops and you just wrote a book called Research That Scales.
[00:07:18] Can you tell us a little bit about what led you to research ops and what led you to writing the book?
[00:07:23] Kate Towsey: So like many people I fell into research operations the very short version of it is, is, that. I was a content strategist working in London as a consultant and Lisa Rakel, the eminent research leader I had done a project with her and she said, Hey, I need a content strategist in government, she'd moved on to, to working with the government digital service.
[00:07:45] At an amazing time in its history, the GDS was about 2013. And for me, I call this the Woodstock days of, of government because it was creative and innovative and a small agile team. It was an amazing place to be. So she said she was growing quite a big research team or bringing researchers together from across government.
[00:08:05] There were about 40 of them at the time. I think. Seem to remember and she realized that they were producing all of this amazing research content and the age old or the evergreen problem is it, was disappearing into the ether once it had been used. So she figured not unwisely that a content strategist might be able to come in and fix the problem.
[00:08:25] When I arrived, I realized as a consultant that I was not going to be able to fix the problem because it really actually needed a bonafide librarian or information scientist. And it was just a pale beyond the kind of skills that I had. But as a consultant, anyone who has been consulting will know you do not say that you've got nothing to offer when you've been, when you're in a contract.
[00:08:45] And so I ended up building a research lab for the GDS. I come from a music, you might see bass guitars and guitars and drums and things in the background. So I have a history in radio production, in music. And so I was, I thought this is great. I get to play in the audio space and, and build a very hi fi lab which I did.
[00:09:05] And then after that, we launched the GDS user research blog, which kind of brought in my editing and content strategy work there, then I got stuck into video libraries and then into participant recruitment panels, So I ended up just doing all of these different parts of at least the tooling aspect of research operations.
[00:09:23] And over the time I was writing blogs on the newly minted user research blog, the GDS blog, and people from across the world were reaching out from places like Etsy or Amazon places like that to have a chat with me about it?
[00:09:37] So by the end of about three years of working on these various projects And having a lot of fun with it as well I realized there are a ton of people who are interested in this work and are thinking about it, but there's no framework around it.
[00:09:49] There doesn't even seem to be a name for it. I was wrong about that. There was a name for it. But I, I started the research ops community, which I stepped away from in 2019 and brought all these people together to really kind of talk about what is, what is research ops. So that was kind of how I wended my way into this profession that is now widely known as research operations through the work of the, what is research ops project that, that I launched with the research ops community and all that kind of stuff.
[00:10:16] But many people. Don't kind of start in research operations. Maybe in five years time, people wake up and go, I want to be a research ops professional, but people come from social sciences, from hotel you know, the hospitality industry, from a lot of people from HR because they know a lot about, you know dealing with people and recruiting and systems oftentimes from service design, from research as well.
[00:10:39] So yeah, I'm just like one of everybody else has kind of found my way into this really intriguing space.
Understanding Research Operations
---
[00:10:46] Melissa Perri: So for people who are not familiar with what research operations is, what is it, how do you describe it?
[00:10:52] Kate Towsey: Yeah. I have, my definition of it has changed over the years. I look at it as the systems design that sets up all of the infrastructure services, everything that is the culture that is needed to enable not just a research team to shine, but to enable an entire organization, to benefit from the knowledge that engaging with customers or users generates really, that's what it's all about.
[00:11:17] Melissa Perri: And when you're thinking about why organizations need research ops, what problem does this solve?
[00:11:24] Kate Towsey: Again, my, my point of view used to be quite narrow. I think, you know, you will know this being a two time author. Writing a book is the best way to form your thoughts around something. And the reason it takes so long to write a book for me, at least, is because I go down all these rabbit holes around, what do we actually mean by research?
[00:11:41] What do we mean by operations? What do we mean by what we're doing? And so that's really broadened my scope in terms of. What is research even? And what are we doing with operationalizing research? And really, when you dig behind the the, the kind of rote phrases that we use, or the rote words that we use, it's all about knowledge and learning and specifically learning about what our Customers or end users for those who don't work in a customer centric organization, I'll stick with customer from now on, You know, what they need. so we, we wanting to dig up all that knowledge about what they need but digging it up is one thing. The next thing is like, enabling people to access that knowledge when they need it, because we all, it's what everything needs to be of the moment. And then more than that, we want them to Be able to absorb it easily.
[00:12:27] It, it appeals to them. It's easy to engage with. It's there at the right time and it. Draws into their central nervous system so that they
[00:12:36] have a deep understanding of that knowledge. It's within them now. It's their knowledge. It's no longer knowledge on a piece of paper or on a report or in a researcher's head.
[00:12:43] It's their knowledge. So at some point in the future, all of this knowledge is consolidated within them as the repository of it. And they can make really smart decisions. They might not even know where all these bits of knowledge have come from necessarily, which is a tricky thing for research teams. How do you draw the lines between an executive or a designer or anyone or a product manager making a brilliant decision?
[00:13:04] It might be something that they've picked up over multiple different experiences in multiple different ways.
[00:13:11] Melissa Perri: When you think about implementing research ops to an organization, where do people typically start?
[00:13:17] Kate Towsey: Implementing research ops in an organization, typically people will start with the most painful part. Most often that's participant recruitment. For everybody, whether you're talking about research operations for product managers in the product operations space, which is what I'm so intrigued by is, is really, you know, when are we all going to get together and just figure out this.
[00:13:36] The completeness of, of, of what people in product organizations, which like you're either service or a product, like we're all delivering the same thing. Ultimately it's all products and services. And so product managers have a hard time getting hold of, of people to talk to, to learn from them. Researchers do, designers do, And sometimes you know, execs or C suite.
[00:13:57] Heads up, they want to spend time occasionally. it might be sort of a quarterly ritual to spend time with customers and they will have a hard time doing that as well. And they want a certain type of VIP customer. So that's the biggest pain point that tends to innovate someone to think about operations and then, if they don't succeed on their own, because they get a wonderful tool in the place and in place, and it just doesn't quite deliver what they're wanting, and they might look at bringing in an operations person to sort that out. The second thing I'm seeing is a more recent theme, which is a wonderful thing to see is knowledge management.
[00:14:31] The very heart and soul of research is knowledge as I, you know, I've already spoken about and It's it's a madness to me. I've said this a number of times. I'll keep repeating it until it becomes not a, not an issue anymore in the profession. It's a madness that that is not the primary thing that we're thinking about.
[00:14:48] The entire point of research is to be able to gather knowledge
[00:14:51] and provide knowledge and yet we don't manage it at all.
[00:14:55] Very few people have knowledge managers in their team.
[00:14:58] But that is becoming more and more an impetus for getting research operations in places. How do we,
[00:15:04] how do we manage the knowledge that we're creating?
[00:15:06] It's not just about creating knowledge.
[00:15:08] How do we show value to the organization? Because we've managed our knowledge well.
[00:15:13] Melissa Perri: That is one of those critical pieces in product management that when I saw research ops be implemented, well, I went, oh, my God, why do we not all have this?
[00:15:23] You know, and it just makes it. so much easier to like, be able to read interviews that have already been done with customers. I might answer my question or be able to understand that if a team like all the way across the company did something already, they may have learned something that I need to learn too. And, it amazes me that at scale, so many companies just don't have that. It's just a free for all. You're like, Oh no, you have several hundred teams. like, they could all just be on an Island by themselves.
[00:15:50] Kate Towsey: Yeah, it's it's, like, saying that water is your most I've never used this analogy, so it might fail, but let's try it. It's Like saying that water is your most valuable asset, which most organizations they'll say knowledge is our most valuable asset, but they're not building a dam for it and thinking of tributaries and understanding where it's going.
[00:16:07] It's just leaking and you don't even know where it's going. And then you're all sitting there thirsty all the time.
[00:16:11] Melissa Perri: Yep, that's a great
[00:16:12] Kate Towsey: worked pretty well. Yeah.
Challenges in Conducting Customer Research
---
[00:16:14] Melissa Perri: Yeah, I like that. It's, it's so true. And where I've seen it struggle to is that especially for product managers, like, because the 2 parts that you're talking about, right? Because it's hard to get in touch with people, they just won't do the customer interviews. They're like,
[00:16:29] Oh, nobody's answering me. It's like, well, how many people have you contacted? Like five, six, like I can't get the opt ins, right. There's so much time that goes into actually recruiting people for a, you know, for any kind of research that they just give up a lot of times. And then we'll just be like, Oh, I'll send out a survey.
[00:16:43] I'll get five responses. And you're like, that's not the type of research we needed to do. So they won't do the research or somebody did the research or, and they don't share it. So in the absence of all that data, what happens to product management is they just like start making guesses.
[00:16:58] Kate Towsey: yeah,
[00:16:59] and because there's so much else going on and, and what I've loved about reading your book the most recent one is about product operations. I'll add that in is really getting an understanding of the you know, the wide remit of product managers in terms of managing business and thinking through all the numbers and it's running a mini company within the company.
[00:17:19] There's a lot to do. And then if you're going to have to be recruiting participants on top of that and it's really difficult to do. it, is going to fall off the back of the bus, literally, but what I feel is that, you know, sometimes I've seen where the relationship between research and product isn't a good.
[00:17:35] And when I say research, I mean, either the researcher that is within that team or the research. Organization as a whole, when that is not good and there's a lack of trust from product that the research coming out is relevant, well timed, true, trustworthy, all those things, then the relationship can fall apart.
[00:17:53] So even if there's a ton of research being done, if all those things aren't in place, particularly the timing or even the format of it if those things aren't really dovetailed to the product managers needs they still don't feel like they've got the research, but they're so busy, they can't kind of stop to try and fix it all because they've got to just keep rolling And running.
[00:18:10] Melissa Perri: yeah,
[00:18:11] Kate Towsey: the other thing that I think is really fascinating about product is that typically in organizations, particularly with the kind of rise of people who do research, PWDR and product and designers and researchers and everyone being empowered often by a research ops team to do research on their own.
[00:18:27] It's often lumped in a research ops person is hired and it's like, well, you must just build tools that everybody can use. It's a good start. It's better than nothing in place. But what I found is that product managers have very, very different needs, even just in the recruiting realm than a designer or a researcher would.
[00:18:45] I've said that so many times and I'm waiting for someone to pick up on it. What I feel, and I'd love to hear your, your point of view, Melissa product managers. They like need like a dating app for customers because busy when I go on to like a Tinder or Bumble style thing I want to filter and say, I'm interested in people who are battling with checkout at the, moment or dark mode.
[00:19:07] And Their profiles there and I want to speak to someone who's available next week And they can flip through and quickly find, I've already done the filters, quickly find that one person instantly hit a button, set up a date done,
[00:19:18] and maybe it's not like, a full research cohort with like analysis and synthesis and the whole nine yards, which takes, you know, a lot of time
[00:19:26] and, and skill that might not be natural to the product manager.
[00:19:29] They're getting to meet a customer and have a chat.
[00:19:32] On a regular basis without needing to go through
[00:19:35] the standard research recruitment protocol,
[00:19:38] which has come in, create your screener, take these boxes, do this filtering, brilliant processes for getting together a solid cohort for a full research study,
[00:19:47] but not great.
[00:19:48] If you're just wanting to
[00:19:49] bump into a relevant customer next week.
[00:19:53] Melissa Perri: yeah, I think everybody's going to be demanding the thing that you just described. So. I hope you want to build it, but I think like, so I think there's two phases of this, right? And the product managers who are usually launching a feature, let's say, or trying to figure out how to optimize a feature that might be out there or fix a unknown problem. They want exactly what you're talking about, right? It's like,
[00:20:15] I want to meet somebody who's experiencing this problem right now. And then there's the phase of like, probably where a lot of the user researchers come into, I'm building strategy.
[00:20:24] Right, so I'm, I'm actually doing this deep dive into our market segments and our customers and those you know, in those segments.
[00:20:31] And I want to understand deeply what problems do they have? What gaps are not filled? What our competition isn't doing what they love about our product, what they hate about our product, how they're actually using our product right now. Right?
[00:20:41] Like, are they using it in ways we didn't expect? Can we take that opportunity for this segment of the market and expand into it. If we, if we did it better with the product or if we marketed better, there could be leveraged those types of things. So there's that type of strategy for product managers, which typically I'd see like more senior PMs do like it's director level
[00:20:59] VP level. CPO level there, but some senior ICs will start a product or, or be in charge of that as well. Sometimes if it's like an innovation team or somebody building net new there, and in those studies, I think they want the targeted research. Like, you're talking about, , I need to talk to people in this type of persona, this type of segment. These people could be problem related. It could be anything like that. But then it's, let's go talk to 8 to 10 people. Let's digest it. Let's see if they have the same trends and go back on it. So I feel there's two, two different needs for. For, , the phase of product development that you're in.
[00:21:32] Kate Towsey: Yeah, that's that's really interesting. And what I'm seeing in terms of trends, I've spoken to a few people over the last few weeks, just to kind of sense check this and it seems to be coming through is not just a version of Kate's world, but something that is wider. And so what's happening is because of all the, layoffs in the last two, three years now.
[00:21:51] We're seeing, that the researchers that are remaining in organizations are being moved from doing a lot of tactical research. So they'd be going in And kind of doing the day to day Research for design or product or whoever. But they're being moved up into strategic research spaces, and that's where their time is being put. And then people who are doing research, the PWDRs are doing the sort of day to day research, which for designers would be more working on cohorts to do usability testing on, you know, They're working on for product. I'm wanting to just check in with customers, sense, check something that they're feeling right now.
[00:22:25] They need the dating app tool, but I wish someone would build I could probably be a billionaire if I build it, I built it, you know, and have that hard road of going through a startup, but I'm quite happy just being a consultant and author and a teacher. And so what's happening then is the agencies who would typically have been hired to do all that really strategic research.
[00:22:41] They're being oftentimes pushed out the top because the internal research teams are forging that more strategic relationship. Sorry for the agencies, but I do think this Is a really magical space because how does our tooling and our operations shift to enable researchers to really work hand in hand with product to do that amazing strategic research in a way that is
[00:23:04] Really timely, like when they need the, the information to put the strategy together, it's all there.
[00:23:09] It's including all the quant that they need, the quality that they need, and there's the full picture.
[00:23:13] And we're operationalizing the variety of people in a product team to be able to do the nuanced type of research that they need to do, not just across methodologies, are they doing a diary study, an unmoderated and moderated field research, but across who they are as a function.
[00:23:31] Like, as I said, designers work differently to researchers, work differently to product, which works differently to market research as well.
The Shift of Research Ops to a Strategic Role
---
[00:23:38] Melissa Perri: I like the, the trends that you're seeing, like, emerge here. And do you, do you, how do you feel about. Research being leveled up into the strategic part. And how, how do you think like, the research community feels about that? Is it like a good shift or is it a, is it like, no, we want to own all the research everywhere shift.
[00:23:56] Kate Towsey: I think there will always be people who were very comfortable with how things were. And don't necessarily want to change. And I think that's especially true. I'm late 40s. I'll be very happy to admit. And so I think that, you know, when you're coming to a part of your career, where you're like in the middle of it, if not like looking at the next 10 years of it, and then thinking, what would I do after that?
[00:24:17] And it's been very comfortable, like maybe you don't want the change so much. But I, think, and there's also just personality. Some people are just very happy with how things were and don't really want to change. But there are a lot of people who are going, wow, there's real opportunity in here.
[00:24:29] Researchers have been, I have heard endless numbers of researchers over the last 13, 15 years saying, oh, I'm just here doing like this sort of like feature testing all the time. And, you know, I've done so much study And I'm really skilled at doing more nuanced work. Well, here's the opportunity. I, think it's an incredible opportunity, and I think those that are willing to kind of look ahead and see the gap that is that is there and dive into it.
[00:24:56] And for me, what what it is is instead of research operations. I'm biased because I'm a research ops fan, of course, and guru. So but I think this is, you know, even if I put that aside, instead of bringing research operations as assistants, which has been a problem all along research operations is, I'm sure you will heartily agree is not an an administrative assistant job.
[00:25:18] It's about designing systems, understanding the business. It should be a strategic design role. And so when you bring in those sorts of operations folks to get them to do that work at a high level, And now you're looking at how we leverage research across the organization by enabling all sorts of people to meet with customers at the level that they need to spread the knowledge that they've got, enabling people to come to a really well, organized resource. and engage with the knowledge that we already know to come to events And immerse themselves in custom experiences, really
[00:25:51] well curated ones, all these levels of experience that you can create and bring people together, create culture around,
[00:25:58] and then we get to use our amazing honed, sometimes university degreed skills
[00:26:04] to do this highly strategic work that is going up to the C suite that's really having an impact on how the company.
[00:26:10] Runs and the direction it's going in.
[00:26:12] I think that is like, wow,
[00:26:14] like what an opportunity.
[00:26:16] I, I, I'm looking forward to the next five years when there will be people who grab that opportunity with both hands
[00:26:22] and really make a shift.
[00:26:25] Melissa Perri: I think it's fantastic for the research community too, because I usually get questions from people who are like, how can I justify the value of research? Right, or how do I, how do I justify my role? And I, I know I've also been told a lot that there's a ton of banks between the research communities and the product management communities
[00:26:42] because a lot of researchers were laid off. And because they were like, well, product managers can go out and talk to customers too. And there's a lot of people who are like, no, they're not going to do it right. Or they're not going to follow all the rules to do it. Like we're needed. And I've always been of the mindset that we do need good user research, but I, I have personally benefited from it.
[00:27:03] A lot, especially at the strategic levels, like, when I would go into organizations when I was an intern CPO, right, with products labs. A lot of times we'd have to figure out very quickly, what was the biggest problems for the customers in these organizations,
[00:27:17] like, they would be invested in.
[00:27:19] You know, through insight and then we'd go in and we're like, let's get the lay of the land. We're like, what are customers happy with? What are they not happy with? And how do we get just like a good snapshot of where opportunities are when it comes to product. And there I'd partner with a researcher.
[00:27:32] Who would go out and we'd say, we'd look through the product. We look through all the metrics and we'd come up with some hypotheses. And then she would go and target the customer segments that we wanted to talk to. Talk to 10 to 15 people and come back with a digest that was like, Hey, here's what's going on with our customers.
[00:27:49] Right? Like you're, you're wondering if you can move up market, or you're wondering, like, what's the different problems in a mid market segment versus the enterprise or if there's opportunity there, like, here's the customers that we talked to. These are like, you know, good. Some of these were not good personas.
[00:28:02] Like, we just cut them out, right? These ones were good ones. Here's the trends we're seeing. And we would evolve that into a product strategy, or we devolve it into a good spot for when we would hire full time CPOs and eventually, but for them to hit the ground running and understand like, hey, This is what my customers are feeling and to me, that was so valuable to have like a strategic researcher there because she could surface up the problems and, you know, talk to the customers and come back and like digest all these clips and help me be able to watch them.
[00:28:30] And we'd go back and forth and I'd be able to connect it back to the product side and the business side and say, Oh, you know, this isn't really what we thought it was going to be, or this was not what we thought. Intended, or there's an opportunity over here, and if we can leverage this, we could, you know, build X, Y, and Z to do it.
[00:28:44] And between the 2 of us, we could get to a really good spot with that product strategy, or like a good hypothesis of where to start or how to actually, like, prioritize a road map in the meantime. And I don't think executives are taking enough advantage of that with researchers.
[00:29:00] Kate Towsey: I completely agree. And I think some of that's been you know, research is still relatively young. I mean, tech is still relatively young, young in a way, but you know, I remember you know, like 15 years ago having big teams of researchers and organizations was not very common. I mean, aside from the, the Googles and the Facebooks and add to all those sort of spaces.
[00:29:22] Research ops, in fact, existed in those spaces 20 years ago. Just very unknown, but, and possibly not the framing that, I would give it off the sort of strategic design of services that will spread knowledge. Which almost sounds biblical, as I say it, I think. But yeah, it's, it's, As, as research, I do wonder, we've, it's been a tough time and I don't want anyone who's in the research space listening to this to go, I'm just kind of rolling over and going, that's all good.
[00:29:50] Like, but there's opportunity in everything that, that happens really. It's my optimistic view. And I think this has been a bit of a jolt to go, Certainly, it was a jolt for me to go, but right, you know, writing a book, I'm writing a line. Things are going great. Research is scaling. I started writing the book. it was like amazing. times. Everybody flying around snacks in offices. Just like, you know, teams growing And about halfway through sort of 2 years into writing the book. I started in 2020, 2022. Everything started to fall apart. And I'd been writing this very like happy book about how do you scale research?
[00:30:24] I have to, I rewrote half of the book because I had to have like a moment of reflection of like, wow, I'm writing a book about it's called research that scales and research is de scaling at a rapid rate around me. And why? Because I can't write a book about how you scale research, but I don't address why it's rapidly descaling.
[00:30:42] And so it's been a lot of soul searching to really look at like, what have we been doing? And I think a lot of that, you know, you mentioned, I'm sort of going in a bit of a circle around now about your comment, but you mentioned the word value earlier. How does how does research show value? And because research is knowledge, which is like this ethereal thing And the value, the real value you want to deliver is that someone has all of the knowledge within them, whether they got it from one report or multiple reports or many experiences, they have that knowledge to make smart decisions. And as you know, from your story, you you know, you had those decisions, you had those, all the knowledge you needed to make those strategic decisions and feel content that you were in a good space. So really for me, you cannot monopolize knowledge. You cannot say, well, I am the only person that should be spending time with customers. And I'm the only person with the skills to be able to do that. You can say that about specific ways of generating really reliable knowledge, because in that instance, in a strategic instance, and
[00:31:38] when you're making the big decisions, you really need robust, reliable knowledge, being well, tested. And there are definite, like highly skilled people who know how to get that out of the right place, people and blah, blah, blah. And that's sort of amazing stuff.
[00:31:51] But what we need to do as researchers look down the line and go there, lots of different forms of learning and forms of gaining knowledge, we cannot monopolize the relationship with the customer. What we need to do is operationalize it. That's pretty cool, little saying I should stick with that one.
Collaboration in User Research
---
[00:32:06] Melissa Perri: I love that like that, the little, the whole thing you just said, I thought it was amazing. And I couldn't agree more, like in the organizations I've worked with that have been the most successful. And again, I get these questions like, should product managers do user research or should user researchers do user research?
[00:32:23] And there's all this infighting, right?
[00:32:25] And I've always said from the beginning, it depends. Like you should be working together though,
[00:32:29] no matter what. And when I, same with UX designers too, because UX designers will say, well, I'm in charge of user research if there's no user researchers. So I'm like, no, nobody's. In charge of being the person who talks to users, right? Like you all have to talk to users, but you might choose to do different types of communication with users. Like if I'm a product manager, like you're saying, I want to dive deeper into a problem, understand how they're using something a little bit more and try to connect that back to like a business opportunity.
[00:32:57] Maybe I'm going to go do a one on one interview. Maybe the UX designer is testing the prototypes with people. Maybe
[00:33:02] the user researcher is doing strategic market segment analysis and diving into
[00:33:06] If there's opportunities there, what are the big problems and competitive analysis? Maybe the product manager is doing competitive
[00:33:11] analysis.
[00:33:11] It, nobody owns all of that, but I think if we all collaborate better, we could work
[00:33:17] better together on it. And I think research ops is really like a great way to start thinking about democratizing that research.
[00:33:25] Kate Towsey: Yeah. And I think you know, like the role that I see for a head of research, the most powerful role that I see. Is being, bunny is, the owner of. How knowledge is treated across the organization, again, customer knowledge, and so they can be designing because there are, you know, like the times to do a survey and there are times not to do a survey. there. are ways to gather certain types of knowledge that and I've seen plenty of examples where non researchers have gone: we'll just survey! And it's a terrible idea. It would be much better to have done like a qualitative study with three people then do that. And so this is where researchers have such great.
[00:34:05] Their own knowledge of, like, how do you gather knowledge in the most, like, most efficient and reliable way? How do we provide the pathways and services so that people who want to do that can go down the right path easily? And I think having a head of research who is. But all of that amazing methodology, knowledge in them, combined with strong operations who are strategists and designers together, they can work with all the stakeholders, with everybody, with product design, with everybody to understand what they need to learn when at what times of the year, what sorts of customers they need and layering on top of that within the organization, we're focusing on expanding to Canada, but we want to expand to female influences in Canada.
[00:34:48] Making something up and so how do we operationalize for that specific thing as well, someone who can have that overview of all of these pieces and then be rolling out the right tools and structures and training and pathways that it becomes easy for people to do the best that they can do because you're right, like product and research have been rubbing like the wrong way for a long time, long before layoffs in the augmented spaces that I've seen where it's like, well, because it feels like research, you're hanging out in an ivory tower.
[00:35:18] And they're trying to cut me off from the customers I'm trying to deliver goods to, and they're telling me that I don't have the smarts or the skills. To hang out with them and I need to do that in order to do my job well.
[00:35:28] So I think it's a really great time now for those relationships to, to shift in a, in, in a direction where everybody works together for the same goal, to understand customers, to make good decisions, ultimately for most companies to make more money and like to be bland for most people to be successful in my role, to get promoted, to have a nice life.
Right Tools to Scale Research
---
[00:35:49] Melissa Perri: I think it's going to be so good if we can get to there. So I'm hoping people are gonna listen to this and get there. When you were just talking about rolling out the right frameworks or right tools to be able to do this. What are some of your top life changing tools or frameworks that you've seen that helps organizations actually scale research effectively?
[00:36:10] Kate Towsey: so one of the key things is self service. It's a simple, simple thing, a self service model. I've seen many organizations who have wanted to scale research and there's two things that they're missing. The biggest one is a strategy. They want to scale, but they don't have a strategy. you can only scale something that is a system, only system scale. Research itself does not scale.
[00:36:31] In my book, it's cheeky. Not many people have picked up on this, but it's called research that scales. The very first chapter is it's contradiction. It says. Research does not scale systems do. And it's true. You cannot, research is not a thing. You can't point at research as knowledge. So you cannot scale it in that sense.
[00:36:48] And it's not even a repeatable thing. Knowledge is not a repeatable thing. It's always completely unique. And if it's codified. So, how do you scale it? Well, you have to build a system and the system has to be specific and then you can scale it. But for specificity, you have to have a strategy. So one of the biggest things you can do to scale anything.
[00:37:07] It's certainly to scale research is to decide, what is our strategy? What are we doing more than we're doing? You know, what are we not doing? Where are our priorities? Strategy is a tricky word because it's so misunderstood. So often you'll see even big companies who have got these hand wavy future focused strategies that mean nothing really.
[00:37:28] And when you dig underneath, if you happen to kind of be invited to dig in, you'll find that there's no grounding. Like they haven't done any planning as to how they'll actually deliver the strategy. It's just some. Vision for the future, a strategy is really just what is our opportunity right now that we're not, that we can grab and we should prioritize to grab because it's going to do some amazing stuff for us.
[00:37:49] What are the things that are blocking us or frustrating us or slowing us down? Let's get together a practical plan to fix them. It is literally that simple. And so in a research context, or even in any, any context, product design research, where you need to learn about your customers and you're finding that you've got a problem and you're being blocked, have a look at why you're being blocked.
[00:38:12] Let's go to that common one recruiting. It takes too long. We've got to work through this. This is a common one for product. As we mentioned earlier, it takes too long because I've got to go through this tool. I've got to do screeners. I've got to select blah, blah, blah, blah, blah. In order to find one person to talk to next week, come up with a strategy. What is your plan? How are you going to fix it? If that is your biggest problem, and it's the thing that's stopping you from learning so that you can make progress in, in, in direction of the product, then that's what your strategy is. We're going to prioritize that and fix it. Number one thing, once you've got the system and once you're building the system, you can build scaling into that.
[00:38:46] The other thing just on the note of scaling is it's often thought that everything has to scale, especially in our world, which is faster, bigger, everything must be faster and bigger all the time. Not everything has to be scalable. It's quite, it's hard work to make something scalable. So you might look at a system and go, actually we're, we're recruiting VIP customers and it's always gonna be a small cohort.
[00:39:08] It's gonna be like two customers a month, 24 people?
[00:39:11] a year. This is not a big system. It doesn't even have to be scalable. So to be very careful about what you actually decide to scale. It's very finally cause I could talk about these things for ages. And I'm one of my promises to myself is to get more succinct over time.
[00:39:25] But the final thing is what often happens is that people hire someone to come in and, and offer recruiting. And they will set up full service systems as in someone will, I did this, this is the only reason I know about this is that I did this six years ago. I hired someone to come and do full service recruiting for all Atlassians when I was still running the research ops team at Atlassian.
[00:39:47] It is completely unscalable and very, very expensive. And, so really your first port of call for delivering scalability and organization, once you've decided what you actually want to deliver is to set up systems that are self service as a start. Allow a canteen style service. right? at the beginning, you'll deliver something that's pretty basic.
[00:40:06] It won't be everybody, you know, you're not, it's not a restaurant. You come in and order exactly what you want or for the a la carte menu. You kind of get what you get
[00:40:14] if you're vegan or gluten free. I'm gluten free.
[00:40:16] Sorry. You're probably not going to be catered for right now. That's coming down the line, but you'll have something.
[00:40:21] Just something to get you like from nothing to something and then later on, you can start to understand where do we need to offer a bit more service here? We need to put in special dietary requirements, or we need to put in an a la carte offering for the special people who come for this particular thing.
[00:40:39] And so really to start slowly with self service, and then look for the opportunity to offer a hybrid or full service later on.
[00:40:47] Melissa Perri: When you were at Atlassian, where did you start? What was your like, Small thing. that you put out for people?
[00:40:52] Kate Towsey: Small thing. Well, once I shut down the full service recruiting system, that was like, not even a system. It was like, I realized pretty within 3 months. It was going to be a complete fail and swallowed my pride and shut it down. The 1st thing was getting a blessed these days. There's so many amazing recruiting tools out there which are designed to work with the sort of research design requirement.
[00:41:15] But it's a start. and so we hired, we procured one of those, set it up as best as we could put in some basic training around privacy, you know, like what is a consent form? How to use a 20 minutes on demand training. we didn't even have to be there. Once you did that training, you could get access to the tool.
[00:41:31] Cause you've got like a little certificate that was handled by it. We didn't even have to do it. and so you were opened up without needing to find money. It was all paid for already. We'd already got forecasted and got all the funds in place for it. You could go And then you could start recruiting people pretty quickly and easily not perfect, but a really good start.
[00:41:51] So that's the number one thing. If you're looking at recruiting with knowledge management number one, hire a librarian, a real librarian who actually knows what they're doing with like taxonomies and structured taxonomies and, and you know, someone who's studied this for five years and really understands the whole thing.
[00:42:07] And she put up a Google spreadsheet initially.
[00:42:10] Which for her was quite like, you know, that's a step down from running a real research tool, library tool but it was a great way to just start gathering all the information we have and also,
[00:42:19] Understand what are the you know, like an MVP.
[00:42:22] What are the
[00:42:23] sort of,
[00:42:23] you know, lean operations,
[00:42:26] what, what are people's needs around knowledge around the organization? and eventually we moved into a bona fide research library tool. So those are the, you know, speaking of recruiting and knowledge management being the two biggest things?
[00:42:38] you can start out pretty simple.
Research Ops and Product Ops Synergy
---
[00:42:40] Melissa Perri: When you think about research ops and product ops, right? So I've written the book a little bit about the research ops function and you know, what we did at Athena health and what Jen Cardello implemented there. And then at Fidelity how do you think these things will work together? I write in the book, if you have a good research ops teams, please do not reinvent the wheel. What can research ops do to work better with product ops and how do you see the divides between these things?
[00:43:06] Kate Towsey: Yeah, I wish there wasn't a divide at all. I think there is currently a divide because they're, they're both pretty emerging spaces and people are still getting to grips with what they're doing, nevermind with what others are doing, but I am seeing more and more research ops folks asking about product ops and trying to understand.
[00:43:23] I see that products have got such a strong muscle around business acumen. MBA level business acumen. We don't necessarily have that we need that. So that's a great exchange. We've got a huge amount of muscle around data privacy and. around the system set up to be able to recruit participants, manage knowledge move knowledge around the organization, socialize things, set up cultures around knowledge exchange that I am, I think could be very useful to you.
[00:43:52] So really. It's a yin and a yang. And once we all get to see that, we can come together and work in harmony. I know in your book, product operations, one of your pillars is, is a research and insights. I finished reading a couple of months ago. Yeah, exactly. And that's where we sit. So, you know, one of the entire pillars is research operations.
[00:44:11] So I foresee, and this is happening already. It's not like this is like looking way down the line that more and more Teams are created that have product operations, research operations, and then design operations,
[00:44:25] Working like absolutely.
[00:44:27] Like dovetails, there's just no distinction between them as one team that enables an entire developed product organization to have the knowledge that they need,
[00:44:36] have the business Intel that they need to be able to make good decisions.
[00:44:39] And all the, design,
[00:44:41] you know, the design operations folk, they do such interesting stuff too, within terms of getting the, designers Figma and all the practices and structures and design patterns and design systems that they need to be able to do their work really effectively. Yeah.
[00:44:52] It's an amazing trio.
[00:44:54] Why we don't see this more and more often. I don't know.
[00:44:56] Melissa Perri: Yeah, it's kind of similar to the trio that we think of with the user researchers, product managers, and. You know.
[00:45:04] Or designers, I mean, product managers and engineers, but user researchers in there. And there are 2, I feel like we all have to work together as a product team. We'd say 2 in the product ops world, go work with sales ops people, too.
[00:45:16] I think you pull them into the tree, like you pull them into the ops group. Maybe we need like an ops guild,
[00:45:21] Kate Towsey: I think we do. Cause there's, there's also like marketing? tech, you know, like my tech
[00:45:25] Melissa Perri: Yep. And
[00:45:25] then there's the, the market. So the, the customer and market insights piece, like there's the market research piece and people always ask me, what about product marketing? And I'm like, if they're doing that piece, let them do it.
[00:45:36] Like, I, I, I don't, I don't have a full ownership over like who does what, as long as it's done in a way that actually helps product management sometimes when those things get siloed, like we were talking about with user research and it becomes like a us versus them thing. They're not thinking about designing or doing in a way that can be leveraged by product management.
[00:45:54] And sometimes there's product marketing team. That's like, no, we do all the market research.
[00:45:58] And you can't, you can't come to us and
[00:45:59] ask for it. Like we're just out there researching.
[00:46:01] You're like, well, that's pointless, right? Like we have to do this together and then we can form a hypothesis and then we can both go look at it
[00:46:09] and you can give me insights.
[00:46:10] And that might spark me to. Actually, start to think about other trends I've been seeing and then we form a hypothesis together and look at it
[00:46:16] and I think we need to get away from those divides. So many companies, I feel like just get so functionally aligned.
[00:46:22] Instead of remembering if you, especially if you're a SAS company, like, you build a product.
[00:46:28] And you sell it. So, like, we're
[00:46:29] all not just. Working towards that product or trying to make that product better or any of that, like trying to make our customers happy with that. Like, what are we doing? Why are we all,
[00:46:38] there's no, there should be no competition.
[00:46:40] Kate Towsey: Yeah. I mean, I might get shot for saying this but you know, I say things anyway. I think there's also need a need to accept that product managers are the top of the pile in the sense that product managers are making the decision. They're managing the product. and it really is about giving the product man.
[00:46:55] This is my understanding. At least correct me if I'm wrong. It really is about giving the product manager the ability to make the decisions along with C suite level and founders and people Like that. I'm not saying that they're the end of the road. Everything really should be pointing to in terms of research, pointing to enable.
[00:47:12] Yes, sure. Designers, researchers are not researching to make decisions. They're researching to understand, to enable others, to make decisions. Designers need to make design decisions. Product managers need to make decisions about, the direction of the product That's really, for me, I'm like, why are we not all working towards that? and then marketing, of course, marketing and product need To align. And oftentimes you hear that they're not aligning very well on the direction of the product versus the marketing that's going on, why company organizations are big. And we all get stuck in our little space and it's easy, like for someone, it's easier for someone like me who doesn't, I don't work in an organization anymore.
[00:47:49] And so I get to kind of hover above the breadth of companies and have a look down and kind of go, why are we not all working together? It's because I'm hanging out in outer space. It's the same as people going to outer space. And then they say, Wow, you just see that the earth is one and we don't have all these boundaries, but then you come down to earth and you travel back to your little home and then you're just back into your little world again.
[00:48:09] So, it's maybe, you know, like Melissa, it's like, we do have that guild or something,
[00:48:14] which is something of stepping away, coming to outer space just for like 2 days to basically see that really big picture again.
[00:48:21] Of how we can all be working together to achieve what we all want to achieve,
[00:48:25] which is ultimately success and more sales and, and, and like
[00:48:30] abundance for all, if you work, in a a for profit company.
[00:48:33] And, if you work in civic spaces or in, in charities,
[00:48:37] even then you want to be delivering more value for your sponsors, for your donors.
[00:48:42] Melissa Perri: I think that would be a beautiful world that I would like to live
[00:48:45] in. And I want, I want us all to get there. And I think like for me, I keep pushing product ops and I don't know if you're getting this feedback too, but a lot of people will look at this and be like, Oh, these are just people about processes and systems and stuff.
[00:48:57] Like, they're not really thinking about, you know, the core of the product and delivering value. To me, I think it's naive to think that we can't talk about process like an organization to get things done, especially in large organizations. Like they have to have some kind of system, some kind of process on how you work, like, otherwise it's a free for all. And, but I just keep hearing this pushback of like, do we really need this? Do we really need that? And in my
[00:49:21] experience, In organizations that don't have these things that we're talking about, research apps, product ops, being able to like, see this data, understand your customers, they fail because it's like, you know, they do not do well, or they're hanging on by a thread.
[00:49:37] Like, they may not failed yet, but they're not doing well. Right.
[00:49:40] And then the ones that are implementing all of these things are creating these systems. They can tell you exactly what their customers want, right? They're so in tuned with them. They're able to deliver value faster.
[00:49:50] Kate Towsey: I think some of that's because operations is not always like an instant. It's not always instant. When you're trying to deliver operations from scratch, you're looking for A low hanging fruit, quick fixes. I said earlier to kind of show value early on. You can't say, you know, inviting people to a party and then going, well, you're just going to hang out for a couple of hours while I cook this amazing meal.
[00:50:09] You give them hors d'oeuvres or something. It's not the full meal, but it's something just to keep them happy. Glass of champagne. Everyone's happy. And it's the same when you're setting up operations from the start, look for something pretty easy, not perfect, but it's just a snack to give Keep, keep people satiated for a little while, but the big changes and the big value comes sometimes a year or two down the line.
[00:50:29] And so when you start collecting data, for instance, within 3 months, it might not necessarily be the most robust data you've ever seen and all the effort you've put into standing up the tools and the processes to collect that might seem like it might have been a waste of time. But a year down the line, you've got some interesting things to look at.
[00:50:45] Two years down the line, you've got something that might look like a trend. Three years down the line, you're seeing maybe some really interesting patterns in there. and I think that's the really big piece around ops is it needs that strategic long term vision. It needs an enormous amount of patience to get to the point where you're at the processes and the systems are delivering things.
[00:51:05] And that's not just even in terms of data, but also culture.
[00:51:09] Like you've managed to shift the needle on how people see their relationships, how they see,
[00:51:15] how they learn, how they understand how you engage with customers. These things don't change overnight. And so the trick for an operations person, I'm sure you've experienced this too, is Deliver some quick things, keep people on board, show them the long term vision and constantly try And encourage patience in getting there because what you're building is not just something that's going to fly away the next day.
[00:51:37] It's like some real robust structuring that you hope is going to be valuable for a decade or two or three, even.
[00:51:44] Melissa Perri: Cute. Great advice for people out there who are trying to spin up research ops. If people want to learn more about you and buy your book, research that scales, where can they go?
[00:51:54] Kate Towsey: They can go to easy: katetowsey.com. That's T O W S E Y, S for sugar. You'll find on there my book you can buy it from Rosenfeld. com as well, or Amazon on there. If you buy it from Amazon, please leave a review at some point when you've read it. And I'm going to get to 50 reviews at some point soon. Yeah, that's the primary way. I'm also on LinkedIn.
[00:52:16] Melissa Perri: Great. And we will put all of those links in our show notes at productthinkingpodcast.Com. Thank you so much for listening to the product thinking podcast. We'll be back next Wednesday with another amazing guest. Make sure you like, and subscribe this. And if you have any questions for me in the meantime, go to dear Melissa.
[00:52:30] com and let me know what they are. We'll see you next time.