Meta/Facebook Product Interviews: SUCCESS METRICS (Execution & Analytical)

👩‍🎓 Coaching 🧑‍🎓

Let's answer the product management and data science execution interview question "What success metrics would you set for the Facebook Groups" product?

👋 Connect With Me 👋

🎓 Interview Questions, Company Guides, Mock Partners 🎓

📚 Books to Prep for Product Interviews & Careers 📚

[Lovelyisyourstory]

I can’t thank you enough for all of your tips and for you taking the time to teach and prepare me for the FB interviews! I’m so excited to say that I got a FB offer and I certainly credit it to you.

Thank you for your personal sessions with me and creating relevant and real content that can’t be copied. I love your authenticity and your passion to help others excel.

[Prayandgrowrich]

Again can’t thank you enough for always sharing your knowledge! Can’t wait to share that I got the jobs because of your great tips

[e.w.]

Thanks for the video. Can you talk about how to prioritize the metrics? it appears in other frameworks but not mentioned here.

[yairgraif]

A metrics video for a video product could really help (Reels, FB live, Youtube). Thanks!

[Jarya]

Should we go through entire customer journey and then list out metrics at every steps ? Some interviewers may expecting this framework?

[Mayaadyby.]

I really like the way you are teaching & describing! It's so clear & understandable. I bet you are supper successful in your job👏

[TheDrhoff]

@Dianna Yau - First off - you are amazing! Second - This may have come up before, but in 2:21 Min you show the wrong visual i think - you are talking aobut FB groups but the screen shows description of the FB events instead. FWIW. Many thanks!!

[amirfakhim]

Hi Diana, great video. I have the follow up question. If the group product impacts the newsfeed product, this impact must be measured before the group product is launched to measure the impact level. How FB will react about this cannibalization? I am sure they do go though trade off analysis of the launching group product whether to launch it or not? Could you please elaborate a little bit?

[khaterehkhodavirdi]

Dianna thanks for sharing all the contents - super helpful. QQ: For FB newsfeed what should be the north star? 1- The number of active people per day (engaging liking, commenting, posting) or 2- Average time spend per user on newsfeed on a daily basis? Thanks!!!

[chetiz]

Thanks Dianna, I thought about this and thought that the HEART framework is equally effective. Is there a particular reason to choose Northstar Framework over the HEART framework or even the more ubiquitous Pirate Framework (AARRR)? See below example: I've left out Signals and Goals and dive right into the metrics.

Happiness: average rating groups, % of positive reviews
Engagement: # of likes/reaction/comment/sharing, # of group invites, avg. session length, avg. session frequency
Adoption: # of user joined, # of new groups created, group invite conversion rate,
Retention: # of returning users (interactions like/share/comment/post in past 7 days),
Task Success: search exit rate, bounce rate (user went to group but did nothing and left the page)

At the end of the day, I feel that the metrics have a big overlap and that Frameworks should be taken at face value: As a guide and there's no correct framework. Thoughts?

[Kb]

Hi Dianna, could you please share advice on how to pick and justify a time horizon for the metric?

[helenxlin]

Hi Dianna, thanks for making these videos - they are my holy grail as I'm prepping for interviews right now. Not sure if you're still actively checking comments on older videos. I noticed that not every metric you set had a grain of daily, weekly, or monthly (D/W/M).

My question is:

In general, because we assume that these are going to all go into a hypothetical dashboard and compared with/against each other, would you want all the metrics to be measured by the same timespan (D/W/M)?

[OnionKnight]

What if the interviewee isn't super familiar with the product? For example, in this exercise you mention some Groups have Join features, which might not be known by the casual FB user. How does the interviewee ask to clarify a product they are not familiar with?

[OnlySwami]

thank you for the vids again, Dianna. 

With regard to timing and say a 45 min Execution round - would your goal be to get through the same framework/narrative, but say in around 30-35 minutes? 

I'm guessing it would involve convo back and forth, some 1-2 min pauses to gather your own thoughts/metrics, other sub questions from interviewer...so this would naturally take up a good chunk of the 45 minutes.

Would you say the same applies for timing PS 45 min round as well? 30-35 min to wrap up bulk, and 10 minutes of buffer?

thank you - I haven't watched the last video in this playlist, so you might already answer this there as it relates to managing time

[airliu]

How do you choose what perspective to define your north star.... for example...
# of active groups vs # of people participating in a group

[nitant]

shouldn't time spent on newsfeed also be a counter metric?

[sharonosahon]

Could you please show us how you'd measure success for the 'Watch together' feature on Facebook messenger (via video call)? How would the metrics for the 'Watch together' feature differ for metrics for Facebook Watch?

[VenkatSattuluri]

Amazing video! so helpful!! thank you Dianna. How does this video only have 1.6K views?

[airliu]

How do you think about Average Metrics vs Total Metrics ... for example ... average # of active members per group vs total # of active members on the groups platform

[aasthathakur]

Hi Dianna, Thanks for the wonderful content. I have 2 questions - 1. Could time spent on Facebook group/ week be the North Star Metrics here? 2. Under downstream metrics, if time spent on Newsfeed does decrease due to launch of Facebook Groups (hence ad revenue reduces assuming only newsfeed shows ads and Group doesn't), then what will be next steps for a Facebook Newsfeed PM/ Facebook Groups PM?