Wait. Who is hipages?

hipages is the online platform that connects Australian homeowners with trusted tradies to simplify home improvement.

Background

The Early Tenure Team at hipages discovered a major user & business problem during research calls with tradies, where a common problem was identified; 

Tradies were not communicating quickly enough with potential customers, thereby missing out on winning work that could have, in turn, increased their risk of churning.


When comparing this problem with others that might lead to tradie dissatisfaction, the team decided to focus on the response speed of tradies as they hypothesized that mitigating this problem would lead to more active tradies & help them win more work. Plus, fixing the issue did not require any complex changes to the overall product.


Period

2 quarters

2022-2023

My Role

As a sole Lead Product Designer in my team, I was responsible for the end to end process and contributing to the product roadmap & strategy.

Team

Product Manager, Engineering Manager,

Tech Lead,

Data Analyst,

Marketing Manager,

Additional Developers



Product Manager, Engineering Manager,

Tech Lead,

Data Analyst,

Marketing Manager,

Additional Developers

Tools

First, let’s zoom out.

How was the high-level problem discovered?

Initially, the team’s focus was to improve the experience of early tenure tradies on the platform. I began by conducting interviews and reviewing user data to understand where the most significant user problems lay during the Tradies’ early tenure, which could lead to reduced engagement and eventually churn.


This was a key high-level research piece to be done. However, if you would like to read the final project in more detail, please scroll down, as the chosen problem was identified through the research later on the page.

Initially, the team’s focus was to improve the early tenure tradie’s experience on-platform, I began by conducting interviews and looking up user data to understand where the biggest user problems lay in the Tradies’ early tenure that could lead to reduced engagement and eventually churn.


This was a key high-level research piece to be done, but if you want to read the final project in more details, please scroll down, as the chosen problem was identified through the research later down the page.


Initially the team’s focus was to improve the early tenure tradie’s experience on-platform, I began by conducting interviews and looking up user data to understand where the biggest user problems lay in the Tradies’ early tenure that could lead to reduced engagement and eventually churn.


This was a key high-level research piece to be done, but if you want to read the final project in more details, please scroll down, as the chosen problem was identified through the research later down the page.


The Key Results we aimed to achieve were:

The Key Results we aimed to achieve were:

Lagging metric:

  • Customer churn


Leading metric:

  • % of tradies who are active (split by tenure and renewal segments)

01

01

Research

Both quantitative and qualitative research methods were conducted.

The goal was to understand the full Tradie user journey end-to-end with the highs and lows, especially focusing onto the first 30 days onboarding stages.


Over multiple weeks, we talked to 91 tradies and 13 homeowners and wanted to find out:


  1. Why was there a reduced churn rate during early days so early on, especially on lower tiers?

  2. What led to the reduction in the frequency of tradies paying for work leads?

  3. How were these problems experienced on the platform?

13

Homeowners

91

Tradies

02

02

User-journey

Over the course of the 4 weeks worth of interviews, I created a user journey map to better understand the Tradie lifecycle, focusing on the first 30 days and outlining: 


  1. What are the key lifecycle phases (from acquisition, through to activation and engagement)

  2. Where, when and how do Sales, Marketing, Service and Product communicate with the tradie

  3. Product screen flow (Tradie & Homeowner journeys via app & website)

  4. Tradie & Homeowner thoughts during lifecycle

  5. Tradie & Homeowner's change of emotions

  6. Quantitative data highlighting key facts in each stage

  7. Biggest pain points & delights & needs synthesised from interview analysis

  8. Potential opportunities for product improvements 

After speaking with the internal customer-facing teams as well as tradies, it became clear that one of the most significant problems we kept encountering was the low win rate of tradies, which eventually led to churn. After digging deeper and talking to homeowners about the potential causes, a major contributor was that after a Tradie accepted a job lead from the homeowner in the app, Tradies were not reaching out to them quickly enough or at all, therefore, missing out on jobs due to the highly competitive nature of the platform, which left homeowners frustrated.


03

03

Pre-EOFY Product Strategy session

Leading up to the EOFY Strategy meeting, I was asked to gather my research insights on customer needs and goals and identify the most significant opportunity areas


To ensure the above problem was a valuable issue worth focusing on, I reviewed additional data to provide more context and detail.

I then prioritised these problems and built a linear progress graph to explain to stakeholders in a pre-EOFY product strategy session how these problems contribute and relate to each other, as well as other opportunities within the problem space.


1.

Tradies did not understand the features and their potential on the platform. (During Onboarding phase)

2.

Tradies did not know how to sell themselves (During first 1-3 months)

It was clear during the phone research that many tradies did not introduce their business and themselves properly. 


We knew we had found a space with an opportunity to improve in the “Communication & follow-up” problem space.


We decided to focus on the second problem “Tradies did not know how to sell themselves” which was often the case in the first couple of months of their hipages tenure. 


In the visualisation below I outlined the range of opportunities we were choosing between and also show some underlying causes for the chosen problem: “Tradies did not know how to sell themselves”


What we heard from tradies:


“ I didn't know I needed to call within 5 minutes and not wait for the client”


“I don't know why consumer is not calling me”


“I don't know how to professionally interact with the consumer..”


“I didn't know I needed to follow up”


“I didn't know I introduced myself & business properly”




“ I didn't know I needed to call within 5 minutes and not wait for the client”


“I don't know why consumer is not calling me”


“I don't know how to professionally interact with the consumer..”


“I didn't know I needed to follow up”


“I didn't know I introduced myself & business properly”


“ I didn't know I needed to call within 5 minutes and not wait for the client”


“I don't know why consumer is not calling me”


“I don't know how to professionally interact with the consumer..”


“I didn't know I needed to follow up”


“I didn't know I introduced myself & business properly”



04

04

Ideation session

Next, I organised an ideation workshop with the broader team & stakeholders to brainstorm potential solution ideas and see how each solution could also contribute to improving other problem spaces.


Some solution ideas were generated:


  1. Teach the tradies what the best practices are to win work, such as nurturing customers and getting people on the phone earlier. 

  2. Explain early in the signup process how leads are converted and the value of contacting customers.

  3. Help tradies leave professional messages in the hipages message centre with suggestions and templates that offer options for personalisation.

  4. Provide email templates for tradespeople to use when sending to consumers.

  5. It would be worth exploring the offering of a richer trial / freemium pathway for our tradies, coupled with an onboarding experience to ensure a successful first engagement.


05

05

Team strategy pivot

At this time of our journey, the team driven by me decided to pivot because the upper management realised that we did not focus on the most critical issues indeed (partially because of external pressure), so now that I broke down the most significant problem areas with facts while outlining the key opportunities, we made a pivot. 


That meant that our objectives became: 

  • Objective 1: Increase Tradie Engagement

  • Objective 2: Increase Tradie Trust of hipages

  • Objective 3: Help tradies get more value from hipages


The Strategy is now focused on onboarding tradies from day 0, identifying critical actions such as contacting customers, claim experience and profile completeness. We also considered:


  • How can we use a Hook model to increase? Engagement, incentivise & reward the correct behaviour?

  • How can we create a multi-channel onboarding approach with consistent messaging across all touch-points?

  • How can we adopt an iterative approach versus a “big upfront design”?

Understanding the ‘Tradie Response speed of contact problem space

01

01

Research Analysis

We decided to first focus on Objective 1: Increase Tradie Engagement.


first, I’ve interviewed 28 tradies to understand the exact steps tradies take after accepting a lead. Also tried to understand the tactics of power users on how they sell themselves and win jobs for their business.



We decided to first focus on Objective 1: Increase Tradie Engagement.

Firstly, I’ve interviewed 28 tradies to understand what are the exact steps tradies make after accepting a lead. Also tried to understand the power users’ tactics on how they sell themselves and win jobs with their business.

of them called the consumer within a few minutes.


of them called the consumer within a few minutes.

25%

of them called the consumer within 2 hours, unless if it was an evening and called the consumer the next morning.


of them called the consumer within 2 hours, unless if it was an evening and called the consumer the next morning.

57%

didn’t know they need to call the consumer.

18%

At the same time we also looked into data to better understand the quantitative facts.

Source: Looker Data Report. Time to Response (last 6 months) - claim to response in the last 6 months

Source: Looker Data Report. Time to Response (last 6 months) - claim to response in the last 6 months

Looking at claims over the prior 6 months, we saw that 32.7% of tradies didn’t reach out to the consumers via the Message Centre (but may be SMSing the customer instead) and another 12.6% were reaching out to the consumer after over 3 hours from accepting the lead.


Looking at claims over the prior 6 months, we saw that 32.7% of tradies didn’t reach out to the consumers via the Message Centre (but may be SMSing the customer instead) and another 12.6% were reaching out to the consumer after over 3 hours from accepting the lead.

When looking only on Early Tenure (last 6 months) the picture is quite similar:

Source: Looker Data Report.

ET Time to Response

02

02

Team focus

Our goals were to ultimately change the long-term behaviour of tradies but we also needed to observe them using the product with the new experimental designs and measuring the impact & outcome of the delivered solution.


Given the fact, tradies were doing well, where 52.4% of tradies had good contact behaviour, that did not satisfy us. Still, 27.9% of tradies had not reached out to the homeowners at all, so we wanted to improve their response speed rate: 


  • Continue to discover and explore different methods to gather quantitative and qualitative insights into the tradies’ & homeowners’ biggest problems, barriers and needs.




  • Run experiments to test the hypotheses and learn how we can achieve change in bad user behaviour and achieve the outcomes we want.


Constraints

The team had limited time to produce experiments, as the company expected them to build and release them at scale within 2-3 months. Additionally, some team members were not yet familiar with the problem space and lacked experience with experiments. 


03

03

Successful User & Less successful Tradie journeys

Based on the latest insights and previous interviews I have done with more than a 100 users by then, I created a power user ( successful tradies = tradies who succeed in winning jobs ~ 20%) journey outlining the key steps these tradies take in order to win more work. I also created a journey for tradies who tend to churn early on and compared the two flows.


04

04

Solutions Prioritisation & Selected Experiments

Knowing that those tradies who claimed a job lead, 27.9% of them had 0 contact with the consumers, we decided to target this Tradie Response Speed problem.


After generating some low and mid-fidelity designs and exploring potential solutions for it, we were able to prioritise our ideas based on their value vs. risk, deciding to run experiments on the following ideas:


  1. Rearrange accepted lead card buttons to highlight the call button as the most important action we wanted the tradie to take after accepting a job lead.

  2. The first time a Tradie accepts a job lead, call out the ‘call icon’ and ‘message button’ with a tooltip to highlight the next steps which we want them to take.

  3. Check to see if the Tradie had managed to contact the customer via a notification 10 minutes after accepting the job lead.

  4. In the Message Centre screen call out the next best actions after a job lead was accepted.

Released Experiments

We have chosen to go with the following solution which we turned into our first experiment.


Tradie Response Speed Experiment - Version 1

#1

#1

We have chosen to go with the following solution which we turned into our first experiment releasing it to small cohort of users.


Problem

Tradies don't communicate quickly enough after claiming a lead, or don’t communicate at all after a claim. They don't realise they need to respond immediately after accepting the job lead via SMS, phone, or in-platform messaging to remain competitive.




Tradies don't communicate quickly enough after claiming a lead or don’t communicate at all after a claim. They do not realize they need to communicate immediately after accepting the job lead via SMS, phone as well as in platform messaging to be competitive.


Tradies don't communicate quickly enough after claiming a lead or don’t communicate at all after a claim. They do not realize they need to communicate immediately after accepting the job lead via SMS, phone as well as in platform messaging to be competitive.


Hypothesis

Because we were aware of the high no-contact rate, we spoke to tradies. Many of tradies who didn't make the first call with homeowners after accepting a job lead, it wasn’t because they were not able to but didn't know how important it was for them to take action on that, therefore we believed that by prompting & educating the tradie on the importance of quick contact after accepting a job lead, we can get the tradies to contact the customer 40% faster.


We also believed that we could educate tradies to call AND use the hipages Message Centre, which would lead to better outcomes (getting hired more often).


Because we knew about the high no-contact rate, we spoke to tradies and many of tradies who didn't make the first call with homeowners after accepting a job lead, it wasn’t because they were not able to but didn't know how important it was for them to action that, therefore we believed that by prompting & educating the tradie on the importance of quick contact after accepting a job lead, we can get the tradies to contact the customer 40% faster.


We also believed that we could educate tradies to call AND use the hipages Message Centre this would lead to better outcomes (getting hired more often).


Experiment Results

The experiment ran for 5-7 days as a 50-50 split test in the iOS app, only being shown to tradies with < 30 days of tenure. (whether they have already claimed).


The Tooltip had a significant and immediate effect. 

Shortly after launch, we observed an average improvement of 50% in contact times and a 50% reduction in tradies not responding at all


85% of the tradies who viewed the tooltip immediately messaged/called the consumers.

Although in the long term, after a few days, the effect of the tooltip diminished, and the improvement in response compared to the control was only a 10-20% improvement across the two behaviours.

Detailed Results

By the end of the experiment, 330 tradies had seen the tooltip after they accepted a claim.


Immediately after seeing the tooltip, a tradie’s behaviour was significantly improved:



Prediction

If the hypothesis is true, then we expect to see:


Tradies hitting the call button AND sending messages via the hipages Message Centre on average 15% quicker than previously

A change in behaviour that persists as it becomes self-reinforcing (better comms leads to more hires, which leads to more confidence and expertise, which leads to better comms)


Hence, if we see success is short-lived, then it is a clue that either more coaching is required or improved contact behaviour is not leading to better success for the tradies.  


Targeted Users

New tradies less than 30 days tenure.


Design

For our first experiment, we showed a simple tooltip encouraging the tradie to contact consumers immediately after accepting their lead.

This was our first step to creating a well-thought-through onboarding experience for tradies, which we hoped would help them build good habits and increase their chances of winning work.


User journey:

When the user accepts a job lead for the first time, they’re shown the message centre with new tooltips highlighting the call button and the message input field. 


of the tradies communicated with the consumer within 5 minutes

85%

of tradies haven’t communicated at all

07%

We then tracked those tradies for the following few days and compared them with the control group, and we could see that:


  • On average, for a test Tradie, the number of claims with no contact at all reduced from 14% of the claims to 10.5% of the claims.

  • The number of claims with contact times greater than 3 hours also reduced from 15% to 11.8%.

  • There was also an increase in the number of claims with an immediate response, from 55% to 60%.


We can conclude that viewing the tooltip message has a significant impact, but more work is required to create a longer-lasting behavioural change.


A month later, we released this feature to all users.


We then tracked those tradies for the following few days and compared them with the control group and we could see that:


  • On average, for a test Tradie, the number of claims with no contact at all reduced from 14% of the claims to 10.5% of the claims.

  • The number of claims with contact times greater than 3 hours also reduced from 15% to 11.8%.

  • There was also an increase in the number of claims with an immediate response, from 55% to 60%.


We can conclude that viewing the tooltip message has a significant impact, but more work is required to create a longer-lasting behavioural change.


A month later, we released this feature to all users.

Follow-up Experiments

Now that we had validated our initial hypothesis and learned that we could influence tradie behaviour, we soon scaled up the solution design and released it to all tradies, then considered further iterations. 


We then experimented with other ideas as we wanted to continue to drive good behaviour using the hook model in the following strategy: 

  • First, triggering the tradie, then bringing them to action in what we want.

  • Rewarding them so they can feel like an investor and will want to return to the specific activity to achieve the right outcome.


For this reason, we designed follow-up messages to prompt, motivate, and bring tradies back to the actions we wanted to direct them towards.

Uncontacted Consumers on Message Centre Screen Experiment - Version 2

#2

Problem

In the long term, after a few days of launching the first Slice 1 Experiment, the effect of the tooltip diminished, and the improvement in response in comparison to the prior was only 10-20%.

It was not enough for us. We needed to achieve at least a 50% increase in the growth speed of contact time between tradies and new clients.





In the long term, after a few days of launching the first Slice 1 Experiment, the effect of the tooltip diminished, and the improvement in response in comparison to the prior was only 10-20%.

It was not enough for us. We needed to achieve at least 50% speed growth of contact time between tradie and new clients.

Hypothesis

We believed that if we reminded tradies in the Message how many customers they have yet to call/message, then more tradies would call/message these customers in under 3 hours, and the number that don't call / message at all would be reduced.






We believed that if we reminded tradies in the Message how many customers they have yet to call/message then more tradies will call/message these customers in under 3 hours and the number that do not call / message at all will be reduced.

The second usage of the component was on the ‘Accepted’ screen, where we gathered the data on the level of engagement between the tradie and the homeowner.

In the month following the release of the new features to iOS users, there was a 25% reduction in the number of claims with no response at all via the message centre.


Solution

The components for the second slice prompted tradies to contact the consumer and reminded them to follow up with a call if they were unsuccessful in reaching the homeowner the first time.


The first use of the component was on the Message screen, where it was used to warn tradies about those they had not yet contacted via the app.



The components for the second slice prompted tradies to contact the consumer and reminded them that they need to follow up with a call if they were unsuccessful in reaching the homeowner the first time.


The first usage of the component was on the Message screen and was used to warn tradies about who they have not contacted yet via the app.

Background

Released to 100% of the iOS tradies features that would remind and encourage them to contact the consumer after they claimed a lead. 


We analysed the experience from two angles: the distribution of the time taken to process a claim and the distribution of time taken to respond for all accounts, based on the account median time to response. last, we looked at the intervals of 14 days and 30 days after the new features were released.

Experiment Results

To understand the difference in claim behaviour, we looked back 3 months, which gives us approximately the same period before and after the release. We compared the iOS tradies to themselves (seasonally adjusted). 


We detected a 25% reduction in the portion of claims with no response via the Message Centre. It is important to note that this is based on the assumption that not many tradies would contact consumers outside of the MC, but this is an assumption we were unable to prove.






To understand the difference in claim behaviour we looked 3 months back which gives us approx the same period before and after the release. We compared the iOS tradies to themselves (seasonally adjusted). 


We could detect that the portion of claims with no response via the message centre was reduced by 25%. Important to note that this is based on the assumption that not many tradies would contact the consumers out of the MC but this is an assumption we were not able to prove.

In addition, we observed a 19% increase in the portion of claims with a response within 5 minutes.


For the accounts, we created a new feature called ‘Time to respond’. This feature calculates the median minutes it takes for an account to attempt to contact a homeowner at intervals of 14, 30, 60, and 90 days.

Tradie Response Speed Experiment - Version 3

#3

#3

(Was yet to be conducted)





(Was yet to be conducted)

We believed that if we tracked tradies who had to slow down in terms of response time and prompted them about it, then we could help them start to slow down in terms of response time and prompted them about it, then we could get them to build a longer-lasting habit of contacting the homeowner ASAP.


After accepting a job lead, we wanted to display tooltips as shown here after the first 30 days. Displaying it until the tradie swipes left to delete. If the tradie doesn’t act on the message, it will be deleted after 5 days.


Tradie Response Speed Hygiene - Version 4

#4

#4

(Was yet to be implemented)





(Was yet to be implemented)

Problem

When I reviewed the job lead card during a test, I noticed that the information hierarchy was very confusing, and I suspected that new users might not know what to click on after accepting a job lead.





When I looked at the job lead card during a test, I noticed the information hierarchy was very confusing and suspected new user might not know what to click on after accepting a job lead.

Solution

In order to help tradies take the best action, I reordered the accepted job lead card buttons to highlight the call icon as the number one action. I placed the message icon on the right side, while I placed the “Mark as hired” button as a tertiary action.

Before





After

Before





After

Learning

05

05

We have learned that by catching tradies in the moments that matter and providing them with simple, actionable advice, a large percentage will take the recommended action and develop a new habit that will help them win more work.


Before the Product Strategy session, I learned the importance of conducting a thorough analysis of the given objectives, rather than accepting them as they are. We first need to identify customer needs and goals to seek out new opportunities, which can then be incorporated into our product strategy and adjusted to focus on specific areas.


Even though we were not very familiar with the problem space yet and lacked experiment experience as a team we did well against our constraints within those first couple of months,

We have learned that by catching tradies in the moments that matter and giving them simple actionable advice, a large percentage will take the recommended action and learn a new habit that will help them win more work.


Prior to the Product Strategy session, I learned the importance of well in-depth analysis of the given objectives, prior to accepting them as they are. We first should identify customer needs and goals to seek out new opportunities which then can be fed into our product strategy and adjust the focus areas.


Even though we were not very familiar with the problem space yet and lacked experiment experience as a team we did well against our constraints within those first couple of months and got to know the problem space very well which helped in the following experiments to quicker decide on possible solutions therefore, achieved good results. 


If we had more time, I would have experimented with more data in the copy to see if that will bring more value to the users, therefore will more likely adopt our suggestion. 

I would have also spent more time designing a user journey with prompt stages as a visual representation; if a user will decline one solution, how can we bring back the user’s attention and eventually achieve changing both users’ bad behaviors in a shorter term.


and got to know the problem space very well, which helped in the following experiments to quickly decide on possible solutions, and therefore, achieved good results. 


If we had more time, I would have experimented with more data in the copy to see if that would bring more value to the users, thereby making them more likely to adopt our suggestion. 

I would have also spent more time designing a user journey with prompt stages as a visual representation; if a user declines one solution, how can we bring back the user’s attention and eventually change both users’ destructive behaviours in the short term?