OVERVIEW
OVERVIEW
OVERVIEW
Validating a new homepage design through comprehensive user research with 10+ enterprise customers, uncovering critical insights about usability, relevance, and desired features.
Validating a new homepage design through comprehensive user research with 10+ enterprise customers, uncovering critical insights about usability, relevance, and desired features.
Validating a new homepage design through comprehensive user research with 10+ enterprise customers, uncovering critical insights about usability, relevance, and desired features.
2024-2025
2024-2025
2024-2025
TIMELINE
TIMELINE
TIMELINE
ROLE
ROLE
ROLE
UX Research
Moderating User Session
Note-taking
UX Research
Moderating User Session
Note-taking
UX Research
Moderating User Session
Note-taking
From Launch to Learnings:
From Launch to Learnings:
From Launch to Learnings:
Evaluating the Impact by Customer Feedback and Usability Sessions
Evaluating the Impact by Customer Feedback and Usability Sessions
Evaluating the Impact by Customer Feedback and Usability Sessions
🎯
🎯
Challenge
Challenge
After releasing the redesigned Datasphere homepage in October 2023, we needed to validate whether the new design met user needs and understand how users were actually interacting with it.
After releasing the redesigned Datasphere homepage in October 2023, we needed to validate whether the new design met user needs and understand how users were actually interacting with it.
Approach
Approach
Conducted in-depth interviews and usability testing with 10 participants representing diverse enterprise customers, including 8 System Admins and 2 Modellers with varying experience levels.
Conducted in-depth interviews and usability testing with 10 participants representing diverse enterprise customers, including 8 System Admins and 2 Modellers with varying experience levels.
🌟
🌟
Outcome
Outcome
Identified critical usability strengths (4.4/5) while uncovering significant gaps in content relevance (2.6/5) and customization (2.6/5), leading to actionable recommendations.
Identified critical usability strengths (4.4/5) while uncovering significant gaps in content relevance (2.6/5) and customization (2.6/5), leading to actionable recommendations.
Research Objective
Research Objective
Key questions we aimed to answer
Key questions we aimed to answer
01
01
Current usage behavior
Current usage behavior
How do users currently navigate through the homepage?
How do users currently navigate through the homepage?
02
02
Current usage frequency
Current usage frequency
How much time do users spend on the homepage?
How much time do users spend on the homepage?
03
03
Current usage experience
Current usage experience
How pleasant is it for users to use the homepage?
How pleasant is it for users to use the homepage?
04
04
Desired functionalities
Desired functionalities
What is currently missing from the homepage? What would users like to see?
What is currently missing from the homepage? What would users like to see?
10
10
Participants
Participants
9
9
Customers
Customers
Enterprise clients including Bosch, Daimler Truck, Henkel, SAF-HOLLAND, Zalando, and ZF Group.
Enterprise clients including Bosch, Daimler Truck, Henkel, SAF-HOLLAND, Zalando, and ZF Group.
Research Methods
Research Methods
• In-depth interviews
• In-depth interviews
• Usability testing
• Usability testing
• Quantitative ratings
• Quantitative ratings
• Qualitative feedback
• Qualitative feedback
8 System Admins and 2 Data Modelers, with varying levels of experience using Datasphere.
8 System Admins and 2 Data Modelers, with varying levels of experience using Datasphere.
Methodology
Methodology
How we did what we did
How we did what we did
Key Findings
Key Findings
User ratings and insights
User ratings and insights
4.4
4.4
/5
/5
Usability
Usability
Highest rated metric
Highest rated metric
Users feel that the Datasphere homepage is easy to use.
Usability is the highest-rated of all the metrics, with users consistently praising the intuitive layout and clear information hierarchy.
Users feel that the Datasphere homepage is easy to use.
Usability is the highest-rated of all the metrics, with users consistently praising the intuitive layout and clear information hierarchy.
2.6
2.6
/5
/5
Relevance
Relevance
Major concern
Major concern
Users think that the homepage content is not relevant to them.
They believe the Datasphere homepage is unable to effectively support them in their day-to-day tasks.
Users think that the homepage content is not relevant to them.
They believe the Datasphere homepage is unable to effectively support them in their day-to-day tasks.
2.6
2.6
/5
/5
Customization Capability
Customization Capability
Major concern
Major concern
Users believe the customization features are limited.
The lack of customization prevented users from tailoring the homepage to their specific workflows, which was problematic given the diverse roles across the user base.
Users believe the customization features are limited.
The lack of customization prevented users from tailoring the homepage to their specific workflows, which was problematic given the diverse roles across the user base.
Post-launch research is critical
Post-launch research is critical
Validating designs after release revealed insights that pre-launch testing couldn't capture, particularly around actual usage patterns.
Validating designs after release revealed insights that pre-launch testing couldn't capture, particularly around actual usage patterns.
Usability ≠ Usefulness
Usability ≠ Usefulness
A highly usable interface doesn't guarantee user satisfaction. Content relevance and customization are equally important.
A highly usable interface doesn't guarantee user satisfaction. Content relevance and customization are equally important.
Role diversity matters
Role diversity matters
Including both System Admins and Modellers revealed distinctly different needs, highlighting the importance of diverse recruitment.
Including both System Admins and Modellers revealed distinctly different needs, highlighting the importance of diverse recruitment.
Learnings
Learnings
Most Used Cards
Most Used Cards
Blog
Blog
7/10
7/10
Data Builder
Data Builder
5/10
5/10
Spaces
Spaces
5/10
5/10
Data Integration Tasks
Data Integration Tasks
2/10
2/10
Most Removed Cards
Most Removed Cards
Business Builder
Business Builder
6/10
6/10
Welcome
Welcome
5/10
5/10
Quick Actions
Quick Actions
1/10
1/10
Recommendations
Recommendations
Proposed improvements
Proposed improvements
1
1
Custom card links
Custom card links
Enable users to add cards with custom links to frequently accessed resources and tools.
Enable users to add cards with custom links to frequently accessed resources and tools.
UX design already delivered. Fast-track development to drive consumption.
UX design already delivered. Fast-track development to drive consumption.
2
2
Card resizing
Card resizing
Allow users to resize cards for more flexibility and better space utilization.
Allow users to resize cards for more flexibility and better space utilization.
First draft already developed. Leverage existing work to speed up delivery.
First draft already developed. Leverage existing work to speed up delivery.
3
3
Enhanced card information
Enhanced card information
Add space information, memory consumption data, and other contextual details to cards.
Add space information, memory consumption data, and other contextual details to cards.
Addresses admin and modeler needs for better system monitoring.
Addresses admin and modeler needs for better system monitoring.
4
4
Role-based defaults
Role-based defaults
Pre-configure default card views based on user roles and privileges
Pre-configure default card views based on user roles and privileges
Improve immediate relevance for new users while maintaining customization.
Improve immediate relevance for new users while maintaining customization.
+301%
+301%
Increase in homepage engagement
Increase in homepage engagement
3.8+
3.8+
Relevance score
Relevance score
4.0+
4.0+
Customization score
Customization score
9/9
9/9
Customers requesting features
Customers requesting features
Key Impact
Key Impact
Qualitative Feedback
Qualitative Feedback
Limited Homepage Engagement
Limited Homepage Engagement
7/10 participants don't spend much time on the homepage and go directly to specific sections like Space Management or Data Builder
7/10 participants don't spend much time on the homepage and go directly to specific sections like Space Management or Data Builder
3/10 participants access via bookmarked links or typed URLs to specific modules, bypassing the homepage entirely
3/10 participants access via bookmarked links or typed URLs to specific modules, bypassing the homepage entirely
Why?
Why?
•
•
Experienced users rely on muscle memory and established workflows
Experienced users rely on muscle memory and established workflows
•
•
Homepage doesn't provide sufficiently detailed information for their needs
Homepage doesn't provide sufficiently detailed information for their needs
•
•
Faster to navigate directly to familiar sections
Faster to navigate directly to familiar sections
Mixed Reactions to Data Builder Card
Mixed Reactions to Data Builder Card
✗ Challenge
✗ Challenge
Most participants (4/5 admins, 2/2 modelers) don't spend time on this card, preferring direct navigation
Most participants (4/5 admins, 2/2 modelers) don't spend time on this card, preferring direct navigation
✗ Challenge
✗ Challenge
3/5 admins don't find recently accessed objects helpful for their role
3/5 admins don't find recently accessed objects helpful for their role
✓ Positive
✓ Positive
1 modeler values quick access to artifacts they're actively working on
1 modeler values quick access to artifacts they're actively working on
Quick Actions Card Not Being Used
Quick Actions Card Not Being Used
The Problem
The Problem
✗
✗
8/10 participants are not actively using Quick Actions
8/10 participants are not actively using Quick Actions
✗
✗
6/10 participants already have familiar methods for tasks
6/10 participants already have familiar methods for tasks
✗
✗
4/10 participants find existing actions not useful for their role
4/10 participants find existing actions not useful for their role
✗
✗
2/10 participants feel actions are developer-oriented
2/10 participants feel actions are developer-oriented
😕
😕
Participant #1 (Admin)
Participant #1 (Admin)
"I've already checked most of the [Quick Actions], they're more or less related to Business and Data Builders. Unfortunately, there's nothing for Catalog or anything that would be useful for my end."
"I've already checked most of the [Quick Actions], they're more or less related to Business and Data Builders. Unfortunately, there's nothing for Catalog or anything that would be useful for my end."
🎯
Challenge
After releasing the redesigned Datasphere homepage in October 2023, we needed to validate whether the new design met user needs and understand how users were actually interacting with it.
Approach
Conducted in-depth interviews and usability testing with 10 participants representing diverse enterprise customers, including 8 System Admins and 2 Modellers with varying experience levels.
🌟
Outcome
Identified critical usability strengths (4.4/5) while uncovering significant gaps in content relevance (2.6/5) and customization (2.6/5), leading to actionable recommendations.
Research Objective
Key questions we aimed to answer
01
How do users currently navigate through the homepage?
Current usage behavior
02
How much time do users spend on the homepage?
Current usage frequency
03
How pleasant is it for users to use the homepage?
Current usage experience
04
What is currently missing from the homepage? What would users like to see?
Desired functionalities
Methodology
How we did what we did
10
Participants
8 System Admins and 2 Data Modelers, with varying levels of experience using Datasphere.
9
Customers
Bosch, Daimler Truck, Henkel, SAF-HOLLAND, Zalando, and ZF Group.
Research Methods
• In-depth interviews
• Usability testing
• Quantitative ratings
• Qualitative feedback
4.4
/5
Usability
Highest rated metric
Users feel that the Datasphere homepage is easy to use.
2.6
/5
Relevance
Major concern
Users think that the homepage content is not relevant to them.
2.6
/5
Customization Capability
Major concern
Users believe the customization features are limited.
User ratings and insights
Key Findings
Most Used Cards
Blog
7/10
Data Builder
5/10
Spaces
5/10
Data Integration Tasks
2/10
Most Removed Cards
Business Builder
6/10
Welcome
5/10
Quick Actions
1/10
Qualitative Feedback
Limited Homepage Engagement
7/10 participants don't spend much time on the homepage and go directly to specific sections like Space Management or Data Builder
3/10 participants access via bookmarked links or typed URLs to specific modules, bypassing the homepage entirely
Why?
•
Experienced users rely on muscle memory and established workflows
•
Homepage doesn't provide sufficiently detailed information for their needs
•
Faster to navigate directly to familiar sections
Mixed Reactions to Data Builder Card
✗ Challenge
Most participants (4/5 admins, 2/2 modelers) don't spend time on this card, preferring direct navigation
✗ Challenge
3/5 admins don't find recently accessed objects helpful for their role
✓ Positive
1 modeler values quick access to artifacts they're actively working on
Quick Actions Card Not Being Used
✗
8/10 participants are not actively using Quick Actions
✗
6/10 participants already have familiar methods for tasks
✗
4/10 participants find existing actions not useful for their role
✗
2/10 participants feel actions are developer-oriented
😕
Participant #1 (Admin)
"I've already checked most of the [Quick Actions], they're more or less related to Business and Data Builders. Unfortunately, there's nothing for Catalog or anything that would be useful for my end."
+301%
Increase in homepage engagement
3.8+
Relevance score
4.0+
Customization score
9/9
Customers requesting features
Key Impact
Post-launch research is critical
Validating designs after release revealed insights that pre-launch testing couldn't capture, particularly around actual usage patterns.
Usability ≠ Usefulness
A highly usable interface doesn't guarantee user satisfaction. Content relevance and customization are equally important.
Role diversity matters
Including both System Admins and Modellers revealed distinctly different needs, highlighting the importance of diverse recruitment.
Learnings