Case Studies: An imperfect but better approach to portfolio presentations
Credit: The UX leadership team at AppFolio brought this to life - specifically Carlisle Sargent with visualizing this early on and helping us find a format that works across design, leadership, and research.
Case studies are a common and often contentious practice in design hiring. While they can provide valuable insights into a candidate's abilities, they also come with challenges and potential drawbacks. This guide balances gaining meaningful information about candidates and creating a positive, respectful candidate experience.
The Purpose of Case Studies
My approach to case studies is designed to assess: 1. Storytelling ability 2. Visual design skills 3. Comfort in presenting and discussing their own work 4. Understanding of different work contexts 5. Collaboration and communication skills with cross-functional partners
Acknowledging Candidate Experience
We recognize that case studies can create anxiety and additional labor for candidates. To mitigate this: - No free work or labor that a candidate can't reuse. - We structure the case study session to allow candidates to showcase their personality and design philosophy, not just their work. - We involve cross-functional partners to give candidates a realistic preview of the collaborative environment they'll be working in.
Case Study Format
Our case study sessions follow this format:
- Personal Introduction (5 minutes)
- Candidate shares about themselves, including interests outside of work.
-
This helps ease nerves and reminds us all that candidates are more than their professional personas.
-
Design Philosophy (10minutes)
- Candidate discusses their design process and philosophy.
-
They share a product they admire and suggest one thing they'd add to improve it, explaining their reasoning.
-
Case Study Presentation (20-30 minutes)
- Candidate presents their chosen case study.
-
They should focus on their role, decision-making process, and outcomes.
-
Q&A (15 minutes)
- Panel asks clarifying questions about the presented work.
- Candidate has the opportunity to ask questions to the entire team.
Rubric for Case Studies
Use this rubric to assess candidates consistently across different interviewers and roles. Rate each area on a scale of 1-5, where 1 is "Needs Significant Improvement" and 5 is "Exceptional".
- Storytelling and Communication
- Clarity of presentation
- Logical flow of information
-
Engagement with the audience
-
Visual Design Skills
- Quality of visual artifacts presented
- Understanding of visual design principles
-
Appropriateness of design choices for the problem at hand
-
Problem-Solving and Process
- Clear articulation of the problem being solved
- Logical approach to solving the problem
-
Consideration of constraints and trade-offs
-
User-Centered Approach
- Evidence of user research or consideration of user needs
- Application of user insights in the design process
-
Ability to advocate for the user
-
Cross-Functional Collaboration
- Examples of working with other disciplines (e.g., product, engineering)
- Understanding of technical constraints and business goals
-
Ability to communicate design decisions to non-designers
-
Impact and Results
- Clear articulation of the project's impact
- Quantitative or qualitative results, if available
-
Lessons learned and applied to future work
-
Design Philosophy and Critical Thinking
- Articulation of personal design philosophy
- Thoughtful critique of admired product
-
Ability to suggest meaningful improvements
-
Adaptability and Growth
- Examples of overcoming challenges or setbacks
- Openness to feedback and alternative viewpoints
- Evidence of personal or professional growth through the project
Remember, this rubric is a guide, not a strict scorecard. Use it to structure your thoughts and ensure consistent evaluation across candidates, but also trust your instincts and consider the specific needs of your team and role. You can also share your rubric with candidates to ensure you see the right examples in their work history.
After the Case Study
- Provide timely feedback to candidates, whether moving forward or not.
- If not moving forward, offer constructive feedback that the candidate can apply in future interviews.