Learning Objective: Apply streamlined coding methods and collaborative analysis techniques using both traditional and AI-supported workflows.
Part 1: AI-Augmented Qualitative Analysis (1 hour)
The AI-Human Partnership in Analysis
AI tools are rapidly transforming qualitative analysis, but they work best as collaborators rather than replacements for human judgment. Drawing on Amershi et al.'s (2019) human-AI collaboration framework, we'll examine where AI excels (pattern detection, initial categorization, processing volume) versus where human judgment remains essential (contextual interpretation, nuanced understanding, strategic framing). Christin's (2020) critical perspective on algorithmic analysis helps us understand the limitations and potential pitfalls of over-reliance on AI.
AI Tools Landscape & Quick Wins
The AI landscape for qualitative research includes automated transcription tools like Otter.ai, Descript, and Whisper, which can reduce transcription time by 80-90%. For coding and analysis, researchers can choose between general large language models (Chat-GPT, Claude) and specialized UX research platforms (Dovetail AI, Notably, UserTesting AI Insights). We'll discuss the advantages of each approach and where researchers see immediate time savings.
Practical AI Workflows
The most effective approach is a hybrid model where AI handles speed-dependent tasks while humans provide depth and interpretation. AI excels at initial categorization, pattern detection across large datasets, and summarization. Humans add irreplaceable value through context interpretation, understanding nuance, and strategic framing of insights. We'll walk through a complete workflow: AI transcription → AI-assisted initial coding → human theme validation → strategic insight development. Prompt engineering for qualitative coding will be covered with concrete examples.
Maintaining Quality with AI
The "human-in-the-loop" principle (Monarch, 2021) is essential for maintaining quality when using AI. This section covers validation strategies for AI outputs, bias detection and mitigation drawing on Noble's (2018) work on algorithmic bias, and transparency requirements when reporting AI-assisted analysis. Participants will learn how to verify AI-generated codes and themes systematically.
Live Demo (15 min): The instructor will walk through an AI-assisted coding session using real interview data, demonstrating prompt engineering, output validation, and the human refinement process.
Part 2: Rapid Coding Techniques (1 hour)
Streamlined Coding Approaches
Traditional grounded theory coding can be time-prohibitive for fast-paced UX work. This session introduces template analysis (King, 2004), which uses pre-defined codes as a starting framework, and provisional coding (Saldaña, 2021), which begins with a priori codes that can be refined. The Framework Method's matrix analysis approach (Gale et al., 2013) provides structure for organizing and comparing data efficiently across cases.
When and How to Skip Transcription
Full transcription isn't always necessary. We'll explore working strategically from notes and recordings, smart transcription approaches that capture only key quotes, and using audio/video timestamps instead of full transcripts. This section also covers when to use AI transcription versus when manual approaches provide better accuracy, particularly for specialized terminology or diverse accents.
Applied Thematic Analysis
Braun & Clarke's (2006) thematic analysis, adapted for speed, remains highly effective for UX research. This section teaches prioritizing pattern identification over exhaustive coding and applying the 80/20 rule to insight generation—finding the 20% of data that yields 80% of actionable insights. We'll compare template analysis and provisional coding approaches and discuss when each is most appropriate.
Technology and Tools
Beyond AI, various collaborative tools support rapid analysis. Miro, Dovetail, and Airtable each offer different strengths for team-based analysis. We'll also cover simple spreadsheet frameworks that can be surprisingly powerful. The key is combining AI and manual coding strategically rather than viewing them as either/or choices.
Practical Exercise (20 min): Participants will code sample interview data using template analysis combined with AI assistance, experiencing the hybrid approach firsthand.
Week 2 Homework Assignment:
- Practice AI-assisted coding on the provided dataset
- Try at least one new coding technique from class on your own data
- Prepare specific questions about your own analysis challenges for Class 3