The big idea for tonight
Engineering teams always face constraints — limited time, limited people, limited compute. Tonight you learn to say no on purpose: structured frameworks for picking the smallest set of features that actually delivers product value. Bring this skill into your capstone the moment topics drop.
1 Learning Objectives
Primary
- Understand MVP vs full production system
- Learn structured frameworks for prioritization
- Design a prioritization strategy for an AI product
Supporting
- Trade off engineering effort vs user value
- Use prioritization matrices on real features
- Document product decisions clearly
Key terms
Feature prioritization
MVP
MLP — Minimum Lovable Product
User value
Engineering effort
Impact vs effort matrix
Technical debt
Scope control
Out of scope
- Product marketing strategy
- Detailed financial modeling
- User acquisition strategy
- Long-term product roadmaps
2 MVP vs Full Production
Same feature, two completely different scopes. The MVP exists to answer: "is this worth building at all?" The production system exists to answer: "can it run reliably for everyone?"
MVP — Recommendation Engine
- Static dataset (CSV / parquet)
- Simple model — top-N by popularity, then by similarity
- Basic API — one endpoint, one user
- Manual evaluation — eyeball results, run a script
- Deploy = a dev server on your laptop
Production — Recommendation Engine
- Streaming event ingestion (Kafka / equivalent)
- Real-time training / continuous updates
- Scalable serving with autoscale + caching
- Monitoring pipelines, drift detection, A/B framework
- Cold-start handling, fallback rules, on-call rotation
The MVP is not a worse version of production. It's a deliberately stripped-down version that proves the core hypothesis is real. If your MVP needs Kafka to run, it's not an MVP.
3 Impact vs Effort Matrix
Two axes, four quadrants, one rule per quadrant. The decision happens before any code does.
Plan carefully
High impact · High effort
Strategic bets. Worth doing — but break them into phases and prove the smallest piece first.
Build first
High impact · Low effort
Quick wins. Ship these in week one. They unlock the rest of the work.
Avoid
Low impact · High effort
Time sinks. Almost always cut from scope, no matter how interesting they sound.
Optional
Low impact · Low effort
Polish. Do them only if there's slack at the end of the iteration.
← low effort · high effort →
Honest effort estimation
- Engineering days — not calendar days. A feature that needs 2 specialists you don't have is infinite effort.
- Hidden costs — data labeling, eval setup, ops burden, ongoing maintenance.
- If unsure, double it. AI features routinely take 2–3× the naïve estimate because of data wrangling.
4 Worked Example — Recommendation Engine
Here's a real feature list students often build for a recsys MVP. Use the interactive matrix tool to drag these around yourself.
- Personalized recommendations (high impact, high effort) — the core thing. Phase it: start with content-based, add collaborative filtering later.
- Top-N popular fallback (medium impact, low effort) — quick win, also unblocks cold-start.
- User feedback loop (high impact, medium effort) — needed to evaluate at all. Don't ship without it.
- Real-time updates (low impact for MVP, high effort) — fight the urge. Daily batch is fine for proof-of-value.
- Recommendation explanations ("why this?") (medium impact, medium effort) — defer unless your hypothesis depends on trust.
- Slick UI for browsing recs (low impact, medium effort) — optional polish.
5 3-Hour Session Schedule
0:00–0:10
Recap & AgendaW31D1 monitoring · today's shift to "what to build first" · core principle: smallest system that solves the problem
0:10–0:30
Core Teaching — MVP vs Full SystemSide-by-side scope comparison · what gets cut and why
0:30–0:55
Breakout 1 — Feature BrainstormingEach team gets a system (RAG / fraud / docs) · list core, advanced, nice-to-have features → feature_list.md
0:55–1:05
Share-outOne essential feature per team · instructor calls out scope creep
1:15–1:35
Core Teaching — Impact vs Effort MatrixFour quadrants · honest effort estimation · trade-off discussion
1:35–2:00
Lab 1 — Prioritization MatrixPlace each feature in a quadrant → feature_prioritization_framework.md
2:00–2:25
Breakout 2 — MVP DefinitionWhat MUST exist? What gets postponed? Update framework doc.
2:35–2:55
Lab 2 — Decision DocumentationSection: "Why these features define the MVP" — value, complexity, trade-offs
2:55–3:00
ClosingHow tonight's decisions accelerate capstone scoping when topics drop
6 Hands-On Labs
Part A — Feature List
Create week31_ai_system_playbook/feature_list.md. For your assigned system, brainstorm freely — quantity first, judgment later. Categorize:
- Core features — the system can't be called "the system" without these
- Advanced features — improve the experience or unlock new use cases
- Nice-to-have features — polish, edge cases, "wouldn't it be cool if…"
# Recommendation Engine — Feature List
## Core
- Top-N item recommendation API
- User profile lookup
- Item embeddings store
- Click logging
## Advanced
- Personalization based on viewing history
- Cold-start handling for new users
- Explanation ("why this?")
## Nice-to-have
- Real-time updates
- Browsable rec UI
- A/B framework
Part B — Prioritization Matrix
Create week31_ai_system_playbook/feature_prioritization_framework.md. Categorize every feature from Part A into one of the four quadrants. Justify every "high effort" claim with concrete reasons (data labeling? specialist needed? new infra?).
Part C — MVP Definition
Add a section titled "Why these features define the MVP". Answer:
- Which features must exist for the system to demonstrate value at all?
- Which features get postponed, and what triggers their inclusion later?
- What trade-offs did you accept?
7 Anti-GenAI Requirement
Section title (required in every team's submission):
"Why these features are critical for the MVP"
Justify decisions using user value and engineering feasibility for your specific system. A reviewer should be able to push back ("why not also include X?") and find a real answer in your doc — not boilerplate.
9 Closing Checklist
Before you leave tonight, every team should have:
week31_ai_system_playbook/feature_list.md
week31_ai_system_playbook/feature_prioritization_framework.md
- A clear MVP scope with ≤ 5 features
- The "Why these features are critical for the MVP" section filled in
These artifacts plug straight into the capstone product brief once topics are revealed.