W20D2: Build Lab

Design Your Own CartPole Solution with AI

Today's Mission

Design, build, and evaluate your own RL solution for CartPole. You're the architect. AI is your developer. Make it work!

1
Design
45 min
2
Build
60 min
3
Evaluate
45 min
4
Document
30 min
🎯
Design Lab

Start here! Make your design decisions step by step.

  • Set your requirements
  • Choose your algorithm
  • Configure your architecture
  • Get your AI prompt
📓
Project Journal

Document everything! Track your progress and decisions.

  • Record design choices
  • Log AI interactions
  • Track experiments
  • Prepare your defense
📖
Template Guide

Section-by-section instructions for my_solution.py

  • Code examples per section
  • Compliance checklists
  • Experimentation guide
  • Journaling prompts
💻
My Solution

Your code goes here. Paste AI-generated code and modify it.

  • Template with structure
  • Add your agent class
  • Run training loop
  • Save your results
📊
Evaluate

Test your solution and get a performance report.

  • Run 100 test episodes
  • Generate graphs
  • Export results
  • Get your grade

Tips for Success

Start Simple

Get a basic version working first, then add improvements one at a time.

Document As You Go

Don't wait until the end. Write in your journal after each step.

Ask AI Good Questions

The better your prompts, the better the code. Be specific!

Test Often

Run your code after every change. Fix bugs early.