Sources:

  1. ECS201A Homepage
  2. ECS201A Projects(gem5)

All the experiments rely on the same python env and a software called gem5.

The professor has offered us github codespaces, such as classroom assignment-0, to develop,upon which you don't need to worry about the setup. So it's strongly recommended to develop with github codespaces.

However, if you prefer to develop on your local machine, to set up for the experiments you must:

  1. Install and config gem5 on your system.
  2. Clone the assignment repo and config it.
Read more »

  1. Shiyu Zhao. Chapter 3: Bellman Optimality Equation. Mathematical Foundations of Reinforcement Learning.
  2. --> Youtube: Bellman Optimality Equation
  3. --> Youtube: How to Solve Bellman Optimality Equation

The previous chapter introduced the Bellman equation of any given policy. The present post introduces the Bellman optimality equation, which is a special Bellman equation whose corresponding policy is optimal. By solving

Read more »

Sources:

  • Masked Autoencoders (MAE)
  • Vision Transformer (ViT)
  • Segment Anything blog
  • Github: SAM
  • Youtube video: Segment Anything - Model explanation with code
    • -->Slides
Read more »
0%