Lu, Yukuan

1. Shiyu Zhao. Chapter 3: Bellman Optimality Equation. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Bellman Optimality Equation
3. --> Youtube: How to Solve Bellman Optimality Equation

The previous chapter introduced the Bellman equation of any given policy. The present post introduces the Bellman optimality equation, which is a special Bellman equation whose corresponding policy is optimal. By solving

Sources:

1. Shiyu Zhao. Chapter 2: State Values and Bellman Equation. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Bellman Equation: Action Value

Sources:

• Masked Autoencoders (MAE)
• Vision Transformer (ViT)
• Segment Anything blog
• Github: SAM
• Youtube video: Segment Anything - Model explanation with code
  • -->Slides

• Cross entropy
• Focal loss
• Hinge loss
• ...

Sources:

1. Shiyu Zhao. Chapter 1: Basic Concepts. Mathematical Foundations of Reinforcement Learning.
2. OpenAI Spinning Up

Sources:

1. Shiyu Zhao. Chapter 2: State Values and Bellman Equation. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Bellman Equation: Matrix-Vector form

Sources:

1. Shiyu Zhao. Chapter 2: State Values and Bellman Equation. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Bellman Equation: Derivation

Sources:

1. Kill Command in Linux.
2. Machtelt Garrels. Chapter 12. Catching signals. Bash Guide for Beginners.

Sources:

• A complete guide to Manage Users and Groups on Linux!
• 蔡德明. 第十四章 Linux账号管理与权限配置. 鸟哥的Linux私房菜.

Sources:

1. Machtelt Garrels. Chapter 3. The Bash environment. Bash Guide for Beginners.