陆昱宽

How to set up configs on a new machine (typically a ubuntu server).

For the usage of most of the rust tools, see my Unix CLI Tools.

My dotfiles are save in:

1

https://github.com/LYK-love/dotfiles-for-servers

1. Shiyu Zhao. Chapter 4: Value Iteration and Policy Iteration. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Value Iteration and Policy Iteration

This chapter introduces three algorithms that are closely related to each other. Briefly speaking, they are all solutions of Bellman optimality equations (BOEs) to get optimal policies.

1. Shiyu Zhao. Chapter 3: Bellman Optimality Equation. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Bellman Optimality Equation
3. --> Youtube: How to Solve Bellman Optimality Equation

The previous chapter introduced the Bellman equation of any given policy. The present post introduces the Bellman optimality equation, which is a special Bellman equation whose corresponding policy is optimal. By solving

Sources:

1. Shiyu Zhao. Chapter 2: State Values and Bellman Equation. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Bellman Equation: Action Value

Sources:

• Masked Autoencoders (MAE)
• Vision Transformer (ViT)
• Segment Anything blog
• Github: SAM
• Youtube video: Segment Anything - Model explanation with code
  • -->Slides

• Cross entropy
• Focal loss
• Hinge loss
• ...

Sources:

1. Shiyu Zhao. Chapter 1: Basic Concepts. Mathematical Foundations of Reinforcement Learning.
2. OpenAI Spinning Up

Sources:

1. Shiyu Zhao. Chapter 2: State Values and Bellman Equation. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Bellman Equation: Matrix-Vector form

Sources:

1. Shiyu Zhao. Chapter 2: State Values and Bellman Equation. Mathematical Foundations of Reinforcement Learning.
2. --> Youtube: Bellman Equation: Derivation

Sources:

1. Kill Command in Linux.
2. Machtelt Garrels. Chapter 12. Catching signals. Bash Guide for Beginners.