陆昱宽

Sources:

1. B. P. Lathi & Roger Green. (2021). Chapter 1: Signals and Systems. Signal Processing and Linear Systems (2nd ed., pp. 64-136). Oxford University Press.

Sources:

1. VQ-VAE 2018 paper
2. A compact explanation by Julius Ruseckas

Link: My VQ-VAE implementation on Github

Sources:

1. JAX Quickstart
2. Learning JAX as a PyTorch developer

In Python, a metaclass creates and defines the behavior of other classes, since classes themselves are objects.

Sources:

1. Demystifying Python Metaclasses: Understanding and Harnessing the Power of Custom Class Creation
2. Python Metaclasses by John Sturtz.

Sources:

• Download file from Github with CLI tools
• Download file from Google Drive with CLI tools

Sources:

• Installing Jupyter

Sources:

• Building makemore Part 5: Building a WaveNet
• WaveNet 2016 from DeepMind

See my Github repo for the full implementation.

Sources:

1. Remzi H. Arpaci-Dusseau & Andrea C. Arpaci-Dusseau. (2014). Virtualization. Operating Systems: Three Easy Pieces (Version 0.8.). Arpaci-Dusseau Books, Inc..

Sources:

• TPU v1: In-Datacenter Performance Analysis of a Tensor Processing Unit. 2017.
• TPU v2, v3: A Domain Specific Supercomputer for Training Deep Neural Networks.
• AI Chips: Google TPU
• HotChips 2019 Tutorial Cloud TPU: Codesigning Architecture and Infrastructure

Many architects believe that major improvements in cost-energy-performance must now come from domain-specific hardware.

Sources:

• Adjrej Karpathy's video Building makemore Part 4: Becoming a Backprop Ninja.
• Paper: Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• PyTorch: BatchNorm1d