RL for ChungLi Traffic 400 tiers

 市區交通模擬，如何控制燈號以增進運輸量 (RL)

    Birds' eye view and follow mode

 (credit: 與專題生共同創作)

sample, share

🚦 RL Traffic Control — Train, Save, Compare

Agents persist across sessions • Continue training anytime

🎮 Training (1747 episodes)

1x5x10x20x

1747

Episodes

5%

Exploration

1358079

Q-Table

-303.5

Avg R (10)

Learning Curve

🚦 RL Traffic Control — Train, Save, Compare

Agents persist across sessions • Continue training anytime

📊 Comparison Complete

Metric

❌ Untrained

✅ Trained (1688 eps)

Total Reward

-359.8

-158.8(+56%)

Throughput

17

21

Avg Wait

44.3

29.2

✓ Learning Verified! Trained agent outperformed random.

HW#11 Reinforcement Learning (RL)

任選一題即可

 1. Use RL to train a robot to walk.

Must obey Physics law.

Start from zero knowledge.

2. Train the robot in the following scenario to cross the road.

scenario setting artifact

3. Use RL to train something you are interested in.

A* Maze

Robot Maze (share)

robot

RF IC Design Optimization- LNA with mathematical optimization & NGSpice

Methodology

Optimized vs. Original (5 GHz), md, Reality check (slides), md, 

schematic (grandparent) Sub 6 GHz

schematic 0.6 – 6 GHz (Sub-6),slides, slides+

running ngspice in Claude VM (findings, ill., also Cadence below, handout md) 5 GHz

recover from disaster

ngspice vs MNA overlay

initial parameters running MNA (findings, ill., handout md, detail md)

optimized parameters using MNA (share, handout md)

 father optimized from grandparent

Use Cowork with local VM

analytical (closed-form) vs. MNA

auto-correction of model, auto-optimize parameters

until all specs pass

CoWork Fable 5.0 update

MNA/Ngspice Overlay 

 Cadence

Cadence files (slides) LNA approximation, Spice vs Spectre PSS slides, PSS on LNA slides

P1dB, IIP3, Two-Tone from PSS Analysis (What's this: Explain P1dB, IIP3, Two-Tone, corrected)

__________________________________________________________________________________

debug journal why I am here

final design

(final) Mirror-Biased 5 GHz Cascode LNA

P1dB, IIP3, Two-Tone from PSS Analysis

IIP3 by PSS Analysis

lineage

dev log 5 GHz LNA

Supplemental

One-stage vs. tw-stage LNA, which is better?

AI-Assisted Workflow Speedup

AI 在IC設計的應用 Cadence AI-Powered Design Solutions

Design Space Optimization