Training dynamics, optimization & algorithm–hardware co-design