We discuss an overtly “simple approach” to complex biological systems borrowing selectively from theoretical physics. The approach is framed by three maxims, and we show examples of its success in two different applications: investigating cellular robustness at the level of gene regulatory networks and quantifying rare events of DNA replication errors.