Quantum computers represent a new computing paradigm and have the potential to serve as a disruptive tool for scientific discovery and practical applications. However, they face the fundamental challenges of errors and decoherence. Quantum error correction (QEC) and fault-tolerant quantum computation (FTQC) are therefore crucial for realizing the promise of quantum computing. In this talk, I will describe how recent experimental and theoretical advances motivate new architectures for fault-tolerant quantum computers. I will first present our realization of early-FT logical algorithms and key building blocks of large-scale universal FTQC in neutral atom quantum computers. Motivated by these emerging capabilities of hardware architectures, I will then describe how theoretical advances, such as quantum low-density parity-check codes and improved fault tolerance constructions, can enable drastic reductions in the space and time overhead of FTQC. Altogether, this co-design of hardware architecture, quantum error correction, and quantum algorithms represents a promising path to architecting utility-scale quantum computers.