Semiconductor platforms are emerging as a promising architecture for storing and processing quantum information e.g., in quantum dot spin qubits. These setups have relatively low nuclear noise, but charge noise coming from many body interactions between the electrons is a major limiting factor with scalability for a useful quantum computer. Here we show how an electric field gradient, readily obtainable with semiconductor quantum dots, can be engineered to induce local quantum coherent dynamical ℓ−bits that have potential to be used as logical qubits. We take into account the full (interacting) electron and phonon dynamics, and analytically, from first principles without any approximation, show that these dynamical ℓ−bits are protected from all sources noise for exponentially long times provided only that the electron-phonon interaction is not completely non-local. Our work opens a new venue for passive quantum error correction and scaling of semiconductor quantum computers.