Spinless systems exhibit unique topological characteristics compared to spinful ones, stemming from their distinct algebra. Without chiral interactions typically linked to spin, an intriguing yet unexplored interplay between topological and structural chirality may be anticipated. Here we discover spinless topological chiralities solely from structural chiralities that lie in the 3D spatial patterning of structureless units, exemplified using two types of twisted graphite systems. In a 3D screw twisted structure without periodicity in all directions, we find a chiral Weyl semimetal phase where bulk topology and chiral surface states are both determined by the screw direction. And in a 3D periodic structure formed with layer-alternating twist angle signs, a higher-order Dirac semimetal with chiral hinge states is discovered. Underlying these novel topological states is the intervalley Umklapp scattering that captures the chirality of the twisted interfaces, leading effectively to a sign-flipped chiral interlayer hopping, thereby introducing $\pi$-flux $\mathbb{Z}_2$ lattice gauge field that alters the symmetry algebra. Our findings point to a new pathway for engineering topological chirality through patterning twisted arrays of featureless units, which can expand the design principles for topological photonics and acoustics.