This paper extends the deep material network (DMN) proposed by Liu et al. (2019) [1] to tackle general 3-dimensional (3D) problems with arbitrary material and geometric nonlinearities. It discovers a new way of describing multiscale heterogeneous materials by a multi-layer network structure and mechanistic building blocks. The data-driven framework of DMN is discussed in detail about the offline training and online extrapolation stages. Analytical solutions of the 3D building block with a two-layer structure in both small-and finite-strain formulations are derived based on interfacial equilibrium conditions and kinematic constraints. With linear elastic data generated by direct numerical simulations on a representative volume element (RVE), the network can be effectively trained in the offline stage using stochastic gradient descent and advanced model compression algorithms. Efficiency and accuracy of DMN on addressing the long-standing 3D RVE challenges with complex morphologies and material laws are validated through numerical experiments, including 1) hyperelastic particle-reinforced rubber composite with Mullins effect; 2) polycrystalline materials with rate-dependent crystal plasticity; 3) carbon fiber reinforced polymer (CFRP) composites with fiber anisotropic elasticity and matrix plasticity. In particular, we demonstrate a threescale homogenization procedure of CFRP system by concatenating the microscale and mesoscale material networks. The complete learning and extrapolation procedures of DMN establish a reliable data-driven framework for multiscale material modeling and design.anisotropic responses, and may require burdensome calibration to find the model parameters. As a result, homogenization based on the concept of representative volume element (RVE) [11] has become an important approach to model multiscale materials [12]. Many analytical methods have been proposed, which adopt some micromechanics assumptions to simplify the full-field RVE problem, such as Hashin-Shtrikman bounds [13,14], the Mori-Tanaka method [15] and self-consistent methods [16]. Since most analytical methods are derived based on the solution for regular geometries and simple material models (e.g. Eshelby's solution for isotropic elastic materials [17]), it is usually difficult for them to consider complex microstructural morphologies, history-dependent materials and large deformations. Additionally, direct numerical simulation (DNS) tools, such as finite element [18], meshfree [19,20] and fast Fourier transform (FFT)-based micromechanics methods [21,22], are both flexible and accurate. However, a DNS model involves a detailed meshing of the RVE microstructures and requires tremendous computational cost, especially for 3D problems. Therefore, one of the fundamental issues in multiscale material modeling and design is how to find an accurate low-dimensional representation of the RVE for arbitrary morphologies and nonlinearities.In the past decade, a plethora of data-driven material modeling methods have been proposed based on exist...