Growth and fat deposition are complex traits, which can affect economical income in the pig industry. Due to the intensive artificial selection, a significant genetic improvement has been observed for growth and fat deposition in pigs. Here, we first investigated genomic-wide association studies (GWAS) and population genomics (e.g., selection signature) to explore the genetic basis of such complex traits in two Large White pig lines (n = 3,727) with the GeneSeek GGP Porcine HD array (n = 50,915 SNPs). Ten genetic variants were identified to be associated with growth and fatness traits in two Large White pig lines from different genetic backgrounds by performing both within-population GWAS and cross-population GWAS analyses. These ten significant loci represented eight candidate genes, i.e., NRG4, BATF3, IRS2, ANO1, ANO9, RNF152, KCNQ5, and EYA2. One of them, ANO1 gene was simultaneously identified for both two lines in BF100 trait. Compared to single-population GWAS, cross-population GWAS was less effective for identifying SNPs with population-specific effect, but more powerful for detecting SNPs with population-shared effects. We further detected genomic regions specifically selected in each of two populations, but did not observe a significant enrichment for the heritability of growth and backfat traits in such regions. In summary, the candidate genes will provide an insight into the understanding of the genetic architecture of growth-related traits and backfat thickness, and may have a potential use in the genomic breeding programs in pigs.