Repair of DNA double-strand breaks by the nonhomologous end joining pathway is central for proper development of the adaptive immune system. This repair pathway involves eight factors, including XRCC4-like factor (XLF)/Cernunnos and the paralog of XRCC4 and XLF, PAXX nonhomologous end joining factor (PAXX). Xlf−/− and Paxx−/− mice are viable and exhibit only a mild immunophenotype. However, mice lacking both PAXX and XLF are embryonic lethal because postmitotic neurons undergo massive apoptosis in embryos. To decipher the roles of PAXX and XLF in both variable, diversity, and joining recombination and immunoglobulin class switch recombination, here, using Cre/lox-specific deletion to prevent double-KO embryonic lethality, we developed two mouse models of a conditional Xlf KO in a Paxx−/− background. Cre expressed under control of the iVav or CD21 promoter enabled Xlf deletion in early hematopoietic progenitors and splenic mature B cells, respectively. We demonstrate the XLF and PAXX interplay during variable, diversity, and joining recombination in vivo but not during class switch recombination, for which PAXX appeared to be fully dispensable. Xlf/Paxx double KO in hematopoietic progenitors resulted in a shorter lifespan associated with onset of thymic lymphomas, revealing a genome caretaking function of XLF/PAXX.