Background: The exact focus of computed tomography (CT)-based artificial intelligence techniques when staging liver fibrosis is still not exactly known. This study aimed to determine both the added value of splenic information to hepatic information, and the correlation between important radiomic features and information exploited by deep learning models for liver fibrosis staging by CT-based radiomics. Methods: The study design is retrospective. Radiomic features were extracted from both liver and spleen on portal venous phase CT images of 252 consecutive patients with histologically proven liver fibrosis stages between 2006 and 2018. The radiomics analyses for liver fibrosis staging were done by hepatic and hepatic–splenic features, respectively. The most predictive radiomic features were automatically selected by machine learning models. Results: When using splenic–hepatic features in the CT-based radiomics analysis, the average accuracy rates for significant fibrosis, advanced fibrosis, and cirrhosis were 88%, 82%, and 86%, and area under the receiver operating characteristic curves (AUCs) were 0.92, 0.81, and 0.85. The AUC of hepatic–splenic-based radiomics analysis with the ensemble classifier was 7% larger than that of hepatic-based analysis (p < 0.05). The most important features selected by machine learning models included both hepatic and splenic features, and they were consistent with the location maps indicating the focus of deep learning when predicting liver fibrosis stage. Conclusions: Adding CT-based splenic radiomic features to hepatic radiomic features increases radiomics analysis performance for liver fibrosis staging. The most important features of the radiomics analysis were consistent with the information exploited by deep learning.