Protein-ligand interaction (PLI) shapes efficacy and safety profiles of small-molecule drugs. Most existing methods rely on resource-intensive computation to predict PLI based on structural information. Here we show that a light-weight graph neural network (GNN), trained with quantitative PLIs of a small number of proteins and ligands, is able to predict the strength of unseen PLIs. The model has no direct access to structural information of protein-ligand complexes. Instead, the predictive power is provided by encoded knowledge of proteins and ligands, including primary protein sequence, gene expression, protein-protein interaction network, and structural similarities between ligands. Our novel model performs competitively with or better than structure-aware models. Our results suggest that existing PLI-prediction methods may be further improved by using omics data and representation learning techniques that embed biological and chemical knowledge.