Earlier studies have mostly identified pre-therapeutic clinical and laboratory parameters for the prediction of treatment response to [177Lu]Lu-PSMA-617 in metastatic castration resistant prostate cancer patients (mCRPC). The current study investigated whether imaging-derived factors on baseline [68Ga]Ga-PSMA-11 PET/CT can potentially predict the response after two cycles of [177Lu]Lu-PSMA-617 treatment, in a lesion- and patient-based analysis in men with mCRPC. Included patients had histologically proven mCRPC and a [68Ga]Ga-PSMA-11 PET/CT before and after two cycles of [177Lu]Lu-PSMA-617 treatment. The imaging-based response was evaluated on lesion-level (standardized uptake value (SUV) reduction) and patient-level (total lesion PSMA (TL-PSMA) reduction). In the lesion-level analysis, a clear relationship was found between SUVpeak/max and the imaging-based response to [68Ga]Ga-PSMA-11 PET/CT (most avid lesion SUVpeak/max ≥30% reduction) (p < 0.001), with no significant difference in cut-off values between different sites of metastases (i.e., lymph node, bone or visceral metastasis). In patient-level analysis, baseline PSA and SUVpeak values of most avid metastasis were significantly associated with imaging-based response (TL-PSMA ≥30% reduction) (p = 0.019 and p = 0.015). In pre-treatment with [68Ga]Ga-PSMA-11 PET/CT, a clear accumulation-response relationship in lesion-level was found for SUVpeak/max in men with mCRPC receiving two cycles of [177Lu]Lu-PSMA-617 treatment. The SUVpeak of the most avid lesion was the only image-derived factor predictive of the imaging-based response at the patient-level.