For effective humanitarian response in refugee camps, reliable information concerning dwelling type, extent, surrounding infrastructure, and respective population size is essential. As refugee camps are inherently dynamic in nature, continuous updating and frequent monitoring is time and resource-demanding, so that automatic information extraction strategies are very useful. In this ongoing research, we used labelled data and highresolution Worldview imagery and first trained a Convolutional Neural Network-based U-net model architecture. We first trained and tested the model from scratch for Al Hol camp in Syria. We then tested the transferability of the model by testing its performance in an image of a refugee camp situated in Cameroon. We were using patch size 32, at the Syrian test site, a Mean Area Intersection Over Union (MIoU) of 0.78 and F-1 score of 0.96, while in the transfer site, MIoU of 0.69 and an F-1 score of 0.98 were achieved. Furthermore, the effect of patch size and the combination of samples from test and transfer sites are investigated.