The COVIDâ19 pandemic is spreading at a fast pace around the world and has a high mortality rate. Since there is no proper treatment of COVIDâ19 and its multiple variants, for example, Alpha, Beta, Gamma, and Delta, being more infectious in nature are affecting millions of people, further complicates the detection process, so, victims are at the risk of death. However, timely and accurate diagnosis of this deadly virus can not only save the patients from life loss but can also prevent them from the complex treatment procedures. Accurate segmentation and classification of COVIDâ19 is a tedious job due to the extensive variations in its shape and similarity with other diseases like Pneumonia. Furthermore, the existing techniques have hardly focused on the infection growth estimation over time which can assist the doctors to better analyze the condition of COVIDâ19âaffected patients. In this work, we tried to overcome the shortcomings of existing studies by proposing a model capable of segmenting, classifying the COVIDâ19 from computed tomography images, and predicting its behavior over a certain period. The framework comprises four main steps: (i) data preparation, (ii) segmentation, (iii) infection growth estimation, and (iv) classification. After performing the preâprocessing step, we introduced the DenseNetâ77 based UNET approach. Initially, the DenseNetâ77 is used at the Encoder module of the UNET model to calculate the deep keypoints which are later segmented to show the coronavirus region. Then, the infection growth estimation of COVIDâ19 per patient is estimated using the blob analysis. Finally, we employed the DenseNetâ77 framework as an endâtoâend network to classify the input images into three classes namely healthy, COVIDâ19âaffected, and pneumonia images. We evaluated the proposed model over the COVIDâ19â20 and COVIDx CTâ2A datasets for segmentation and classification tasks, respectively. Furthermore, unlike existing techniques, we performed a crossâdataset evaluation to show the generalization ability of our method. The quantitative and qualitative evaluation confirms that our method is robust to both COVIDâ19 segmentation and classification and can accurately predict the infection growth in a certain time frame.