Many studies indicated that ionospheric total electron content (TEC) prediction is vital for terrestrial and space-based radio-communication systems. In previous TEC prediction schemes based on RNN, they learn TEC representations from previous time steps, and each time-step made an equal contribution to a prediction. To overcome these drawbacks, we propose two improvements in our study: (1) To predict TEC with both past and future time-step, Bidirectional Gate Recurrent Unit (BiGRU) was presented to improve the capabilities. (2) To highlight critical time-step information, attention mechanism was used to provide weights to each time-step. The proposed attentional BiGRU TEC predicting method was evaluated on the publicly available data set from the Centre for Orbit Determination in Europe. We chose three geographical locations in low latitude, middle latitude, and high latitude to verify the performance of our proposed model. Comparative experiments were conducted using Deep Neural Network (DNN), Artificial Neural Network (ANN), Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), Bidirectional Long Short-Term Term memory (BiLSTM), and Gated Recurrent Unit (GRU). Experimental results show that the proposed Attentional BiGRU model is superior to the other models in the selected nine regions. In addition, the paper discussed the effects of latitudes and solar activities on the performance of Attentional BiGRU model. Experimental results show that the higher the latitude, the higher the prediction accuracy of our proposed model. Experimental results also show that in the middle latitude, the prediction accuracy of the model is less affected by solar activity, and in other areas, the model is greatly affected by solar activity.