Increasing traffic congestion is a major obstacle to the development of cities. The prediction of traffic flow is very important to city planning and dredging. A good model of flow is able to accurately predict future flow by learning historical flow data. Traffic flow is usually affected by macro and micro factors. At the macro level, the whole city can be divided into different subregions according to the similarity in the traffic flow patterns. At the micro-level, there is a temporal and spatial correlation between the traffic flow of different road sections at di fferent times. In this paper, we propose a multi-mode traffic flow prediction method with Clustering based Attention Convolution LSTM (CACLSTM) to model spatial-temporal data of traffic flow. The framework includes three modules: a convolution LSTM encoding-decoding layer which is used to predict the traffic flow of the next time slice by encoding the historical traffic information, a clustering based attention layer which is able to extract different temporal features by clustering based attention, and an additional factors layer which can integrate weather, wind speed, holidays and other factors to improve the prediction accuracy. The experimental results on Beijing taxis data show that the CACLSTM method performs more effective than the six well-known compared methods.