The ensemble of fuzzy clustering can address the problems presented in the base clustering, such as fluctuations in results due to random initialization and performance degradation due to outliers. However, the performance of fuzzy clustering ensembles is still hampered by some challenges that include misaligned membership matrices, loss of information in the co-similarity matrix, large storage space, unstable ensemble results due to an additional re-clustering, the need for original data information for assistance, etc. To address these issues, we propose a parameter-free robust ensemble framework for fuzzy clustering. After obtaining the set of membership matrices, we cascade these membership matrices and mine the latent spectral matrix of the raw data. Benefiting from this step, we obtain global features of the dataset without knowing the specific data. Then, our framework uses transition matrices to solve the alignment problem, avoiding the storage of large-scale matrices. Most importantly, we introduce a robust weighted mechanism in the optimization model, where each base clustering is adaptively adjusted and the effect of outliers is suppressed by a robust function. In addition, the model yields the results as a membership matrix, which produces the exact partition results directly without any subsequent clustering operations. Finally, since our model is a parameter-free model, the setting of hyper-parameters is avoided and the applicability of the model is improved as well. The effective algorithm of the optimization model is derived and its time complexity and convergence are analyzed. The results of competitive experiments on benchmark data show that the proposed ensemble framework is effective compared to state-of-the-art methods.