With the increasing penetration of renewable energy resources (RESs), the uncertainties of volatile renewable generations significantly affect the power system operation. Such uncertainties are usually modeled as stochastic variables obeying specific distributions by neglecting the temporal correlations. Conventional approaches to hedge the negative effects caused by such uncertainties are thus hard to pursue a trade-off between computation efficiency and optimality. As an alternative, the theory of stochastic process can naturally model temporal correlation in closed forms. Attracted by this feature, our research group has been conducting thorough researches in the past decade to introduce stochastic processes within renewable power systems. This paper summarizes our works from the perspective of both the frequency domain and the time domain, provides the tools for the analysis and control of power systems under a unified framework of stochastic processes, and discusses the underlying reasons that stochastic process-based approaches can perform better than conventional approaches on both computational efficiency and optimality. These work may shed a new light on the research of analysis, control and operation of renewable power systems. Finally, this paper outlooks the theoretic developments of stochastic processes in future’s renewable power systems.