Conceptual preparation is the very initial step in language production. Endogenous semantic variables, reflecting the inherent semantic properties of concepts, could influence the productive lexical retrieval by modulating both conceptual activation and lexical selection. Yet, empirical understandings on this process and underlying mechanisms remain limited. Here, inspired by previous theoretical models and preliminary findings, we proposed a Behavioral-Neural Dual Swinging Model (DSM), revealing the swinging process between conceptual facilitation and lexical interference and extending to neural resource allocation during these processes. To further test the model, we examined the joint effect of semantic richness and semantic density on productive word retrieval both behaviorally and neurally, using a picture naming paradigm. Results nicely support the DSM by showing that the productive retrieval is driven by the swinging between semantic richness-induced conceptual facilitation primarily managed in semantic-related regions and semantic density-induced lexical interference managed in control-related regions. Moreover, the conceptual facilitation accumulated from semantic richness plays a decisive role, mitigating interference from competitors as well as the neural demands in control-related regions.