Generation of induced cardiomyocytes (iCMs) directly from fibroblasts offers a great opportunity for cardiac disease modeling and cardiac regeneration. A major challenge of iCM generation is the low conversion rate. To address this issue, we attempted to identify small molecules that could potentiate the reprogramming ability towards cardiac fate by removing inhibitory roadblocks. Using mouse embryonic fibroblasts as the starting cell source, we first screened 47 cardiac development related epigenetic and transcription factors, and identified an unexpected role of H3K4 methyltransferase Mll1 and related factor Men1 in inhibiting iCM reprogramming. We then applied small molecules (MM408 and MI503) of Mll1 pathway inhibitors and observed an improved efficiency in converting embryonic fibroblasts and cardiac fibroblasts into functional cardiomyocyte-like cells. We further observed that these inhibitors directly suppressed the expression of Mll1 target gene Ebf1 involved in adipocyte differentiation. Consequently, Mll1 inhibition significantly decreased the formation of adipocytes during iCM induction. Therefore, Mll1 inhibitors likely increased iCM efficiency by suppressing alternative lineage gene expression. Our studies show that targeting Mll1 dependent H3K4 methyltransferase activity provides specificity in the process of cardiac reprogramming. These findings shed new light on the molecular mechanisms underlying cardiac conversion of fibroblasts and provide novel targets and small molecules to improve iCM reprogramming for clinical applications.