In this paper, a novel adaptive active contour model based on image data field for image segmentation with robust and flexible initializations is proposed. We firstly construct a new external energy term deduced from the image data field that drives the level set function to move in the opposite direction along the boundaries of object and an adaptive length regularization term based on the image local entropy. The designed external energy and length regularization term are then incorporated into a variationlevel set framework with an additional penalizing energy term. Due to the adaptive sign–changing property of the external energy and the adaptive length regularization term, the proposed model can tackle images with clutter background and noise, the level set function can be initialized as any bounded functions (e.g., constant function), which implies the proposed model is robust to initialization of contours. Experimental results on both synthetic and real images from different modalities confirm the effectiveness and competivive performance of the proposed method compared with other representative models.