Substantial studies have investigated the social influence effect; however, how individuals with different social value orientations (SVOs), prosocials and proselfs, respond to different social influences remains unknown. This study examines the impact of positive and negative social information on the responses of people with different SVOs. A face-attractiveness assessment task was employed to investigate the relationships between influence probability, memory, and event-related potentials of social influence. A significant interactional effect suggested that prosocials and proselfs reacted differently to positive (group rating was more attractive) and negative (group rating was less attractive) social influences. Specifically, proselfs demonstrated significantly higher influence probability, marginally better recall performance, smaller N400, and larger late positive potential on receiving negative influence information than on receiving positive influence information, while prosocials showed no significant differences. Overall, correlations between N400/LPP, influence probability, and recall performance were significant. The above results indicate the modulating role of SVO when responding to social influence. These findings have important implications for understanding how people conform and how prosocial behavior occurs.