The current study is the first study to emphasize family systems, violent norms, and violent peer association as three domains of the social environment that influence both adolescent violent offending and victimization among Chinese adolescents using a longitudinal sample. Under the framework of cultural spillover theory, the purpose of the current study was to explore how these three factors influenced adolescent violent offending and victimization. A total of 1192 middle and high school students were randomly selected from one of the largest cities in Southwest China. Structural equation model analysis was applied to investigate the direct and indirect effect of violence in the family system on violent offending and victimization. The results indicated that violent offending and victimization overlapped among Chinese adolescents. Violent peer association and acceptance of the violence norm fully mediated the effect of violence in the family system on violent offending, and partially mediated the effect of violence in the family system on violent victimization. In conclusion, adolescents who had experienced violence in their family system were more likely to be exposed to violent peer influences and to accept violent norms, which increased the likelihood of violence perpetration and victimization later in their life.