Chimeric Antigen Receptor (CAR) T cells have changed the therapeutic landscape of hematological malignancies with overwhelming success. The clinical success of CAR T-cell therapy in hematologic malignancies has fueled interest in exploring the technology in solid tumors. However, the treatment of solid tumors presents a unique set of challenges compared to hematological tumors. The biggest impediments to the success of CAR T cell treatment are the paucity of tumor-specific antigens that are produced selectively and uniformly and the immunosuppressive tumor microenvironment. To overcome these significant challenges, nanotechnology has been involved to improve the efficacy of CAR-T cells. In this review, we systematically introduced the components of different generations of CARs and summarized recent innovations in nano-based CAR-T cell therapy to conquer therapeutically resistant non-hematologic malignancies, including mRNA and hydrogel-based CAR T cells delivery, photothermal-remodeling, and tumor microenvironment-based CAR T cell therapy. These nanotechnologies remarkably facilitate in vivo generation of CAR T cells and hold promise as a therapeutic platform to treat solid tumors and even other diseases.