In the paper, the adaptive observer and controller designs based fuzzy approximation are studied for a class of uncertain nonlinear systems in strict feedback. The main properties of the considered systems are that all the state variables are not available for measurement and at the same time, they are required to limit in each constraint set. Due to the properties of systems, it will be a difficult task for designing the controller and the stability analysis. Based on the structure of the considered systems, a fuzzy state observer is framed to estimate the unmeasured states. To ensure that all the states do not violate their constraint bounds, the Barrier type of functions will be employed in the controller and the adaptation laws. In the stability analysis, the effect caused by the constraints for all the states can be overcome by using the Barrier Lyapunov functions. Based on the proposed control approach, it is proved that the system output is driven to track the reference signal to a bounded compact set, all the signals in the closed-loop system are guaranteed to he hounded, and all the states do not transgress their constrained sets. The effectiveness of the proposed control approach can be verified by setting a simulation example.