Music literacy education plays a unique role in the process of quality education for college students in higher vocational colleges in its unique form. At present, due to the influence of various reasons, there are still some problems in the development of music literacy education in vocational colleges. To solve these problems well, we must start with formulating reasonable teaching plans, strengthening the construction of teaching staff, and improving teaching methods. Starting from the idea of system theory, it is of great significance and value to grasp the structure, purpose, hierarchy, integrity, coordination, and dynamics of music education in colleges and universities. Based on the idea of system theory, this paper conducts research on music education in colleges and universities, hoping to be beneficial to the development of music education in colleges and universities.