In this paper, an improved association rule algorithm based on vector product is used. This algorithm only needs to scan the transaction database once and does not generate a large number of frequent item candidate sets. The algorithm first maps the set of data transactions into a matrix of vectors, each column vector representing an attribute. Matrix factorization algorithms usually decompose the original data matrix into two or more low-dimensional matrices. This paper analyzes the common problems existing in society, colleges, and families in labor education, and innovatively proposes a four-dimensional comprehensive evaluation index system for labor education in colleges and universities, including “subject-dominated colleges—family education support—social environment support—college students’ individual characteristics”.