Utilizing crushed waste glass as a substitute for natural aggregate in asphalt mixtures presents significant economic potential and environmental protection advantages. However, compared with natural aggregates, the low-strength glass aggregates are prone to crushing under load, necessitating an investigation into the crushing behavior of glass aggregates under load and its influence on the performance of asphalt mixture. In this paper, the crushing behavior of the mixture was analyzed through rotational compaction test and digital image processing technology, using the aggregate crushing index of the mixture as an indicator to evaluate its road performance. The results show that as the number of compaction times and the proportion of glass aggregates increase, the aggregate crushing index of the mixture rises, leading to more pronounced crushing phenomena in glass asphalt mixtures, primarily due to the crushing of glass aggregates. By extracting the void information from the cross-section of the glass asphalt mixture specimen, it is found that the void number and the void area in the mixture decrease with an increase in the number of compaction times and the proportion of glass aggregates. Within a certain range of glass content, the crushing behavior of glass aggregates significantly impacts the road performance and durability of the asphalt mixture, while having no noticeable effect on skid resistance. As the aggregate crushing index of the glass asphalt mixture increases, the high-temperature performance of the mixture deteriorates; when the crushing index is greater than 4.45%, its resistance to high-temperature deformation does not meet the specification requirements. Conversely, when the crushing index is below 3.25%, the low-temperature cracking resistance, water stability, and durability of the mixture are improved, but exceeding this threshold adversely affects the mixture’s low-temperature cracking resistance, water stability, and durability. Therefore, it is suggested that the glass content in glass asphalt mixture should not exceed 20%, and the number of rotary compaction times should not exceed 150.