From my memories at GT near the turn of millennium, most work in CS was already programmatically gradable. The course descriptions look every bit as rigorous. Seems the only real difference is the level of access to personal assistance in the class.
Same memories here for the everything through senior year of BS, but after that things were more self defined projects with a lot more gray area for functionality, API definitions, etc.
I thought/have heard secondhand here that MS was more along those lines, but I may be completely wrong there.
I only did undergrad there, but was friends with several MS students. It seemed to largely differ course to course. Some were more research/project oriented, and others seemed more like an undergrad course with a narrower focus. Format might have even differed based on professor. Either way it doesn't seem a stretch to use autograding for a MS, at least for non-thesis options.