The thing is, if you look at a lot of JJK's smaller-but-still-great moments, they're actually really cleverly constructed to save on detail while still being really expressive. Yuji fighting those three transformed humans on the roof of the school is an example that'll always stick with me, because it was just so smooth, but they did it by pulling the camera way, way out so the actual forms are super low-detail and easier to animate. That's a direction thing.
Obviously, if what it takes is poor working conditions, it's not worth it. But I think there's room to give it a poke when they're clearly not delivering.
Right, this. It doesn't have to be All Sakuga All The Time, but there's really not a lot of effort being made to try and get it to look interesting from a directorial perspective. And when the manga goes out of its way to have these moments of incredibly cool paneling and framing, it's just a shame to see the anime drop the ball.