Outside of the original trilogy, I kind of just view each successive movie as individual movies, with actors that we enjoy seeing in those roles. Like, each one a parallel reality with minor things altered or changed, but core elements the same (ie, Xavier and Magneto having a troubled past, Mystiques relationship with both of them, etc etc).
When the movie is fun, or good (like DOFP, Logan), it's something I can overlook and just enjoy the fun/good story the filmmakers came up with. But when it's bad (Apocalypse), it sticks out more. Like, I think setting X-Men movies in the 60's, 70's, 80's and 90's is a neat idea. The problem was then trying to pretend that they're all interconnected without even attempting to alter the appearances of the cast, or age up some of the actors. That's silly, but ultimately doesn't bother me.
Logan, if you want to dissect it, falls apart when trying to fit it into the established X timeline. But if you just roll with what the story is trying to evoke, it's great. Definitely my favorite. Yeah, it leans heavily on our affection for Jackman and Stewart's portrayal as Logan and Xavier, respectively, but it works.
Days of Future Past, for me, is the end of the X-Men film series. I thought it was a fun amalgamation of the original cast and the first class cast, and was a fun, entertaining movie.
Apocalypse and Phoenix are just "what ifs" to me. And I actually don't hate Dark Phoenix. It's just not very memorable for me. Entertaining, but dumb. Better than Apocalypse though.