Someday I want to try ripping out chapters of my favorite books and pasting them into a notebook in a new sequence just to see what it's like.
It's a very awkward analogy. Let me explain: books have plot, main & 2ndary characters, fabula & such. If you change the sequence, it won't make any sense. Long players, on the contrary, are just a mixture of songs glued together regardless of what the song's about, whether track 5 is a logical follower of events in track 4 or not, so they
already have
no specific order. Yes, there's a thing called "the concept album" but we're talking here about the general idea of LP. Like Sheriff John & donald, I also think rearranging is fun & nothing to be strict about. Doesn't mean I can't play the album in its original sorted way sometime.
At the end of the day, though, I think you are just being nostalgic & feel like the album loses its authentic sound & charm. That's fine & perfectly understandable.