You can't tell a person what they should and should not feel. I feel exactly the same. Transformers and Spider-Man follow a very similar plot line, but HM and Mermaid and IASW and Pirates each have a distinct feel to their rides. Nothing about the rides other than the RV reminds me of the other.
Basically, when i'm on TF, I think of Spidey almost every time when we go past the scene where the fire SHOULD be. I literally never think of HM while on Mermaid or think of ISAW while on Pirates (or vice-versa).
If it's different for you, then great, that's you. Not everyone is you though. Sometimes you should try to remember that.