Hmm... tried doing some more research and it could be this thing called "Sleep state misperception": https://en.wikipedia.org/wiki/Sleep_state_misperception