I'm afraid that I will never have a sense of direction while driving?

I do not want to depend on a gps all the time or risk my life looking at a map while driving. I see others with no problem they just start the car and go without a map or gps. Maybe I have some brain disorder or something I'm not sure maybe I just need to drive more. I do not drive that often but when I do it's hell. My mom said to remember landmarks but that's easy to say and hard to do when your focused on driving alright im just rambling now but I need help someone help me thanks I want to be independent I can't even drive alone I'm in my twenties.