I'm guessing that you have a synchro problem. If you have a linkage alignment problem it will usually give problems over most of the gear range, so maybe it's not the linkage.

It's also possible that if your engine mounts are damaged or really worn out, the engine is shifted enough that you aren't getting proper alignment.