I have good luck with "Sticker Shock" or a comparable product.
It is designed to remove exactly what you are talking about...
Nasty glue left from bumper stickers, removing complete stickers off of paint.
Hell, it even works very well in removing dial in ( or shoe polish) off of windows.
2cents