Another side effect of too much (or too-old, sticky) oil can be a rosin-like squeaking of fingertips on the board, a bit like trainers on a marble floor.

But if you do this, don't panic. Don't start buying glamourous fingerboard cosmetics (you'll just seal the problem in, or even introduce Teflon into your problem); just keep playing (and maybe wiping a bit) and it will go away.
Light oiling is good, and once a year is plenty, whatever anyone's marketing guys say.
My personal vote is for the nice simple "Fret Doctor"

, but I don't keep it past four years old.