Yeah. I saw this regularly about six months back, then it went away, then it came back just the other day.
I've adopted a new rule of thumb: If Steam says that I have more than 5 Downloads, I don't worry about any of them. They'll be fast whenever they happen, but they're probably not patches from the game developers and they won't affect my game play.
It's annoying, but at the end of the day the only real problem is that if there is a real update buried in that queue I'll miss it.