I guess the best way to put it is a Ferrari really quicker than a F100?
A good bike makes a lot of difference, rotating mass (wheels, tyres etc) more than static mass (frame).
I have a carbon fibre Eddy Merckx and it is a dream to ride, could not imagine doing a long ride on a hybrid.
The important thing is how much do you want to get into it? That 1 question dictates how much money you poor into the hardware.