In the Greek, "follow" is actually two words. They mean "Follow closely behind." Half-hearted Christians have something wrong with them; they are not closely following Jesus. That's why they win few, if any, souls to Christ.
And there's something else in this verse that we often miss: it is Jesus's responsibility to make you a fisher of men. YOUR responsibility is to follow Christ closely. Then Jesus works in your life to make you more successful.