Was it wrong of Yosef to try and help himself?

Many understand Rashi as criticizing Yosef for making an effort on his own behalf rather than relying on Hashem. Is this really what Rashi is saying? And what do the pesukim say?