For some men it can only take a few minutes, for others it can take longer, it all depends upon you! If you are having problems you can either try using a prostate stimulator as your finger may be too short to massage your prostate properly or what works really well for some men is to lay on your side.
Take your time, it will happen!