Recent ferry services for Isle of Wight residents have "simply not been good enough", the prime minister told an island MP.