Can you survive in Japan without speaking Japanese?

I apologize for this silly question, but how likely will I be able to survive in Japan with only being able to speak English and unable to write Japanese? I can understand and speak a bit Japanese but not well enough to start conversations and ask questions. Are there places that are populated with more westerners or English speakers?

Tough but I am the living proof of it.

Thank you for your reply, how long have you've been living in Japan. What are some of the difficulties you've faced there during your stay?

I am lucky, my wife is Japanese. I have been here for too long..lol..7 years I believe.