Walter was born and raised in Mobile, Alabama which he was quoted as describing as "a separate kingdom. We are not North America; we are North Haiti." He was great friends during childhood with Truman Capote but he lived far from a life of luxury, he was abandonded and left to fend for himself on the streets of Mobile.