The actual name of this critter was 'The Lake Worth Monster'. The Goat Man was said to live on the island off of Mosque Point.
The Monster was active in an area above the Lake Worth Nature center that backed up to what was then called 'The Goat Farm', so perhaps this is where the Goat Man confusion comes in.
Google the Goat Farm. It is a story unto itself.