Possible Clues:

• That's a poor sort of way to be sort of refuse
• Shack; sea song
• Sailor's work song - ramshackle hut
• Poor housing
• Refused to build this over the Wye, by the sound of it
• Sea song - hovel
• The way of 21 across for a song of the sea
• Only a shack, but it gets sea air
• A song of the sea that won't go on the Wye
• Ramshackle dwelling