Heritage Victoria has refused to grant a permit for the first stage of work towards a $1 billion project in the area surrounding Richmond’s Nylex Clock, sighting issues with the development’s height.