Argyle House could be demolished and redeveloped - but the plan is coming up against criticism from conservationists, heritage bodies and architects.