I don't have a problem with someone who is uncomfprtable with Topic Z being on a panel about Topic Z if a) they own their discomfort, b) are open to discussion of all aspects of Topic Z (not just "Please make me more comfortable!") and c) the panel is designed to allow discussion of discomforts.