Consultants based at Altnagelvin Hospital in Derry may not be willing to travel to Fermanagh, according to a union rep.