Do refugees and IDPs present an obstacle to sustainable peace

Do refugees and IDPs present an obstacle to sustainable peace? How? Why? What are those obstacles?