Neighbors say Lafayette County asphalt plant will harm community