North Korean refugees fear time has run out for family reunions