Up to 30 migrants are feared dead after a boat capsized off the Libyan coast while some 50 have been rescued by EU vessels from the sea.