Judge Sullivan is married to Lis Sullivan of Denmark, who is an artist and field anthropologist with expertise in bound-foot women of China. Their daughter Kim is a graduate of Columbia University and producer for CNBC in New York City. Their son Eugene II is a litigator in Washington DC and a graduate of Duke University, The London School of Economics, and Columbia Law.