Presumptive Democratic nominee Joe Biden on Tuesday said the federal government has a responsibility to protect statues and monuments of historical figures like George Washington, Thomas Jefferson and Christopher Columbus.

Speaking at a press conference in Wilmington, Del., the former vice president defended monuments dedicated to past presidents who owned slaves. Biden made the case that those public statues should be preserved, while monuments to Confederate leaders should be removed peacefully by local officials.