The house was built in 1479 for aristocrat Giovanni Dario. His daughter Marietta and her husband Vincenzo later inherited the house. Vincenzo was stabbed to death, and Marietta died by suicide in the Grand Canal not long after. Shortly after these tragedies, their son Vincenzo Jr. was killed in Crete by assassins.

The cursed house claimed another victim when British scientist Radon Brown became its owner. After having the house for only four years, he suffered financial difficulties and his romantic relationship with another man was discovered. The scandal affected him so much that in 1842 he died by suicide in the palace with his partner (some speculate that the deaths were a murder-suicide).