Factual Challenge to the Legend
One theory suggests that not much of the Venice can be seen from the windows of the bridge. Thus, the sighs were actually the last breaths of the prisoners in the free world, who knew once they entered the prison cells, they will never be released again.