You delete the calendar note either by deleting all text it contains, or by using a pop-up menu.
Selecting Delete Note deletes note at selected cell. But don't forget that the calendar note will never be deleted into the note bin.