Remova a tecla Tabpage por chave
tabControl1.TabPages.RemoveByKey("tabPage1");
Lonely Lyrebird
tabControl1.TabPages.RemoveByKey("tabPage1");