Sport, Arts and Culture Minister Gayton McKenzie has vowed to withdraw his party, the PA, from the Government of National Unity.