If you have loaded a texture is there a way to get rid of it without replacing it with another?

You could use a blank, white texture...

I think what you're looking for is the default texture upon starting a new map, which is banana.BMP ;-)