I'm trying to use layer/matting but it is greyed out. Probably a really simple thing, but what format/mode does the image have to be in for matting to be ungreyed?
You need to be working on a layer to start with. If you only have the Background layer, double click it in the layers palette to change it into a proper layer.