If it just sebaceous cyst there should not be pus. Sounds like it is infected, as you have been 'messing' with it. If it is a sebaceous cyst and has ruptured, there can be an inflammatory reaction to it and make it worse. Surgical excision may be required. If it is not infected, don't mess with it. If it is infected, you may need antibiotics.