When the fluid in a Bartholin gland cyst (or the gland itself) becomes infected, a collection of pus develops and the surrounding area may become inflamed. Escherichia coli is the most common cause of a Bartholin gland abscess.