I agree with Alto, Corys are a shoaling fish but also in my experience like a slower tank hence why i think Alto's suggestion of moving the Rummy...
How many Pygmy Cories do you have?
I like Rummynoses!
What are your water parameters?
Separate names with a comma.