Can I mute notifications per group? Can I mute all groups at once?

Yes!

You can mute just one group in that specific group's Settings.

You can mute all of the groups in your GroupMe global Settings.