When you mute a chat, it will be identified by a specific icon in the chat overview.
To start receiving push notifications for a muted chat again, you can click on the arrow located to the right of the chat name. After that, simply select "Turn Notifications On":
Once you've done this, you'll start receiving push notifications once more whenever there are new messages in the chat.