Yes, it is congress's job. The constitution allows both chambers to expel members for various reasons. At the same time, they can't be recalled by their states. The constitution is pretty vague on what charges they can be expelled for so it's whatever Nancy or Chucky say it is.