Jimmy is officially saying goodbye to “Late Night” before he heads over to take Jay Leno’s spot on “The Tonight Show.” And to give one final farewell to his 30 Rock digs, the SNL alum is joined by The Muppets to perform “The Weight” from “The Last Waltz.”

Good luck on the other side, Jimmy!