You may hear House members calling for his ouster after the resignations of Reps. Tony Gonzales and Eric Swalwell, but Rep.