AFAIK congress cannot overthrow a president for being unworthy or acting illegally.

Yes it can- this is literally what the impeachment process is. The problem is what happens when you have a political party that is every bit as guilty and refuses to charge or convict an obviously criminal president.