And they did nothing about it.
UPDATE September 30, 2006: Alexander notified Rep. John Shimkus (R-Illinois), who says "We ordered Congressman Foley to cease all contact with this former House page to avoid even the appearance of impropriety." Also informed was Majority Leader John Boehner (R-Ohio), who blocked a vote yesterday on a resolution from Minority Leader Nancy Pelosi calling for a preliminary investigation into the matter and the Republican leadership's response to it by the House Ethics Committee. Boehner nixed the latter part, and a motion was passed to investigate Foley's conduct but not the Republican leadership's handling of the matter.
It's also now been verified that Dennis Hastert was told about this issue "months ago".