Answer to Question One: John Ashcroft was a proponent of data-mining. In 2002, he issued guidelines for terrorism investigations. They included this paragraph:
I Information Systems
The FBI is authorized to operate and participate in identification, tracking, and information systems for the purpose of identifying and locating terrorists, excluding or removing from the United States alien terrorists and alien supporters of terrorist activity as authorized by law, assessing and responding to terrorist risks and threats, or otherwise detecting, prosecuting, or preventing terrorist activities. Systems within the scope of this paragraph may draw on and retain
pertinent information from any source permitted by law, including information derived from past or ongoing investigative activities; other information collected or provided by governmental entities, such as foreign intelligence information and lookout list information; publicly available information, whether obtained directly or through services or resources (whether nonprofit or commercial) that compile or analyze such information; and information voluntarily provided by private entities. Any such system operated by the FBI shall be reviewed periodically for compliance with all applicable statutory provisions, Department regulations and policies, and Attorney General Guidelines.
Ashcroft was also a driving force behind Matrix, the multi-state police database with data mining capabilities, that would allow police to create lists of people who fit criminal profiles based on their ethnicity, address or credit history.
In June, 2003, Ashcroft testified before the House Judiciary Committee and had this to say about data-mining:
Mr. MEEHAN. If I could just follow up. Let's talk about limits on data collection then more generally. The FBI has relied on commercial databases to obtain information about existing suspects. But to what extent has the FBI been looking for patterns of terrorist activity in data that includes information about people who are not already suspects? And do we need some privacy rules to limit Government data mining in search of such patterns? And I'm just interested in what happens if the FBI relies on faulty data, either from the commercial sector or its own databases. Do Americans have any way to correct the inaccurate data that the FBI may have been relying on; in other words, whether it's commercially obtained or whether it's obtained through the FBI's own data collection?
Attorney General ASHCROFT. Well, your concern is an understandable concern, and I think we all are concerned about two things at least, probably many more. Faulty data is always a problem. You know, in the computer world we say garbage in, garbage out. So if you get bad input you're going to have a bad outcome. So we need to worry about the integrity of our data. And there is some concern about the scale of the data or there's too much data. And that's one of the reasons that I don't really believe that the FBI should be maintaining data. It's one thing to have — to go seek data if it's available someplace when you need it. It's another thing to accumulate data. And one of the things that I think protects privacy well is the idea of minimization; that you don't take more information than you need. And if you need to go get it, being able to go get it is very important.
He says the Justice Department and the Defense Department submitted a joint report on data mining and in his letter attached to the report, he raised these concerns:
....the efficacy and accuracy of search tools must be carefully demonstrated and tested, and that should be an ongoing thing. Secondly, it's critical that there be built-in operational safeguards to reduce the opportunities for abuse so that when you construct a system you ought to have checks over sites in the system and safeguards.
Number three, it's essential to ensure that substantial security measures are placed to prevent such tools from unauthorized access by hackers or by outsiders. Number four, any agency contemplating deploying certain tools for use in particular context with respect to data sources that contain information on U.S. persons must be required first to conduct a thorough predeployment legal review. In other words, review in advance what kinds of things are being sought.
So Ashcroft was never opposed to data-mining. He was concerned with how it was to be accomplished. The only way I can see to reconcile the White House's latest explanation of Gonzales' testimony is if Ashcroft thought the way in which the NSA was going about the data mining failed to pass legal muster.
Answer to Question Two: If top level Justice Department officials were willing to quit over the NSA's proposed data mining plan, it wasn't because they opposed data mining. It could only be because the kind of data they were going to mine or the way in which they were going to use it or store it were completely illegal under Title III, the Fourth Amendment, FISA and privacy or other laws.
Can't this be resolved by Congress (or a special prosecutor) calling John Ashcroft to testify about the reason for the March, 2004 hospital room dispute?
Update: I'm also wondering whether the national security letters issued to telecom companies figure in somewhere here. More here.