FORT MEADE/HONG KONG/LONDON (Rixstep) — One of the great benefits of the revelations by Edward Snowden was catapulting the world into a mega-reality check, not only about what the NSA are doing but what they're capable of. Another hitherto unmentioned aspect came to light today via the 'FYJA' forum.
The NSA have been transcribing voice communications since before the new millennium, before the 'total awareness' paranoia, and before the repugnant Patriot Act.
New NSA patent explicitly mentions machine transcription
Suelette Dreyfus and Julian Assange, coauthors of Underground, sent the link to the Cypherpunks mailing list via the University of Oxford on 15 November 1999. Dreyfus herself wrote the piece for the British newspaper.
The US National Security Agency has designed and patented a new technology that could aid it in spying on international telephone calls. The NSA patent, granted on 10 August, is for a system of automatic topic spotting and labelling of data. The patent officially confirms for the first time that the NSA has been working on ways of automatically analysing human speech.
Bruce Schneier is later quoted in the article.
'One of the holy grails of the NSA is the ability automatically to search through voice traffic. They would have expended considerable effort on this capability, and this indicates it has been fruitful.'
Schneier goes on.
'It's easy to eavesdrop on any single phone call, but sifting through millions of phone calls looking for a particular conversation is difficult. In terms of automatic surveillance, text is easier to search than speech. This patent brings the surveillance of speech closer to that of text.'
Unsurprisingly the NSA declined to comment on the patent. But the piece goes on to bring in the EU and the spectre of the NSA spying on other countries.
The revelation of the NSA's patent is likely to cause tensions with the European Parliament. Over the past two years, the Parliament has commissioned several reports which examined whether the NSA has been using its electronic ears for commercial espionage, particularly in areas where US corporations compete with European and other companies.
The NSA relies on an international web of eavesdropping stations around the world, commonly known as Echelon, to listen into private international communications. The network emerged from a secret agreement signed after the Second World War between five nations including Australia, New Zealand, Canada, Britain and the US. Two of the NSA's most important satellite listening stations are located in Europe, at Menwith Hill in Yorkshire and Bad Aibling in Germany.
The Discovery
It was Julian Assange who happened on the patent whilst doing research.
Julian Assange, a cryptographer who moderates the online Australian discussion forum AUCRYPTO, found the new patent while investigating NSA capabilities.
'This patent should worry people. Everyone's overseas phone calls are or may soon be tapped, transcribed, and archived in the bowels of an unaccountable foreign spy agency', Assange said.
Patent 5,937,422
Commercial software capable of transcribing voice was available already back in 1999. But the lugubrious 'training' involved in making the software understand human speech made it impractical for spy agencies. It's also difficult to weed out actual topics that often aren't mentioned by name. According to the NSA's patent application 5,937,422:
'Much of the information conveyed in speech is never actually spoken and... utterances are frequently less coherent than written language.'
So enter the NSA who devised a technology that could overcome both barriers. The first step is to clean the transcription to remove what they called 'stutter phrases'. The second step is to apply a topic description to each chunk, which in turn has the potential to function better than traditional keyword searching.
Can Walk, Perhaps Run
But the NSA technology was already two years old when it was discovered by Julian Assange, having been submitted on 15 April 1997. The article concludes and explains further:
The NSA's current spy technology may be more advanced than methods described in the patent because the application is more than two years old. The US Patent Office approved the patent on 10 August this year, but the NSA originally lodged the application on 15 April 1997. The US Patent office keeps all applications secret until it issues a patent.
'You're All Screwed'
Here's RT's report on the WikiLeaks Spy Files press conference from December 2011.
What's learned from this report by RT's Laura Smith is that the NSA and other agencies have been up to no good for a long long time, but 9/11 gave them the opportunity to come out of the woodwork and up their game by an order of magnitude.
As Assange said at the time: if you're using the major social sites, 'you're all screwed'.
Secure Internet communications don't help much either: certificate authorities can be compromised or are already compromised through ownership or through coercion of the ownership.
NSA whistleblower William Binney also warned of the extent of NSA surveillance.
The NSA turn up everywhere. As Edward Snowden said, they can only be stopped by a policy change.
Denials
Of course the NSA are in total damage control mode by now. Their Keith Alexander is involved, granting the US congress a special debriefing session.
The official word from Fort Meade is that no, the NSA wouldn't listen in on conversations involving people in the US. So far so good. But the massive computer parks of the NSA are not really 'listening', and the Patriot Act only concerns so-called 'intercepts' - opening the preprocessed files or donning headphones.
So a bit of linguistic gymnastics and Alexander is still technically telling the truth.
Full Transcript
The Independent article has been taken offline and seems to have been burping 404s for years, but luckily it was transcribed by Assange and Dreyfus for the message board. Following is the post in its entirety.
There are some amongst us who've been trying to wake up the great unwashed for at least 17 years in this matter, but it's rather common that the unwashed like to go back to sleep again. Perhaps this time can be different?