Back to articles

XKeyscore

XKeyscore

The XKeyscore program is one of the most pervasive and advanced pieces of software in the mass surveillance apparatus operated by the National Security Agency (NSA). In various classified documents and training materials, this tool is described as the cornerstone for collecting and analyzing information from computer networks, a process known in technical jargon as Digital Network Intelligence. Its most striking feature is its immense capacity to monitor global digital activity, covering nearly everything a user does on the internet. Through a simple interface, which mimics the operation of a standard web search engine, intelligence analysts can search numerous databases without needing a court order or prior review by superiors or courts. To launch a search, one simply enters a general justification into an online form, gaining immediate access to historical data and real-time intercepts. This complete absence of technical or legal safeguards within the software merely serves to confirm the validity of the controversial statements made in 2013 by the whistleblower Edward Snowden, who claimed that, from his desk as a private consultant for the NSA, he could have electronically intercepted anyone, from ordinary citizens to federal judges right up to the President of the United States, provided they had a simple email address.

The technical infrastructure that enables XKeyscore to operate on a global scale is based on the direct interception of data traffic passing through the global telecommunications backbone, in particular terrestrial and submarine fibre-optic cables. In 2008, the processing infrastructure comprised around 150 collection sites spread across the globe, with active installations in countries such as the United States, the United Kingdom, Mexico, Brazil, Spain, Russia, Nigeria, Somalia, Pakistan, Japan and Australia. This network relied on over 700 distributed servers, capable of scaling their computing and storage power to absorb and process tens of billions of records. The volume of information flowing into this network every day is so colossal (exceeding twenty terabytes a day at some sites) that it places a severe strain on physical storage capacity. For this reason, the system adopts a differentiated retention policy whereby the full content of communications remains stored on local servers for only a very short period, whilst metadata is retained for between thirty and forty-five days. To circumvent this technological bottleneck and avoid losing valuable data, the NSA has set up a multi-tiered storage system, enabling analysts to extract the most relevant items and transfer them to secondary long-term databases, such as the one known as Pinwale, which is capable of storing the material for up to five years.

XKeyscore’s capacity and flexibility in identifying and cataloguing online activity go beyond the limitations of traditional interception systems based solely on strong selectors, such as a specific email address. Recognising that much of the time spent on the web is devoted to actions that are theoretically anonymous, the agency has designed the software to operate even in the absence of a known email account associated with the target. Analysts can, in fact, set up targeted searches using a wide range of criteria, including names, telephone numbers, IP addresses, keywords, the language used during the browsing session, or the type of web browser used. The programme’s internal modules, known as plug-ins, enable the analysis of the most specific aspects of each internet session. These include all detected email addresses, analysed by both username and domain, telephone numbers found in digital address books or in message signature blocks, and details of webmail and chat activities, including usernames, contact lists and cookies specific to the victim’s computer.

In addition to email, surveillance extends almost without limit to every form of social and multimedia interaction. With the advent of social networks and their growing centrality in people’s day-to-day communications, platforms such as Facebook have become primary data sources for analysts, who regard traffic on these networks as a starting point for tracking targets. Using an integrated tool called DNI Presenter, XKeyscore offers the ability to read the contents of private chats and direct messages exchanged on social media simply by entering a username and the desired time period. The automated collection process does not even spare images, attached documents and videos. A further tracking technique relies on the indirect cooperation of commercial advertising systems and third-party web analytics services. As virtually all websites use cookies to uniquely identify visitors for commercial or authentication purposes, the NSA is able to latch onto these same markers to track an individual’s digital movements. This system renders the user’s attempts to conceal their identity, by changing their IP address, switching to public Wi-Fi networks or activating VPN connections ineffective, as the tracking cookie will continue to tag the browser until the browsing data is manually cleared. The same principles apply to the mobile sector, where XKeyscore extracts unique identifiers from smartphone and tablet apps, even monitoring users’ connections to Google and Samsung’s digital stores or collecting secondary information such as crash reports sent by the Windows operating system.

The global scope of XKeyscore raises many questions regarding international law and constitutional safeguards, particularly with regard to the treatment of US citizens. Although the FISA Amendments Act of 2008 requires the NSA to obtain an individual warrant to surveil a person within the United States, XKeyscore provides the full technological capability, though not the legal authority, to include US citizens in extensive surveillance programmes without prior judicial oversight. Americans’ communications are routinely aggregated in vast quantities whenever contact is made with foreign targets located abroad.

Various cyber security experts have highlighted how the automation introduced by XKeyscore drastically reduces the time and expertise required to breach a computer system, turning hacking into an operation that can be carried out easily in a matter of minutes. Finally, the programme is systematically used to harvest authentication credentials and combinations of usernames and passwords from webmail servers and discussion forums, including channels frequented by hackers or system administrators themselves, who are considered prime targets as they already possess the keys to access the network infrastructure.