NSF launches an Institute to manage huge data output from Large Hadron Collider
The upgraded Large Hadron Collider is expected to produce 1 billion particle collisions every second, of which only a fraction are the collisions that physicists want to study. To weed out the collisions of interest will require a big data software system on a massive scale to essentially find the needle in the haystack. That is, the interesting collisions in a flood of humdrum everyday collisions. When the LHC is fully operational in 2026 scientists will be completely buried in data unless they develop better tools. To that end the NSF is funding a new institute explicitly for that purpose.
