Parallel Processing

RIP DryadLinq, or long live LINQ-to-Hadoop?

About a month ago'ish I read some very sad news. Microsoft announced that they were killing off the DryadLinq (or LINQ-to-HPC) project in favor of Hadoop. I was one of the first users of DryadLinq outside of Microsoft, back when it was a pre-alpha project inside Microsoft Research. My company had a running HPC cluster and my boss convinced me to install DryadLinq on it to see what I could make it do. I worked with it for a year, and being a big LINQ and PLINQ fan, really enjoyed how easy it was to ......

Many core processors and parallel processing

Although most of topics I've written about are pretty random, I'll try to focus in on a much more narrow (yet incredibly broad) topic: multi core vs many core processing, parallel processing, and the paradigm shift that we software engineers are on the leading edge of having to face. To put it in short Intel, AMD, and other hardware manufacturers are telling anyone that listens that programmers need to change the way they think about designing enduser software. End-user software needs to take advantage ......