Geeks With Blogs
Josh Reuben December 2011 Entries
Daytona - Iterative MapReduce on Windows Azure
Daytona - Iterative MapReduce on Windows Azure Overview MapReduce is a framework for processing highly distributable problems across huge datasets using a large number of compute nodes. It is a generic mechanism that comprises 2 steps: Map step: The master node takes the input, partitions it up into smaller sub-problems, and distributes them to worker nodes. The worker node processes the smaller problem, and passes the answer back to its master node. Reduce step: The master node then collects the ......

Posted On Thursday, December 8, 2011 7:26 AM

The Windows Azure HPC Scheduler SDK
Overview Windows HPC Server 2008 is infrastructure for high-end applications that require high performance computing clusters – i.e. for scaling out parallelizable across many compute nodes in a grid. These compute nodes can be coordinated by a head node , which in turn can be proxied via a service broker node that exposes a SOA WCF interface for job scheduling. Additional functionality includes the ability to coordinate between job processes running on nodes via MPI (message passing interface). ......

Posted On Tuesday, December 6, 2011 6:36 AM

Unit Testing a ConcurrentPriorityQueue
I’m leveraging a ConcurrentPriorityQueue – from This class basically is a thread safe IProducerConsumerCollection wrapper for a binary heap that prioritizes smaller values. You use it as you would a dictionary, where the priority is the key, except you can have duplicate keys (ie values with the same priority). I needed to demonstrate to a customer that it worked. I set up my queue and my priority enum values: var q = new ConcurrentPriorityQueue<... ......

Posted On Sunday, December 4, 2011 1:05 PM

Overview C++ AMP is a GPGPU API – it allows you to define functions (kernels) that take some input, perform an expensive calculation on the GPU and return the output to CPU. GPU supports fast calculative operations across many SIMD-like cores - NVidia Tesla supports 512 cores compared to the paltry 10 cores available on the CPU today - even Intel's Knights Corner will only support 60 cores next year. Suitable only for certain classes of problems (i.e. data parallel algorithms) and not for others ......

Posted On Sunday, December 4, 2011 8:20 AM

Copyright © JoshReuben | Powered by: | Join free