EDN Admin
Well-known member
http://research.microsoft.com/projects/naiad/" target="_blank Naiad is an investigation of data-parallel dataflow computation in the spirit of http://research.microsoft.com/projects/Dryad/" target="_blank Dryad and http://research.microsoft.com/projects/DryadLINQ/" target="_blank DryadLINQ , but with a focus on incremental computation. Naiad introduces a new computational model, differential dataflow, operating over collections of differences rather than collections of records, and resulting in very efficient implementations of programming patterns that are expensive in existing systems.
"Our goal with Naiad was to address one of the recurring requests for systems like Dryad and DryadLINQ, incremental recomputation, but in so doing found that the necessary mechanisms gave rise to a new computational model, differential dataflow, capable of efficiently processing substantially more complex computations than current systems support, namely incremental and arbitrarily nested iterative dataflow computation."
Microsoft Researcher http://research.microsoft.com/en-us/people/mcsherry/" target="_blank Frank McSherry joins us to discuss what this all means and how it would be useful in the big data problem space (a big problem space...). Demos included, of course.
Resources: <div class="conM http://research.microsoft.com/downloads/d964c4d2-358e-4109-857e-8a2f1b32ec88/" target="_blank Download Naiad . Read the http://research.microsoft.com/apps/pubs/?id=174076" target="_self Naiad tech report . Learn more about Naiad on the http://bigdataatsvc.wordpress.com/" target="_self MSR SVC Big Data blog . <img src="http://m.webtrends.com/dcs1wotjh10000w0irc493s0e_6x1g/njs.gif?dcssip=channel9.msdn.com&dcsuri=http://channel9.msdn.com/Feeds/RSS&WT.dl=0&WT.entryid=Entry:RSSView:fb89b02c2fcb461296eda0e8014355ec
View the full article
"Our goal with Naiad was to address one of the recurring requests for systems like Dryad and DryadLINQ, incremental recomputation, but in so doing found that the necessary mechanisms gave rise to a new computational model, differential dataflow, capable of efficiently processing substantially more complex computations than current systems support, namely incremental and arbitrarily nested iterative dataflow computation."
Microsoft Researcher http://research.microsoft.com/en-us/people/mcsherry/" target="_blank Frank McSherry joins us to discuss what this all means and how it would be useful in the big data problem space (a big problem space...). Demos included, of course.
Resources: <div class="conM http://research.microsoft.com/downloads/d964c4d2-358e-4109-857e-8a2f1b32ec88/" target="_blank Download Naiad . Read the http://research.microsoft.com/apps/pubs/?id=174076" target="_self Naiad tech report . Learn more about Naiad on the http://bigdataatsvc.wordpress.com/" target="_self MSR SVC Big Data blog . <img src="http://m.webtrends.com/dcs1wotjh10000w0irc493s0e_6x1g/njs.gif?dcssip=channel9.msdn.com&dcsuri=http://channel9.msdn.com/Feeds/RSS&WT.dl=0&WT.entryid=Entry:RSSView:fb89b02c2fcb461296eda0e8014355ec
View the full article
