This site is for the .NET SDK for Hadoop, making it easier to work with Hadoop from .NET. The site hosts two types of projects: Released projects and Incubator projects. Please read roadmap on the quality bar of projects in Incubator and how they graduate to Released projects.

Released Projects

  • Microsoft Avro Library
    • NuGet package: Microsoft.Hadoop.Avro
    • Documentation: Avro Library

Released NuGet Packages

You can download and install released binaries of the SDK using NuGet. In Visual Studio open NuGet package manager console and use following commands to install components of the SDK:
install-package Microsoft.WindowsAzure.Management.HDInsight
install-package Microsoft.Hadoop.Client
install-package Microsoft.Hadoop.Avro 

Incubator Projects

Incubator NuGet Packages

You can download and install latest published build of the Incubation SDK projects using NuGet. In Visual Studio open NuGet package manager console and use following commands to install components of the SDK:
install-package Microsoft.Hadoop.MapReduce  
install-package Microsoft.Hadoop.Hive 
install-package Microsoft.Hadoop.WebClient 

Source Code

You can browse the source either via the web or git.
git clone https://git01.codeplex.com/hadoopsdk.git 

Building

Navigate to the project directory and run following msbuild command.
msbuild .\src\HDInsightSDK.sln /p:NoTestsOnBuild=true

As part of building you may need to obtain NuGet packages from the Outercurve Foundation NuGet public feed*.

*By running build, you will be initiating the download of other software from a NuGet-based feed that is owned by the Outercurve Foundation. You are responsible for locating, reading and complying with the license terms that accompany each such software. Each software that you obtain through this feed is licensed to you by its respective owner. We grant you no rights for third party software from this feed.

Installing HDInsight Emulator on local machine

You can obtain one-box installation of Hadoop development environment by installing Microsoft HDInsight using WebPI.

Roadmap

You can see the roadmap on this wiki.

Contributing

We appreciate any contribution to help create a better experience for writing Hadoop jobs with .NET.

Last edited Mon at 5:51 PM by maxluk, version 35