Under The Influence(of code)

MEF 101 - Part2

Abhijeet Patel — Sun, 30 Oct 2011 22:27:26 GMT

This is part 2 of a 2 part series exploring the MEF.We covered some of the basics in Part 1 In this part we'll cover the following:

Catalogs
Recomposition
Export Providers

Catalogs:
Catalogs provide one way for MEF to discover components that it can compose. In it's most basic form it contains a registration of types. A container by itself is just an empty repository. The catalog is the one that collects and returns ComposablePartDefinitions i.e (objects of types that you have registered with MEF) to the container which in turn uses this for satifying imports on a specified object. We've seen AssemblyCatalog previously as a means for finding and satisfying imports. The following catalogs are built into the framework: TypeCatalog, AssemblyCatalog, DirectoryCatalog and AggregateCatalog. Each of these catalogs are derived from ComposablePartCatalog which is the abstract base class for all catalogs.

TypeCatalog
A type catalog is an immutable catalog that lets you register one or more type names.When this catalog is provided to the container it will use the types specified in this catalog for resolving imports and exports. You can specify types directly using 'typeof' (less useful since you are coupled to concrete types) or read type information from a configuration file instead.

[Export(typeof(ILogger))]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}
[Export(typeof(ITextFormatter))]
public class TextFormatter : ITextFormatter
{
public string Name
{
get
{
return "Text Formatter";
}
}
public string Format(string str)
{
return string.Format("Formatted Message:{0}", str);
}
}
class Program
{
[Import]
public ILogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
ComposablePartCatalog typeCatalog = new TypeCatalog(typeof(ConsoleLogger), typeof(TextFormatter));
CompositionContainer container =
new CompositionContainer(typeCatalog);
container.ComposeParts(p);
p.Logger.Log("Hello world");
}
}

To avoid coupling to specific type names (and by extension an assembly holding a concrete implementation) you could use 'Type.GetType(string typename)' instead where the typename could come from a config file. TypeCatalog gives you fine grained control over each type that you would like to register and make available to the container.

Assembly Catalog
If all the types that you would like to register are contained in an assembly you can use the AssemblyCatalog which scans the assembly and identifies the types that expose Import and Export attributes and registers them in one fell swoop into the catalog.This is useful when you have an application which is broken down into components by say feature areas or you have an on demand download for performance reasons or you have a pay as you go model for features available to your application as is typical in plugin based applications which is what MEF is all about anyways.
The AssemblyCatalog lets you register the types defined in such assemblies and make them available to the rest of the host application via the container.

class Program
{
[Import]
public ILogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
Assembly assembly = Assembly.LoadFile(Path.Combine(Directory.GetCurrentDirectory(), "MEF101.Implementations.dll"));
//you could also load the assembly on the fly from over the wire by using Assemly.Load(byte[] bytes)
ComposablePartCatalog assemblyCatalog = new AssemblyCatalog(assembly);
CompositionContainer container = new CompositionContainer(assemblyCatalog);
container.ComposeParts(p);
p.Logger.Log("Hello World");
}
}

DirectoryCatalog
If all your types are contained in a specific directory (such as the current directory your exe is running from) you could use the DirectoryCatalog specifying a directory name and an optional search pattern to have MEF scan all assemblies in the specified directory and automatically register all types that it finds into the catalog like so:

class Program
{
[Import]
public MEF101.Interfaces.ILogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
ComposablePartCatalog dirCatalog = new DirectoryCatalog(Directory.GetCurrentDirectory());
CompositionContainer container = new CompositionContainer(dirCatalog);
container.ComposeParts(p);
p.Logger.Log("Hello World");
}
}

AggregateCatalog
You can all combine all the above catalog types into an aggregate catalog type using the AggregateCatalog. As the name implies this takes in one or more ComposablePartCatalogs and exposes the the type registrations contained in all of them to the container as one whole. This is great when you have your types spread out over multiple locations. For example your applcation can start with a barebones set of features loaded from an assembly running in the current directory and you can asynchronously download updates/feature assemblies in the background. You can then compose your application using a combination of AssemblyCatalog and DirectoryCatalog
The following code shows a simplified example wherein ILogger implementations come from an AssemblyCatalog and a TypeCatalog .The TypeCatalog is added after the AggregateCatalog is constructed .

[Export(typeof(MEF101.Interfaces.ILogger))]
class DebugLogger : MEF101.Interfaces.ILogger
{
public string Name
{
get { return "Debug Logger"; }
}
[Import]
public MEF101.Interfaces.ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
Debug.Write(str);
}
}
class Program
{
[ImportMany]
public IEnumerable<MEF101.Interfaces.ILogger> Loggers { get; set; }
static void Main(string[] args)
{
Program p = new Program();
ComposablePartCatalog typeCatalog = new TypeCatalog(typeof(DebugLogger));
ComposablePartCatalog assemblyCatalog = new AssemblyCatalog(Assembly.LoadFile(
Path.Combine(Directory.GetCurrentDirectory(),
"MEF101.Implementations.dll")));
AggregateCatalog aggCatalog = new AggregateCatalog(assemblyCatalog);
aggCatalog.Catalogs.Add(typeCatalog);
CompositionContainer container = new CompositionContainer(aggCatalog);
container.ComposeParts(p);
foreach (var logger in p.Loggers)
{
logger.Log("Hello");
}
}
}

Whereas all the other catalog types are immutable, the AggregateCatalog lets you add and subract ComposablePartCatalogs from it's internal "Catalog" collection facilitating recomposition of the container on the fly.

Recomposition
MEF provides a facility to allow a composable application to change it's behavior when composable parts can change on the fly via a mechanism called recomposition.
Let's re-write the example such that the call to "Catalogs.Add" is made after we compose the instance of Program

[Export(typeof(MEF101.Interfaces.ILogger))]
class DebugLogger : MEF101.Interfaces.ILogger
{
public string Name
{
get { return "Debug Logger"; }
}
[Import]
public MEF101.Interfaces.ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
Debug.Write(str);
}
}
class Program
{
[ImportMany]
public IEnumerable<MEF101.Interfaces.ILogger> Loggers { get; set; }
static void Main(string[] args)
{
Program p = new Program();
ComposablePartCatalog typeCatalog = new TypeCatalog(typeof(DebugLogger));
ComposablePartCatalog assemblyCatalog = new AssemblyCatalog(Assembly.LoadFile(
Path.Combine(Directory.GetCurrentDirectory(),
"MEF101.Implementations.dll")));
AggregateCatalog aggCatalog = new AggregateCatalog(assemblyCatalog);
CompositionContainer container = new CompositionContainer(aggCatalog);
container.ComposeParts(p);
aggCatalog.Catalogs.Add(typeCatalog);
foreach (var logger in p.Loggers)
{
logger.Log("Hello");
}
}
}

This causes the following exception to be thrown:
Change in exports prevented by non-recomposable import 'MEF.LazyImports.Program.Loggers (ContractName="MEF101.Interfaces.ILogger")' on part 'MEF.LazyImports.Program'
This happens because the container changed after the instance of Program was already composed. The error indicates that the part being imported on the instance of Program i.e Loggers does not support recomposition and hence the change was prevented. We can easily enable this by changing the [Import] declaration on the Loggers property to
[ImportMany(AllowRecomposition=true)]. This allows for the program to dynamically obtain another instance of logger in it's Loggers collection and continue working normally
i.e. recompose itself
Similar to adding catalogs on the fly, we can also remove catalogs from the container and this will cause recomposition and update the Import on the instance of the Program automatically like so:

[Export(typeof(MEF101.Interfaces.ILogger))]
class DebugLogger : MEF101.Interfaces.ILogger
{
public string Name
{
get { return "Debug Logger"; }
}
[Import]
public MEF101.Interfaces.ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
Debug.Write(str);
}
}
class Program
{
[ImportMany]
public IEnumerable<MEF101.Interfaces.ILogger> Loggers { get; set; }
static void Main(string[] args)
{
Program p = new Program();
ComposablePartCatalog typeCatalog = new TypeCatalog(typeof(DebugLogger));
ComposablePartCatalog assemblyCatalog = new AssemblyCatalog(Assembly.LoadFile(
Path.Combine(Directory.GetCurrentDirectory(),
"MEF101.Implementations.dll")));
AggregateCatalog aggCatalog = new AggregateCatalog(assemblyCatalog);
CompositionContainer container = new CompositionContainer(aggCatalog);
container.ComposeParts(p);
aggCatalog.Catalogs.Add(typeCatalog);
foreach (var logger in p.Loggers)
{
logger.Log("Hello");
}
aggCatalog.Catalogs.Remove(typeCatalog);
foreach (var logger in p.Loggers)
{
logger.Log("Hello");
}
}
}

Notifications of Recomposition
MEF can notify you whenever a recomposition happens in case you need to perform some action such as cleanup/housekeeping. It does this via an interface called IPartImportSatisfiedNotification
You implement this interface in any of your parts in which you need that a recomposition(or more generally a composition) has occured.The interface has a single method called OnImportSatisfied
that you need to provide an implementation for.

[Export(typeof(MEF101.Interfaces.ILogger))]
class DebugLogger : MEF101.Interfaces.ILogger
{
public string Name
{
get { return "Debug Logger"; }
}
[Import]
public MEF101.Interfaces.ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
Debug.Write(str);
}
}
class Program : IPartImportsSatisfiedNotification
{
[ImportMany]
public IEnumerable<MEF101.Interfaces.ILogger> Loggers { get; set; }
public void OnImportsSatisfied()
{
Console.WriteLine("Import satisfied");
}
static void Main(string[] args)
{
Program p = new Program();
ComposablePartCatalog typeCatalog = new TypeCatalog(typeof(DebugLogger));
ComposablePartCatalog assemblyCatalog = new AssemblyCatalog(Assembly.LoadFile(
Path.Combine(Directory.GetCurrentDirectory(),
"MEF101.Implementations.dll")));
AggregateCatalog aggCatalog = new AggregateCatalog(assemblyCatalog);
CompositionContainer container = new CompositionContainer(aggCatalog);
container.ComposeParts(p);
aggCatalog.Catalogs.Add(typeCatalog);
foreach (var logger in p.Loggers)
{
logger.Log("Hello");
}
aggCatalog.Catalogs.Remove(typeCatalog);
foreach (var logger in p.Loggers)
{
logger.Log("Hello");
}
}
}

In the above example, recomposition occurs thrice. Once for the initial composition: container.ComposeParts(p); and then once each for the calls to Catalogs.Add and Catalogs.Remove

Export Providers
Up until now we have used catalogs to initialize the CompositionContainer.We can also use one or more Export Providers to initialize the container. The difference is that by providing one or more export providers, MEF will search for exports matching an import in the order in which the exports providers are set on the CompositionContainer. This helps in situations where more than one catalog has part definitions that could satisfy an Import. Let's change the code above to illustrate this

[Export(typeof(MEF101.Interfaces.ILogger))]
class DebugLogger : MEF101.Interfaces.ILogger
{
public string Name
{
get { return "Debug Logger"; }
}
[Import]
public MEF101.Interfaces.ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
Debug.Write(str);
}
}
class Program
{
[Import(AllowRecomposition=true)]
public MEF101.Interfaces.ILogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
ComposablePartCatalog typeCatalog = new TypeCatalog(typeof(DebugLogger));
ComposablePartCatalog assemblyCatalog = new AssemblyCatalog(Assembly.LoadFile(
Path.Combine(Directory.GetCurrentDirectory(),
"MEF101.Implementations.dll")));
AggregateCatalog aggCatalog = new AggregateCatalog(typeCatalog,assemblyCatalog);
CompositionContainer container = new CompositionContainer(aggCatalog);
container.ComposeParts(p);
}
}

The call to ComposeParts causes the following error.
More than one export was found that matches the constraint . The reason for this is because there are 2 parts (ConsoleLogger and DebugLogger) that are exported as ILogger and the Program has a single import for a logger instead of a collection of loggers. In this case MEF does not know which export to use for satisfying the import and hence the exception.
By using ExportProviders you can control the resolution order for satisying imports.

[Export(typeof(MEF101.Interfaces.ILogger))]
class DebugLogger : MEF101.Interfaces.ILogger
{
public string Name
{
get { return "Debug Logger"; }
}
[Import]
public MEF101.Interfaces.ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
Debug.Write(str);
}
}
class Program
{
[Import(AllowRecomposition=true)]
public MEF101.Interfaces.ILogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
ComposablePartCatalog typeCatalog = new TypeCatalog(typeof(DebugLogger));
ComposablePartCatalog assemblyCatalog = new AssemblyCatalog(Assembly.LoadFile(
Path.Combine(Directory.GetCurrentDirectory(),
"MEF101.Implementations.dll")));
CatalogExportProvider assemblyProvider = new CatalogExportProvider(assemblyCatalog);
CatalogExportProvider typeProvider = new CatalogExportProvider(typeCatalog);
AggregateExportProvider aggProvider = new AggregateExportProvider(
assemblyProvider, typeProvider);
CompositionContainer container = new CompositionContainer(aggProvider);
typeProvider.SourceProvider = container;
assemblyProvider.SourceProvider = container;
container.ComposeParts(p);
p.Logger.Log("Hello");
}
}

Since the AggregateExportProvider contains the assemblyProvider first followed by typeProvider, the call to ComposeParts checks the assemblyProvider(and by extension the assemblyCatalog) first and notices that it can satisfy the import defined on Program, stops there and ends up using the ConsoleLogger. If no export was defined in the assemblyProvider then MEF would continue looking into the typeProvider for satisfying the import. Vice-versa, if the order was reversed and typeProvider was set before assemblyProvider then DebugLogger would have been used instead. You can also buid your own export providers by deriving from ExportProvider. This wraps up the coverage of MEF.

MEF 101 - Part1

Abhijeet Patel — Sat, 03 Jul 2010 16:03:53 GMT

The Managed Extensibility framework or MEF is a framework released as part of .NET 4 and Silverlight that provides a mechanism to dynamically compose an application at runtime out of loosely coupled parts and provides a variety of mechanisms to discovering these parts. You can think of this as an implementation of a plugin framework that enables plugging in functionality into a container, based on information available at runtime. The most notable example of a MEF client is the Visual Studio 2010 editor which uses MEF to plugin in 3rd party extensions into it's shell proving an easy to use programming model to customize and/or extend the behavior of the IDE.

To wrap my head around MEF and how to leverage the framework to write extensible apps,I'll be going over some of the key features and APIs in MEF over the next several posts. This is the first in the series, and covers the nuts and bolts that MEF is made up of:

Imports and Exports

Imports and Exports is how MEF discovers and marries components that provide a service with components needing a service. The discovery is based on attributes.
A type decorated with the [Export] attribute indicates to MEF that the type is available to any type that needs it's services. Similarly a type needing a service is decorated with the [Import] attribute which conveys to MEF that it is in need of some type which provides the service.

Using Concrete classes

To make things a bit concrete, let's say we have a Logger which uses a TextFormatter to format messages before they are logged.

[Export]
public class TextFormatter
{
public string Format(string str)
{
return string.Format("Formatted Message:{0}", str);
}
}
[Export]
public class ConsoleLogger
{
[Import]
TextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
}

The [Export] attribute on the TextFormatter class indicates that the services of this type are available to any type that needs them. The [Import] attribute on the ConsoleLogger indicates that it needs a TextFormatter in order for it to log messages.
Similarly the [Export] attribute on the ConsoleLogger indicates that it's services are available to any type that needs a ConsoleLogger.

class Program
{
[Import]
public ConsoleLogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.Logger.Log("This is a test");
}
}

Nowhere in the code above do you see a new TextFormatter() or new ConsoleLogger().
MEF handles the creation for you. In order to do this it needs to discover the types available so that it can satify the imports. It does this using a CompositionContainer which holds onto catalogs of various types. A catalog itself is a container holding types. In the code above we are using one type of catalog called AssemblyCatalog which wraps around a specified assembly and holds onto the types available in the assembly which exports services that can be used for satisfying imports(more on catalogs later). The main program imports the ConsoleLogger, in order to satisfy this import and have MEF create a ConsoleLogger for us we need to tell MEF to go through a composition on the instance of the Program so that it can satify it's imports. This is achieved via the call to container.Composeparts(p). At the end of this step MEF has inspected the current assembly, discovered that TextFormatter exports it's services which are needed in turn by the ConsoleLogger and injected an instance of the TextFormatter into the ConsoleLogger.
Furthermore, it then creates an instance of the ConsolLogger(since it also is an [Export]) and has injected an intance of the ConsoleLogger into the intance of the main program we created.

You might say "Why can't I just use new...?" which is a valid question, considering that everything is currently in one code file/assembly, this will become clearer as we progress further along where not all types are available in the same assembly and there is no static dependency between assemblies(via add ref).

Injecting dependencies via Constructor Injection

Imports can also be specified on constructors so that dependencies can be auto injected into a type. This is specified by using the [ImportingConstructor] attribute on the constructor of the type into which the dependency needs to be injected.

[Export]
public class TextFormatter
{
public string Format(string str)
{
return string.Format("Formatted Message:{0}", str);
}
}
[Export]
public class ConsoleLogger
{
TextFormatter _formatter;
[ImportingConstructor]
public ConsoleLogger(TextFormatter formatter)
{
_formatter = formatter;
}
public void Log(string str)
{
string formattedString = _formatter.Format(str);
Console.WriteLine(formattedString);
}
}
class Program
{
[Import]
public ConsoleLogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.Logger.Log("This is a test");
}
}

In the above code,the TextFormatter is specified as a constructor parameter to the ConsoleLogger. the [ImportingConstructor] attribute indicates to MEF that the TextFormatter needs to be injected into the ConsoleLogger.
As before, the ConsoleLogger has an [Export] attribute and is imported into the main Program as an Import. When the Program is composed, MEF finds the TextFormatter in the AssemblyCatalog (since it's in the current assembly) and uses that to satisfy the import for the ConsoleLogger's constructor.

Exporting types from a Factory class

In the previous examples we've specified the [Export] attribute on the type itself such as on the TextFormatter and ConsoleLogger classes, which in turn causes MEF to instantiate these types for satisfying imports. Instead, if we wanted to have a factory class in charge of creating instances of a type so that you have more control, and specify these types as the ones to use for satisfying an import, we can do something like so:

class FormatterFactory
{
[Export]
public TextFormatter Formatter
{
get
{
return new TextFormatter();
}
}
}

The Formatter property of the FormatterFactory provides a valid export to MEF. If another type needs to Import a TextFormatter, MEF is prepared to instantiate the FormatterFactory and invoke the "Formatter" property in order to satisy the import.

public class TextFormatter
{
public string Format(string str)
{
return string.Format("Formatted Message:{0}", str);
}
}
[Export]
public class ConsoleLogger
{
[Import]
TextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
}
class Program
{
[Import]
public ConsoleLogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.Logger.Log("This is a test");
}
}

Notice that the [Export] atribute is no longer present on the TextFormatter, and the import in ConsoleLogger is satisfied by the FormatterFactory.

In addition to exporting a type from a property we can also have function exports. i.e the [Export] attribute is tagged onto a method

class FormatterFactory
{
[Export]
public TextFormatter Formatter
{
get
{
return new TextFormatter();
}
}
[Export]
public TextFormatter GetTextFormatter()
{
return new TextFormatter();
}
[Export]
public void WriteFormattedOutput(string str, Stream stream)
{
System.Text.UTF8Encoding encoding = new System.Text.UTF8Encoding();
var bytes = encoding.GetBytes(str);
stream.Write(bytes,0,bytes.Length);
}
}

This enables some interesting scenarios for import, such as lazy evaulation.The function export can be imported into a type by specifying a delegate type that matches the function signature, The signatures of GetTextFormatter() and WriteFormattedOutput(string str, Stream stream) match the delegates Func<TextFormatter> and Action<string, Stream> respectively. We can use these delegates to import these exports into the ConsoleLogger.

public class TextFormatter
{
public string Format(string str)
{
return string.Format("Formatted Message:{0}", str);
}
}
[Export]
public class ConsoleLogger
{
[Import]
TextFormatter Formatter
{
get;
set;
}
[Import]
public Func<TextFormatter> FormatterFunc
{
get;
private set;
}
[Import]
public Action<string, Stream> FormatterAction
{
get;
private set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
formattedString = FormatterFunc().Format(str);
FormatterAction(str, Console.OpenStandardOutput());
Console.WriteLine(formattedString);
}
}
class Program
{
[Import]
public ConsoleLogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.Logger.Log("This is a test");
}
}

Notice the following 2 lines in the Log method
formattedString = FormatterFunc().Format(str);
FormatterAction(str, Console.OpenStandardOutput());
FormatterFunc() invokes the GetTextFormatter() of the Export which gives us a TextFormatter on which we then invoke the Format method.
FormatterAction(str, Console.OpenStandardOutput()) invokes the WriteFormattedOutput method we exported passing in a string and the standard console stream.
This is immensely useful when you don't necessarily want MEF to materialize a value up front but rather provide a handle to a method which on invocation yields a value, but there are other ways to be lazy.

Using Interfaces instead of concrete classes

This far we've been using concrete classes for all exports and imports, i.e we've used ConsoleLogger and TextFormatter. This limits us to working only with these types. To promote loose coupling to any type, MEF also supports importing and exporting via interfaces. We can extract out the following interfaces from the ConsoleLogger and TextFormatter

public interface ITextFormatter
{
string Name { get;}
string Format(string str);
}
public interface ILogger
{
string Name { get;}
ITextFormatter Formatter { get; set;}
void Log(string str);
}

and have both classes implement the respective interface

[Export(typeof(ITextFormatter))]
public class TextFormatter : ITextFormatter
{
public string Name
{
get
{
return "Text Formatter";
}
}
public string Format(string str)
{
return string.Format("Formatted Message:{0}", str);
}
}
[Export(typeof(ILogger))]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}

Notice that the Export attributes now export the respective interface types and not the concrete types anymore and the Import attributes are applied on properties of interface types

class Program
{
[Import]
public ILogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.Logger.Log("This is a test");
}
}

The main program now just works since MEF resolves the import by instantiating the concrete type on which the Export attribute is defined, types it to the specified interface type and uses the interface type to satisfy imports.

Lazy Imports

It's great that MEF instantiates and injects types to satisfy imports but there are times when you just don't need an import to be satisfied until the point in time at which you need the imported type. The default behavior with the Import attribute is that when a part is composed, imports are satisified and MEF has already created an instance of the type and injected them into your type. Based on the dynamics of how your type is used, the satisifed import may never get used, this means that you paid for something that you did not need but paid for it in anticipation of it's use. It could very well be that the export might be a type which consumes expensive resources, or needs to make a cross domain/ cross process call as part of it's construction, or pull data from a database to initialize itself to a usable state, which means that we paid a "lot" for anticipation. To alleviate this, MEF leverages the Lazy<T> type which is new in .NET 4.0 to allow for lazy instantiaion of types. Using Lazy<T> for an import instead of T, causes MEF to delay the instantiation of the type T until the Value property of the Lazy<T> is accessed.

If we replace the Import in the main Program to use Lazy<ILogger> instead of ILogger, we effectively delay the creation of the ConsoleLogger until the Value property is accessed for the first time.

[Export(typeof(ILogger))]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}
class Program
{
[Import]
public Lazy<ILogger> Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.Logger.Value.Log("This is a test");
}
}

If you were to add a watch to the p.Logger.IsValueCreated, you would observe that it returns false.Once the Value property is accessed, IsValueCreated would return true.

Part Creation Policy

By default when MEF satisfies imports for a type(note the pluralization), it shares the instance that it creates from the export across all imports(i.e. it creates a singleton) and this is the default behvior. You can change this behavior on the importing side or the exporting side.

On the exporting side you can specify a PartCreationPolicy attribute on the type being exported indicating that a new instance should be created for satisying an import, by specifying a value of CreationPolicy.NonShared (the default that MEF uses is CreationPolicy.Shared)

[Export(typeof(ILogger))]
[PartCreationPolicy(CreationPolicy.NonShared)]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}

Now, whenever MEF satisfies an import it will create a new instance of the ConsoleLogger instead of a singleton.
You can also specify a value of CreationPolicy.Any which effectively means that the importer decides the creation policy.
This is accomplished by using an overload of the Import attribute which accepts a RequiredCreationPolicy enum,which can have values of Shared,NonShared or Any. This is best illustrated with an example:

[Export(typeof(ILogger))]
[PartCreationPolicy(CreationPolicy.Any)]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}
class Program
{
[Import]
public ILogger Logger1 { get; set; }
[Import(RequiredCreationPolicy=CreationPolicy.Shared)]
public ILogger Logger2 { get; set; }
[Import(RequiredCreationPolicy=CreationPolicy.Shared)]
public ILogger Logger3 { get; set; }
[Import(RequiredCreationPolicy=CreationPolicy.NonShared)]
public ILogger Logger4 { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
}
}

Since Logger2 and Logger3 have a CreationPolicy of CreationPolicy.Shared, they will share an instance of a ConsoleLogger that MEF creates, Logger1 will also share this instance since the default behavior is Shared if nothing is specified.
Logger4 on the other hand uses a CreationPolicy of CreationPolicy.NonShared, which will cause MEF to create a new instance of the ConsolLogger4 for satisfying the import for Logger4. This instance is not shared with any other import.

Default Values

There may be times where there is no available export to satisfy an import and it might be feasible to settle with a default value for an import (null for a reference type and the default value for a value type).
If a Formatter is not available, the logger can still perform logging like so:

public struct LogInfo
{
private string _loggedBy ;
public string LoggedBy
{
get { return _loggedBy; }
}
public LogInfo(string loggedBy)
{
_loggedBy = loggedBy;
}
}
[Export(typeof(ILogger))]
public class ConsoleLogger : ILogger
{
[Import(AllowDefault=true)]
public ITextFormatter Formatter
{
get;
set;
}
[Import(AllowDefault = true)]
public LogInfo Info
{
get;
set;
}
public void Log(string str)
{
if (Formatter != null)
{
string formattedString = Formatter.Format(!string.IsNullOrEmpty(Info.LoggedBy)? str + " logged by" + Info.LoggedBy: str);
Console.WriteLine(formattedString);
}
}
public string Name
{
get
{
return "Console Logger";
}
}
}
class Program
{
[Import]
public ILogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
}
}

Note that the [Import] ttribute sets "AllowDefault" to true which causes the Formatter property to be set to null since there are no types which export IFormatter and hence the Formatter is set to null.
Also note that for kicks we have included a struct (LogInfo) and the ConsoleLogger imports this struct. Since this struct is not explicitly exported and "AllowDefault = true", MEF creates a default instance of the struct and sets the "Info" property to this default instance.

Named Exports

Since multiple types can export the same contract you can provide a name for each export so that you can uniquely identify an export on the importing side like so:

[Export("Console Loger",typeof(ILogger))]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}
[Export("Debug Logger",typeof(ILogger))]
public class DebugLogger : ILogger
{
[Import(AllowDefault = true)]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Debug.WriteLine(formattedString);
}
public string Name
{
get
{
return "Debug Logger";
}
}
}
class Program
{
[Import("Debug Logger")]
public ILogger Logger { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.Logger.Log(DateTime.UtcNow.ToString());
}
}

The main drawback here is that we are now rely on strings for identifying a particular export. There are better ways to achieve the same end effect using attributes as we'll soon see.

Import Many

The main advantage of MEF is building wholes out of parts and building functionality by assembling parts. Multiple types can implement the same contract and export it. You are not limited to importing a single implementation of an export,multiple implementations of a contract can be imported using [ImportMany] You could have different types of loggers,a ConsoleLogger to log to the console, a DebugLogger to log to the debug output and so on. These loggers can all export the ILogger interface. A client application can import many such ILoggers which causes MEF to look for all matching available exports in the configured catalogs to satisfy the import. This is specified using an ImportMany attribute an IEnumerable<ILogger> like so:

[Export(typeof(ITextFormatter))]
public class TextFormatter : ITextFormatter
{
public string Name
{
get
{
return "Text Formatter";
}
}
public string Format(string str)
{
return string.Format("Formatted Message:{0}", str);
}
}
[Export(typeof(ILogger))]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}
[Export(typeof(ILogger))]
public class DebugLogger : ILogger
{
[Import(AllowDefault = true)]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Debug.WriteLine(formattedString);
}
public string Name
{
get
{
return "Debug Logger";
}
}
}
class Program
{
[ImportMany]
public IEnumerable<ILogger> Loggers { get; set; }
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
foreach (var logger in p.Loggers)
{
logger.Log(DateTime.UtcNow.ToString());
}
}
}

Exporting Metadata

So now you've imported multiple exports,great!, you can use these exports as they are, but what if you needed to get a handle to a particular export you've imported. This is where metadata comes in. Each export can be annotated with export metadata which can be used to query the export.The metadata is made available on the import side as a Dictionary<string,object> which can be queried for the attribute name which is the dictionary key, and the value can be checked for the value of interest.
We can mark the ConsoleLogger as the default logger to use by specifying an ExportMetatdata attribute with key name "IsDefault" and value true.

[Export(typeof(ITextFormatter))]
public class TextFormatter : ITextFormatter
{
public string Name
{
get
{
return "Text Formatter";
}
}
public string Format(string str)
{
return string.Format("Formatted Message:{0}", str);
}
}
[Export(typeof(ILogger))]
[ExportMetadata("IsDefault", true)]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}
[Export(typeof(ILogger))]
[ExportMetadata("IsDefault", false)]
public class DebugLogger : ILogger
{
[Import(AllowDefault = true)]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Debug.WriteLine(formattedString);
}
public string Name
{
get
{
return "Debug Logger";
}
}
}

The client can query for the default logger like so:

class Program
{
[ImportMany]
public IEnumerable<Lazy<ILogger,Dictionary<string,object>>> Loggers { get; set; }
public void LogUsingDefaultLogger(string message)
{
foreach (var logger in Loggers)
{
if (logger.Metadata.ContainsKey("IsDefault"))
{
bool isdefault = (bool)logger.Metadata["IsDefault"];
if (isdefault)
{
logger.Value.Log(message);
}
}
}
}
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.LogUsingDefaultLogger("test");
}
}

Note that in order to get to the metadata the Loggers property is of type IEnumerable<Lazy<ILogger,Dictionary<string,object>>>, Lazy<T> exposes a Metadata property which allows us to get to our metadata as shown in LogUsingDefaultLogger

Exporting Metadata the strongly typed way

Working with strings tends to be error prone.Wouldn't it be nicer to export metadata using strong types instead of strings. The good news is you can.You can write a custom attribute class derived from ExportAttribute and includes properties in the derived class which you can then use for finding exports matching your filter criteria

[MetadataAttribute]
[AttributeUsage(AttributeTargets.Class,AllowMultiple=false)]
public class LogExportAttribute : ExportAttribute
{
public LogExportAttribute() : base(typeof(ILogger))
{
}
public bool IsDefault { get; set; }
}

You can then decorate the loggers with this attribute and set one as the default

[Export(typeof(ILogger))]
[LogExport(IsDefault=true)]
public class ConsoleLogger : ILogger
{
[Import]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Console.WriteLine(formattedString);
}
public string Name
{
get
{
return "Console Logger";
}
}
}
[Export(typeof(ILogger))]
[LogExport(IsDefault=false)]
public class DebugLogger : ILogger
{
[Import(AllowDefault = true)]
public ITextFormatter Formatter
{
get;
set;
}
public void Log(string str)
{
string formattedString = Formatter.Format(str);
Debug.WriteLine(formattedString);
}
public string Name
{
get
{
return "Debug Logger";
}
}
}

In order to query for the attribute and reach into it's properties we need to also define an interface with properties corresponding to that of the custom attribute class like so:

public interface ILogExportMetdata
{
bool IsDefault { get; }
}

We can then consume the metadata(strongly typed) like so:

class Program
{
[ImportMany]
public IEnumerable<Lazy<ILogger,ILogExportMetdata>> Loggers { get; set; }
public void LogUsingDefaultLogger(string message)
{
foreach (var logger in Loggers)
{
if (logger.Metadata.IsDefault)
{
logger.Value.Log(message);
}
}
}
static void Main(string[] args)
{
Program p = new Program();
CompositionContainer container =
new CompositionContainer(new AssemblyCatalog(Assembly.GetExecutingAssembly()));
container.ComposeParts(p);
p.LogUsingDefaultLogger("test");
}
}

Behind the scenes MEF performs some clever mapping of the attribute's properties to the interface's properties so that we can access the metadata in a strongly typed way.
This post is getting longer than I anticipated but we've covered the heart of what MEF is about.
In part 2 we'll look at Catalogs.

A simple Dynamic Proxy

Abhijeet Patel — Sun, 04 Apr 2010 22:41:33 GMT

Frameworks such as EF4 and MOQ do what most developers consider "dark magic". For instance in EF4, when you use a POCO for an entity you can opt-in to get behaviors such as "lazy-loading" and "change tracking" at runtime merely by ensuring that your type has the following characteristics:

The class must be public and not sealed.
The class must have a public or protected parameter-less constructor.
The class must have public or protected properties

Adhere to this and your type is magically endowed with these behaviors without any additional programming on your part.
Behind the scenes the framework subclasses your type at runtime and creates a "dynamic proxy" which has these additional behaviors and when you navigate properties of your POCO, the framework replaces the POCO type with derived type instances.

The MOQ framework does simlar magic. Let's say you have a simple interface:

public interface IFoo
{
int GetNum();
}

We can verify that the GetNum() was invoked on a mock like so:

var mock = new Mock<IFoo>(MockBehavior.Default);
mock.Setup(f => f.GetNum());
var num = mock.Object.GetNum();
mock.Verify(f => f.GetNum());

Beind the scenes the MOQ framework is generating a dynamic proxy by implementing IFoo at runtime. the call to moq.Object returns the dynamic proxy on which we then call "GetNum" and then verify that this method was invoked.

No dark magic at all, just clever programming is what's going on here, just not visible and hence appears magical!

Let's create a simple dynamic proxy generator which accepts an interface type and dynamically creates a proxy implementing the interface type specified at runtime.

public static class DynamicProxyGenerator
{
public static T GetInstanceFor<T>()
{
Type typeOfT = typeof(T);
var methodInfos = typeOfT.GetMethods();
AssemblyName assName = new AssemblyName("testAssembly");
var assBuilder = AppDomain.CurrentDomain.DefineDynamicAssembly(assName, AssemblyBuilderAccess.RunAndSave);
var moduleBuilder = assBuilder.DefineDynamicModule("testModule", "test.dll");
var typeBuilder = moduleBuilder.DefineType(typeOfT.Name + "Proxy", TypeAttributes.Public);
typeBuilder.AddInterfaceImplementation(typeOfT);
var ctorBuilder = typeBuilder.DefineConstructor(
MethodAttributes.Public,
CallingConventions.Standard,
new Type[] { });
var ilGenerator = ctorBuilder.GetILGenerator();
ilGenerator.EmitWriteLine("Creating Proxy instance");
ilGenerator.Emit(OpCodes.Ret);
foreach (var methodInfo in methodInfos)
{
var methodBuilder = typeBuilder.DefineMethod(
methodInfo.Name,
MethodAttributes.Public | MethodAttributes.Virtual,
methodInfo.ReturnType,
methodInfo.GetParameters().Select(p => p.GetType()).ToArray()
);
var methodILGen = methodBuilder.GetILGenerator();
if (methodInfo.ReturnType == typeof(void))
{
methodILGen.Emit(OpCodes.Ret);
}
else
{
if (methodInfo.ReturnType.IsValueType || methodInfo.ReturnType.IsEnum)
{
MethodInfo getMethod = typeof(Activator).GetMethod(/span>"CreateInstance",new Type[]{typeof((Type)});
LocalBuilder lb = methodILGen.DeclareLocal(methodInfo.ReturnType);
methodILGen.Emit(OpCodes.Ldtoken, lb.LocalType);
methodILGen.Emit(OpCodes.Call, typeofype).GetMethod("GetTypeFromHandle")); ));
methodILGen.Emit(OpCodes.Callvirt, getMethod);
methodILGen.Emit(OpCodes.Unbox_Any, lb.LocalType);

}
else
{
methodILGen.Emit(OpCodes.Ldnull);
}
methodILGen.Emit(OpCodes.Ret);
}
typeBuilder.DefineMethodOverride(methodBuilder, methodInfo);
}
Type constructedType = typeBuilder.CreateType();
var instance = Activator.CreateInstance(constructedType);
return (T)instance;
}
}

Dynamic proxies are created by calling into the following main types: AssemblyBuilder, TypeBuilder, Modulebuilder and ILGenerator. These types enable dynamically creating an assembly and emitting .NET modules and types in that assembly, all using IL instructions.
Let's break down the code above a bit and examine it piece by piece

Type typeOfT = typeof(T);
var methodInfos = typeOfT.GetMethods();
AssemblyName assName = new AssemblyName("testAssembly");
var assBuilder = AppDomain.CurrentDomain.DefineDynamicAssembly(assName, AssemblyBuilderAccess.RunAndSave);
var moduleBuilder = assBuilder.DefineDynamicModule("testModule", "test.dll");
var typeBuilder = moduleBuilder.DefineType(typeOfT.Name + "Proxy", TypeAttributes.Public);

We are instructing the runtime to create an assembly caled "test.dll"and in this assembly we then emit a new module called "testModule". We then emit a new type definition of name "typeName"Proxy into this new module. This is the definition for the "dynamic proxy" for type T

typeBuilder.AddInterfaceImplementation(typeOfT);
var ctorBuilder = typeBuilder.DefineConstructor(
MethodAttributes.Public,
CallingConventions.Standard,
new Type[] { });
var ilGenerator = ctorBuilder.GetILGenerator();
ilGenerator.EmitWriteLine("Creating Proxy instance");
ilGenerator.Emit(OpCodes.Ret);

The newly created type implements type T and defines a default parameterless constructor in which we emit a call to Console.WriteLine. This call is not necessary but we do this so that we can see first hand that when the proxy is constructed, when our default constructor is invoked.

var methodBuilder = typeBuilder.DefineMethod(
methodInfo.Name,
MethodAttributes.Public | MethodAttributes.Virtual,
methodInfo.ReturnType,
methodInfo.GetParameters().Select(p => p.GetType()).ToArray()
);

We then iterate over each method declared on type T and add a method definition of the same name into our "dynamic proxy" definition

if (methodInfo.ReturnType == typeof(void))
{
methodILGen.Emit(OpCodes.Ret);
}

If the return type specified in the method declaration of T is void we simply return.

if (methodInfo.ReturnType.IsValueType || methodInfo.ReturnType.IsEnum)
{
MethodInfo getMethod = typeof(Activator).GetMethod("CreateInstance",
new Type[]{typeof(Type)});
LocalBuilder lb = methodILGen.DeclareLocal(methodInfo.ReturnType);
methodILGen.Emit(OpCodes.Ldtoken, lb.LocalType);
methodILGen.Emit(OpCodes.Call, typeof(Type).GetMethod("GetTypeFromHandle"));
methodILGen.Emit(OpCodes.Callvirt, getMethod);
methodILGen.Emit(OpCodes.Unbox_Any, lb.LocalType);
}

If the return type in the method declaration of T is either a value type or an enum, then we need to create an instance of the value type and return that instance the caller. In order to accomplish that we need to do the following:
1) Get a handle to the Activator.CreateInstance method
2) Declare a local variable which represents the Type of the return type(i.e the type object of the return type) specified on the method declaration of T(obtained from the MethodInfo) and push this Type object onto the evaluation stack.
In reality a RuntimeTypeHandle is what is pushed onto the stack.
3) Invoke the "GetTypeFromHandle" method(a static method in the Type class) passing in the RuntimeTypeHandle pushed onto the stack previously as an argument, the result of this invocation is a Type object (representing the method's return type) which is pushed onto the top of the evaluation stack.
4) Invoke Activator.CreateInstance passing in the Type object from step 3, the result of this invocation is an instance of the value type boxed as a reference type and pushed onto the top of the evaluation stack.
5) Unbox the result and place it into the local variable of the return type defined in step 2

methodILGen.Emit(OpCodes.Ldnull);

If the return type is a reference type then we just load a null onto the evaluation stack

methodILGen.Emit(OpCodes.Ret);

Emit a a return statement to return whatever is on top of the evaluation stack(null or an instance of a value type) back to the caller

Type constructedType = typeBuilder.CreateType();
var instance = Activator.CreateInstance(constructedType);
return (T)instance;

Now that we have a definition of the "dynamic proxy" implementing all the methods declared on T, we can now create an instance of the proxy type and return that out typed as T.

The caller can now invoke the generator and request a dynamic proxy for any type T.
In our example when the client invokes GetNum() we get back "0". Lets add a new method on the interface called DayOfWeek GetDay()

public interface IFoo
{
int GetNum();
DayOfWeek GetDay();
}

When GetDay() is invoked, the "dynamic proxy" returns "Sunday" since that is the default value for the DayOfWeek enum

A client would consume this as follows:

static void Main(string[] args)
{
var instance = DynamicProxyGenerator.GetInstanceFor<IFoo>();
int num = instance.GetNum();
var day = instance.GetDay();
Console.WriteLine(num);
Console.WriteLine(day);
}

This is a very trivial example of dynamic proxies, frameworks like MOQ have a way more sophisticated implementation of this paradigm where in you can instruct the framework to create proxies which return specified values for a method implementation as part of Setup.

CLR via C# 3rd Edition is out

Abhijeet Patel — Sun, 14 Mar 2010 00:09:50 GMT

Time for some book news update. CLR via C#, 3rd Edition seems to have been out for a little while now. The book was released in early Feb this year, and needless to say my copy is on it’s way. I can barely wait to dig in and chew on the goodies that one of the best technical authors and software professionals I respect has in store. The 2nd edition of the book was an absolute treat and this edition promises to be no less.

Here is a brief description of what’s new and updated from the 2nd edition.

Part I – CLR Basics

Chapter 1-The CLR’s Execution Model

Added about discussion about C#’s /optimize and /debug switches and how they relate to each other.

Chapter 2-Building, Packaging, Deploying, and Administering Applications and Types

Improved discussion about Win32 manifest information and version resource information.

Chapter 3-Shared Assemblies and Strongly Named Assemblies

Added discussion of TypeForwardedToAttribute and TypeForwardedFromAttribute.

Part II – Designing Types

Chapter 4-Type Fundamentals

No new topics.

Chapter 5-Primitive, Reference, and Value Types

Enhanced discussion of checked and unchecked code and added discussion of new BigInteger type. Also added discussion of C# 4.0’s dynamic primitive type.

Chapter 6-Type and Member Basics

No new topics.

Chapter 7-Constants and Fields

No new topics.

Chapter 8-Methods

Added discussion of extension methods and partial methods.

Chapter 9-Parameters

Added discussion of optional/named parameters and implicitly-typed local variables.

Chapter 10-Properties

Added discussion of automatically-implemented properties, properties and the Visual Studio debugger, object and collection initializers, anonymous types, the System.Tuple type and the ExpandoObject type.

Chapter 11-Events

Added discussion of events and thread-safety as well as showing a cool extension method to simplify the raising of an event.

Chapter 12-Generics

Added discussion of delegate and interface generic type argument variance.

Chapter 13-Interfaces

No new topics.

Part III – Essential Types

Chapter 14-Chars, Strings, and Working with Text

No new topics.

Chapter 15-Enums

Added coverage of new Enum and Type methods to access enumerated type instances.

Chapter 16-Arrays

Added new section on initializing array elements.

Chapter 17-Delegates

Added discussion of using generic delegates to avoid defining new delegate types. Also added discussion of lambda expressions.

Chapter 18-Attributes

No new topics.

Chapter 19-Nullable Value Types

Added discussion on performance.

Part IV – CLR Facilities

Chapter 20-Exception Handling and State Management

This chapter has been completely rewritten. It is now about exception handling and state management. It includes discussions of code contracts and constrained execution regions (CERs). It also includes a new section on trade-offs between writing productive code and reliable code.

Chapter 21-Automatic Memory Management

Added discussion of C#’s fixed state and how it works to pin objects in the heap. Rewrote the code for weak delegates so you can use them with any class that exposes an event (the class doesn’t have to support weak delegates itself). Added discussion on the new ConditionalWeakTable class, GC Collection modes, Full GC notifications, garbage collection modes and latency modes. I also include a new sample showing how your application can receive notifications whenever Generation 0 or 2 collections occur.

Chapter 22-CLR Hosting and AppDomains

Added discussion of side-by-side support allowing multiple CLRs to be loaded in a single process. Added section on the performance of using MarshalByRefObject-derived types. Substantially rewrote the section on cross-AppDomain communication. Added section on AppDomain Monitoring and first chance exception notifications. Updated the section on the AppDomainManager class.

Chapter 23-Assembly Loading and Reflection

Added section on how to deploy a single file with dependent assemblies embedded inside it. Added section comparing reflection invoke vs bind/invoke vs bind/create delegate/invoke vs C#’s dynamic type.

Chapter 24-Runtime Serialization

This is a whole new chapter that was not in the 2^nd Edition.

Part V – Threading

Chapter 25-Threading Basics

Whole new chapter motivating why Windows supports threads, thread overhead, CPU trends, NUMA Architectures, the relationship between CLR threads and Windows threads, the Thread class, reasons to use threads, thread scheduling and priorities, foreground thread vs background threads.

Chapter 26-Performing Compute-Bound Asynchronous Operations

Whole new chapter explaining the CLR’s thread pool. This chapter covers all the new .NET 4.0 constructs including cooperative cancelation, Tasks, the aralle class, parallel language integrated query, timers, how the thread pool manages its threads, cache lines and false sharing.

Chapter 27-Performing I/O-Bound Asynchronous Operations

Whole new chapter explaining how Windows performs synchronous and asynchronous I/O operations. Then, I go into the CLR’s Asynchronous Programming Model, my AsyncEnumerator class, the APM and exceptions, Applications and their threading models, implementing a service asynchronously, the APM and Compute-bound operations, APM considerations, I/O request priorities, converting the APM to a Task, the event-based Asynchronous Pattern, programming model soup.

Chapter 28-Primitive Thread Synchronization Constructs

Whole new chapter discusses class libraries and thread safety, primitive user-mode, kernel-mode constructs, and data alignment.

Chapter 29-Hybrid Thread Synchronization Constructs

Whole new chapter discussion various hybrid constructs such as ManualResetEventSlim, SemaphoreSlim, CountdownEvent, Barrier, ReaderWriterLock(Slim), OneManyResourceLock, Monitor, 3 ways to solve the double-check locking technique, .NET 4.0’s Lazy and LazyInitializer classes, the condition variable pattern, .NET 4.0’s concurrent collection classes, the ReaderWriterGate and SyncGate classes.

Chunking a List - .NET vs Python

Abhijeet Patel — Sun, 07 Mar 2010 20:36:03 GMT

Chunking a List

As I mentioned last time, I'm knee deep in python these days. I come from a statically typed background so it's definitely a mental adjustment. List comprehensions is BIG in Python and having worked with a few of them I can see why. Let's say we need to chunk a list into sublists of a specified size.
Here is how we'd do it in C#

static class Extensions
{
public static IEnumerable<List<T>> Chunk<T>(this List<T> l, int chunkSize)
{
if (chunkSize <0)
{
throw new ArgumentException("chunkSize cannot be negative", "chunkSize");
}
for (int i = 0; i < l.Count; i += chunkSize)
{
yield return new List<T>(l.Skip(i).Take(chunkSize));
}
}
}
static void Main(string[] args)
{
var l = new List<string> { "a", "b", "c", "d", "e", "f","g" };
foreach (var list in l.Chunk(7))
{
string str = list.Aggregate((s1, s2) => s1 + "," + s2);
Console.WriteLine(str);
}
}

A little wordy but still pretty concise thanks to LINQ.We skip the iteration number plus chunkSize elements and yield out a new List of chunkSize elements on each iteration.

The python implementation is a bit more terse.

def chunkIterable(iter, chunkSize):
'''Chunks an iterable
object into a list of the specified chunkSize
'''
assert hasattr(iter, "__iter__"), "iter is not an iterable"
for i in xrange(0, len(iter), chunkSize):
yield iter[i:i + chunkSize]
if __name__ == '__main__':
l = ['a', 'b', 'c', 'd', 'e', 'f']
generator = chunkIterable(l,2)
try:
while(1):
print generator.next()
except StopIteration:
pass

xrange generates elements in the specified range taking in a seed and returning a generator. which can be used in a for loop(much like using a C# iterator in a foreach loop)
Since chunkIterable has a yield statement, it turns this method into a generator as well.
iter[i:i + chunkSize] essentially slices the list based on the current iteration index and chunksize and creates a new list that we yield out to the caller one at a time.
A generator much like an iterator is a state machine and each subsequent call to it remembers the state at which the last call left off and resumes execution from that point.

The caveat to keep in mind is that since variables are not explicitly typed we need to ensure that the object passed in is iterable using hasattr(iter, "__iter__").This way we can perform chunking on any object which is an "iterable", very similar to accepting an IEnumerable in the .NET land

Showing Progress in a .NET Console Application

Abhijeet Patel — Sun, 21 Feb 2010 18:50:28 GMT

Showing the progress of an operation is trivial in rich client applications using a progress bar control of some sort. But what about .NET console apps? The Console class offers 2 static methods Console.Write and Console.WriteLine to write out to the Console, but any subsequent calls to these methods will write the content out at the current location of the cursor.This doesn't really help when you want the progress percentage to refresh in place instead. The trick is to write out the "\r" character in the call to Console.Write so that the cursor is repositioned to the begining of the line after the content is written out. Following is quick implementation of a method which shows percentage of progress, refreshing the percent value in place.

static void ShowPercentProgress(string message, int currElementIndex, int totalElementCount)
{
if (currElementIndex < 0 || currElementIndex >=totalElementCount)
{
throw new InvalidOperationException("currElement out of range");
}
int percent = (100 * (currElementIndex + 1)) / totalElementCount;
Console.Write("\r{0}{1}% complete",message, percent);
if (currElementIndex == totalElementCount-1)
{
Console.WriteLine(Environment.NewLine);
}
}

and the caller of course.

static void Main(string[] args)
{
for (int i = 0; i < 100; i++)
{
ShowPercentProgress("Processing...", i, 100);
Thread.Sleep(100);
}
}

That's all there is to it. Happy coding.

UPDATE: This example wouldn't be complete unless I provide an Python implmentation since that's what I'm living and breathing these days.

def showProgress(message, it = [], currElement = 0):
percent = (100 * (currElement + 1)) / len(it)
sys.stdout.write("\r")
sys.stdout.write("%s %i complete" % (message, percent))
sys.stdout.flush()
def process(it, notifyCompletion = showProgress):
for item in it:
time.sleep(0.5)
notifyCompletion("Processing", it, it.index(item))
if __name__ == "__main__":
process(range(10));

UPDATE(4/27/11): I received a comment requesting a precise usage example of the above for copying files
The code below has been adapted to achieve that.
Disclamer: If you use this code, please add proper error handling as you see fit.

class Program
{
static void Copyfiles(
string[] sourceFiles,
string destPath,
Action<string,long,long> reportProgress,
int blockSizeToRead = 4096)
{
if(!Directory.Exists(destPath))
{
throw new DirectoryNotFoundException(destPath);
}
foreach (var sourceFile in sourceFiles)
{
if (!File.Exists(sourceFile))
{
Console.WriteLine("{0} not found.. skipping",sourceFile);
}
FileInfo sourceFileInfo = new FileInfo(sourceFile);
string message = string.Format("Copying {0} ", sourceFileInfo.Name);
string destFilePath = Path.Combine(destPath, sourceFileInfo.Name);
byte[] buffer = new byte[blockSizeToRead];
using (var destfs = File.OpenWrite(destFilePath))
{
using (var sourcefs = File.OpenRead(sourceFile))
{
int bytesRead,totalBytesRead = 0;
while ((bytesRead = sourcefs.Read(buffer, 0, buffer.Length - 1)) > 0)
{
destfs.Write(buffer, 0, bytesRead);
totalBytesRead += bytesRead;
if (reportProgress != null)
{
reportProgress(message, totalBytesRead, sourceFileInfo.Length);
}
}
}
}
}
}
static void ShowPercentProgress(string message, long processed, long total)
{
long percent = (100 * (processed + 1)) / total;
Console.Write("\r{0}{1}% complete", message, percent);
if (processed >= total - 1)
{
Console.WriteLine(Environment.NewLine);
}
}
static void Main(string[] args)
{
var files = Directory.GetFiles(@"C:\temp\source");
Copyfiles(files, @"C:\temp\dest", ShowPercentProgress);
}
}

Covariance and Contravariance in C# 4.0

Abhijeet Patel — Sun, 10 Jan 2010 20:50:00 GMT

C# 4.0 introduces the notion of Covariance and Contravariance of generic type parameters for interfaces and delegate types. Eric Lippert has put together a bunch of posts that goes into details of the why and how, an excellent read but not for the faint of heart. I would strongly suggest reading these posts to get a firm grounding and a better appreciation of this feature. It took me a while to get my head wrapped around this, especially since none of the VS2010 Betas were not out at the time and there was no way to try out any code. Now that I have Beta2 of VS2010 at hand I decided to try out some code samples first hand and solidify my understanding of the feature.

Suppose we have the following inheritance hierarchy:

interface IAnimal
{
void Speak();
}
class Whale : IAnimal
{
public void Speak()
{
Console.WriteLine("I'm a Whale");
}
}
class Giraffe : IAnimal
{
public void Speak()
{
Console.WriteLine("I'm a Giraffe");
}
}

and a processor to process animals:

interface IProcessor<T>
{
void Process(IEnumerable<T> ts);
}
class Processor<T> : IProcessor<T> where T:IAnimal
{
public void Process(IEnumerable<T> ts)
{
foreach (var t in ts)
{
t.Speak();
}
}
}

It would be natural to be able to create a Processor to process any kind of animal, but the following code does not compile today on the C# 3.0 compiler

List<Giraffe> giraffeList = new List<Giraffe> { new Giraffe() };
IProcessor<IAnimal> proc = new Processor<IAnimal>();
proc.Process(giraffeList);

We have to add a silly"OfType<IAnimal>" cast to make it work:

List<Giraffe> giraffeList = new List<Giraffe> { new Giraffe() };
IProcessor<IAnimal> proc = new Processor<IAnimal>();
proc.Process(giraffeList.OfType<IAnimal>());

In C# 4.0 no such cast is needed and everything just works as expected. Why? because in .NET 4.0 IEnumerable<T> is covariant in it's type parameter T, this is what the definition looks like

public interface IEnumerable<out T> : IEnumerable
{
....
....
}

The "out" keyword is what makes the "T" covariant; which means that you can pass in any type which is more derived than "T" as the type argument, hence we can pass in IEnumerable<Giraffe> or IEnumerable<Whale> to the Process method which accepts an IEnumerable<IAnimal> and everything just works as expected in a type safe way.

You can define your own covariant types to allow for such conversions.
Consider the following generic class definition to create instances of a specified type

interface IFactory<out T>
{
T CreateInstance();
}
class Factory<T> : IFactory<T> where T: new()
{
public T CreateInstance()
{
return new T();
}
}

IFactory<T> is covariant in T so we can treat a Factory<Giraffe> as an IFactory<IAnimal>. This allows us to treat factories of types in the same inheritance chain uniformly like so:

IFactory<IAnimal> giraffeFactory = new Factory<Giraffe>();
IFactory<IAnimal> whaleFactory = new Factory<Whale>();
List<IFactory<IAnimal>> factories = new List<IFactory<IAnimal>>{ giraffeFactory, whaleFactory };
foreach (var factory in factories)
{
factory.CreateInstance().Speak();
}

Note that it is illegal for a covariant type parameter to occur in an input position, it can only occur in output positions such as return type of a method in the type. This restriction is key in making covariance work,allowing the type parameter in an input position would break covariance. How you might ask. Imagine if the following illegal code were legal and you could specify T in an input position.

interface IFactory<out T>
{
T CreateInstance();
T CreateInstanceFrom(T t);
}
class Factory<T> : IFactory<T>
where T : new()
where T : ICloneable
{
public T CreateInstance()
{
return new T();
}
public T CreateInstanceFrom(T t)
{
return (T)t.Clone();
}
}

We added a constraint to the factory class to constrain the type parameter to support ICloneable and added a new method CreateInstanceFrom which accept the instance to clone. Now what happens if we do the following:

IFactory<IAnimal> giraffeFactory = new Factory<Giraffe>();
giraffeFactory.CreateInstanceFrom(new Whale())

Oh my! we just passed in a Whale to clone a Giraffe, and we'd bomb a runtime.
It is precisely for this reason that a covariant type parameter can only occur in output positions(hence the keyword out) and the runtime error is now a compile time error.

But what if we wanted to have the type paramter in an input position to get the benefits variance has to offer, enter contrvariance which is the dual of covariance. In that a type argument can be safely replaced by a more derived type but only in an input position.

If T appears ONLY in an input position (such as a parameter in methods of IProcessor) then we can mark T as contravariant using the in keyword, allowing us to substitute any sub type of T.

interface IProcessor<in T>
{
void Process(IEnumerable<T> ts);
}

This makes assignments such as the following legal.

List<Giraffe> giraffes = new List<Giraffe> { new Giraffe() };
List<Whale> whales = new List<Whale> { new Whale() };
IProcessor<IAnimal> animalProc = new Processor<IAnimal>();
IProcessor<Giraffe> giraffeProcessor = animalProc;
IProcessor<Whale> whaleProcessor = animalProc;
giraffeProcessor.Process(giraffes);
whaleProcessor.Process(whales);

Finally let's look at variance in delegate types. Consider the following delegate definition and it's subsequent usage

public delegate void MyAction<in T>(T t);
........
.......
.........
MyAction<IAnimal> animalAction = a => a.Speak();

Since T is contravariant, we can treat MyAction<IAnimal> as MyAction<Giraffe> since Giraffe is more derived than IAnimal

MyAction<Giraffe> rafAction = animalAction;

Now let's combine both co and contravariance, consider the following delegate

public delegate T2 MyFunc<in T1,out T2>(T1 t1);

T2 is covariant and T1 is contravariant and hence we can use T1 or any subtypes of T1 as the first generic type paramter and T2 or any of its base types as the second generic type parameter, allowing us to use assignments such as the following with full type safety

Func<IAnimal, Giraffe> func = a => a as Giraffe;
Func<Giraffe, IAnimal> funcG = func;

Covariance and Contravariance may sound like a mouthful and daunting to understand but at its core it's quite simple to grasp once you understand its purpose, it enables writing generic code more naturally and allows safe type coercions. That's it for today. Happy coding.

T4 template consuming a WCF service

Abhijeet Patel — Sun, 18 Oct 2009 07:06:49 GMT

It’s been a while since I’ve blogged since things have been crazy busy. I finally decided to kick myself and do a post so without further ado, the problem at hand:
A co-worker of mine asked me whether its possible to dynamically create a type from some data he is receiving from a WCF service (over HTTP).
My natural response was, why would you need to do that since Visual Studio creates a proxy from the metadata exposed by the service and the return types would typically be DataContracts.
Well, it turns out that instead of returning a strongly typed domain specific object, the service is returning a Dictionary<string,string> where the Key represents an attribute and the Value represents the value of the attribute.

This has obvious problems:

Nothing is strongly typed
No contract versioning
The service could return a variable number of fields

A naive approach is to inspect the data returned by the service and hand code a class with properties based on the type of each key in the Dictionary.
For example, if the Dictionary contained the following KeyValuePairs.
{“Name”,”Jon Smith”}
{“Age”,”20”}
{“Zip”,”90876”}

The class definition would look something like this:

public class User
{
public string Name {get;set;}
public int Age {get;set;}
public int Zip {get;set;}
}

That’s fine when you have a couple of KeyValuePairs but what if you had 10 or 20, it gets unwieldy very quickly.
Enter T4 templates, a slick way to generate code for repetitive tasks. I'd never written a T4 template before so I figured this would be a nice excuse to dabble in it a little.

Let’s create a simple service to simulate some data, nothing too fancy

using System;
using System.Collections.Generic;
using System.Linq;
using System.Runtime.Serialization;
using System.ServiceModel;
using System.Text;
namespace T4WCFService
{
[ServiceContract]
public interface IT4WCFService
{
[OperationContract]
Dictionary<string,string> GetUser(string userID);
}
}

and its implementation...

using System;
using System.Collections.Generic;
using System.Linq;
using System.Runtime.Serialization;
using System.ServiceModel;
using System.Text;
namespace T4WCFService
{
public class T4Service : IT4WCFService
{
#region IT4WCFService Members
public Dictionary<string, string> GetUser(string userID)
{
if (userID == "jsmith")
{
return new Dictionary<string, string>
{
{ "Name", "Jack smith" },
{ "Age", "30" },
{ "City", "San francisco" },
{ "State", "CA" },
{ "Zip", "94061" },
{ "Country", "USA" }
};
}
if (userID == "jasmith")
{
return new Dictionary<string, string>
{
{ "Name", "Jane smith" },
{ "Age", "28" },
{ "City", "Portland" },
{ "State", "OR" },
{ "Zip", "98685" },
{ "Country", "USA" }
};
}
return new Dictionary<string, string>();
}
#endregion
}
}

The service just simulates returning some dummy users based on a userID and returns an empty Dictionary if no matching user is found, and it’s exposed using

WSHttpBinding

The <system.servicemodel> looks as follows:

<system.serviceModel>
<services>
<service behaviorConfiguration="T4WCFService.Service1Behavior"
name="T4WCFService.T4Service">
<endpoint address="WsHttpT4Service" binding="wsHttpBinding" name="WsHttpT4Service"
contract="T4WCFService.IT4WCFService">
<identity>
<dns value="localhost" />
</identity>
</endpoint>
<endpoint address="mex" binding="mexHttpBinding" contract="IMetadataExchange" />
<endpoint address="basicHttpTService" binding="basicHttpBinding"
name="basicHttpTService" contract="T4WCFService.IT4WCFService" />
<host>
<baseAddresses>
<add baseAddress="http://WCFServices" />
</baseAddresses>
</host>
</service>
</services>
<behaviors>
<serviceBehaviors>
<behavior name="T4WCFService.Service1Behavior">
<serviceMetadata httpGetEnabled="true"/>
<serviceDebug includeExceptionDetailInFaults="false"/>
</behavior>
</serviceBehaviors>
</behaviors>
</system.serviceModel>

If you(like me) have never created a T4 template before, I’d strongly suggest reading this article first.

Welcome back, now that you know how to create a simple T4 template, let’s get started.
T4 enables writing reusable modules that can be consumed from other T4 modules. For the purpose of this exercise I decided to create a template which encapsulates invoking a WCF service and returning the result back to the caller.

Create a new Console Application and add a service reference to the service we created above, also add a new T4 file to your project called WCFServiceInvoker.tt

Double click on WCFServiceInvoker.tt and the file should open up in markup mode.Delete the default code in the .tt file and add the following code:

<#@ template language="C#v3.5"#>
<#@ output extension=".cs"#>
<#@ assembly name ="System.ServiceModel" #>
<#@ import namespace="System.Collections.Generic"#>
<#@ import namespace="System.Reflection"#>
<#@ import namespace="System.ServiceModel.Channels"#>
<#@ import namespace="System.ServiceModel"#>
<#+
public class WCFServiceInvoker<TInterfaceType,TReturnType> where TReturnType:class
{
public string EndPointAddress {get;set;}
public string EndPointName {get;set;}
public Type ServiceInterfaceType {get;set;}
public Binding Binding {get;set;}
public string MethodName {get;set;}
public object[] Parameters {get;set;}
public TReturnType InvokeMethod()
{
EndpointAddress endpoint = new EndpointAddress(EndPointAddress);
Type typeDef = typeof(ChannelFactory<>).MakeGenericType(typeof(TInterfaceType));
var typeInst = Activator.CreateInstance(typeDef,new object[]{Binding,endpoint});
var channel = typeInst.GetType().InvokeMember("CreateChannel", BindingFlags.InvokeMethod,null, typeInst, null);
var results = channel.GetType().InvokeMember(MethodName, BindingFlags.InvokeMethod, null,channel, Parameters);
return results as TReturnType;
}
}
#>

There is a lot going on here.

The template and output directives indicate that the code is written in C# and the generated file needs to be have an extension of .cs.
The <#@assembly> directive is similar to an “Add Reference” in Visual Studio, it allows for referencing external assemblies.
The <#@import> directive is similar to a “using” statement, in that it brings the types in the specified namespace in scope so that the template can avail of them.
The <#+ #> directive is called Class feature block and it allows for writing class definitions within the template.
This allows for encapsulating reusable logic.
NOTE: The class definitions in this block are not emitted out to the final .cs file.
The WCFServiceInvoker class contains a bunch of properties, whose values(when set) are used for invoking a specified service dynamically.
The type parameters “TInterfaceType” represents the type of the interface on which the method specified in the "MethodName" parameter will be invoked.
The type parameter “TReturnType” represents the type of the result returned from the method call.

Using “TInterfaceType” we dynamically create a type definition for ChannelFactory<T> using reflection, and then create an instance of it, on which we then call CreateChannel which in turns returns us an instance of a type which implements TInterfaceType. Once we have a “TInterfaceType” instance we then go ahead and invoke the specified “MethodName” with the parameters specified in the “Parameters” object[] property and get the result back which is typed to “TReturnType” and returned to the caller.

Phew! that’s a mouthful and we are not done yet. For now just keep in mind that this template is merely a helper which encapsulates the details on dynamically invoking a WCF service in a strongly typed manner.

Now onto the main task of writing a template to solve our problem.

Add another T4 template to the project and call it UserClass.tt

As before delete the code from the .tt file and add the following:

<#@ assembly name ="System.ServiceModel" #>
<#@ assembly name ="T4WCFService.dll" #>
<#@ assembly name ="System.ServiceModel" #>
<#@ import namespace="System.Collections.Generic"#>
<#@ import namespace="System.Reflection"#>
<#@ import namespace="System.ServiceModel.Channels"#>
<#@ import namespace="System.ServiceModel"#>
<#@ import namespace="T4WCFService"#>
<#@ include file="WCFServiceInvoker.tt" #>
using System.Collections.Generic;
namespace T4ClassFromDict
{
public class User
{
<#
WCFServiceInvoker<IT4WCFService,Dictionary<string,string>> invoker = new WCFServiceInvoker<IT4WCFService,Dictionary<string,string>>();
invoker.EndPointAddress = "http://localhost:24551/Service1.svc/WsHttpT4Service";
invoker.EndPointName = "WsHttpT4Service";
invoker.ServiceInterfaceType = typeof(IT4WCFService);
invoker.Binding = new WSHttpBinding();
invoker.MethodName = "GetUser";
invoker.Parameters = new object[]{"jsmith"};
Dictionary<string,string> result = invoker.InvokeMethod();
#>
<#foreach(KeyValuePair<string,string> item in result){
#>
public <#= item.Key.GetType().Name.ToLower()#> <#=item.Key#>
{
get;
set;
}
<#}#>
public static User GetUser(Dictionary<string,string> dict)
{
var user = new User();
foreach(KeyValuePair<string,string> kvp in dict)
{
typeof(User).GetProperty(kvp.Key).SetValue(user,kvp.Value,null);
}
return user;
}
}
}

We've included the template file we created before so that we can reuse it to invoke any WCF Service.
We then proceed to create an instance of WCFServiceInvoker and set it's properties to invoke the WCF service we've created.
The result of "invoker.InvokeMethod()" is a Dictionary<string,string> which we then loop through creating public properties.

We use the type of the Key as the type of the property and the Key itself as the property name.

We've also created the definition of factory method which accepts a Dictionary<string,string> and returns a User object.

Note that we've added a direct reference to the service assembly in this template so that we can get a reference to IT4WCFService.
This is just to keep the example simple, ideally you would want to seperate the interface and implementation assemblies and have a reference to just the interface assembly.

T4 templates are executed typically when saved or by right clicking on the .tt file and selecting "Run Custom Tool".
Before running the template, ensure that the WCF service is up and running.

On running/saving the template, the following class definition is generated.

using System.Collections.Generic;
namespace T4ClassFromDict
{
public class User
{
public string Name
{
get;
set;
}
public string Age
{
get;
set;
}
public string City
{
get;
set;
}
public string State
{
get;
set;
}
public string Zip
{
get;
set;
}
public string Country
{
get;
set;
}
public static User GetUser(Dictionary<string,string> dict)
{
var user = new User();
foreach(KeyValuePair<string,string> kvp in dict)
{
typeof(User).GetProperty(kvp.Key).SetValue(user,kvp.Value,null);
}
return user;
}
}
}

A client can then use the generates class as follows:

using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using System.Net;
using System.IO;
using System.ServiceModel;
using T4WCFService;
using System.Reflection;
namespace T4ClassFromDict
{
class Program
{
public string Foo { get; set; }
static void Main(string[] args)
{
var client = new T4Service.T4WCFServiceClient("WsHttpT4Service");
var data = User.GetUser(client.GetUser("jsmith"));
}
}
}

NOTE: The console app hosting the project has a direct project reference to WCF service project since it needs the IT4WCFService definition. and since T4 engine is running inside Visual studio it locks the assembly, so rebuilding the WCF service after template generation does not work.
As mentioned previously the solution to this is to have seperate assemblies for the interface and service implementation.
Download Code

Why no Anonymous Iterators in C#

Abhijeet Patel — Tue, 25 Aug 2009 04:55:53 GMT

Yes I’m a language geek and yes the awesome Eric Lippert is my idol when it comes to anything C# and the CLR, I’ve been following his blog for a long time and recently Eric wrote an awesome series on the how and why of Iterator Blocks. The entire series is very well worth a read, but then again I’d read almost anything Eric writes from why the sky is blue to why the Falkirk Wheel has horns.

I had posed a question on this post about why there are no anonymous iterators in C#. Eric provided a very good answer to that comment and I was highly flattered when he did a follow up post on this very question here.

Thanks Eric!

Creating Higher Level APIs with TPL

Abhijeet Patel — Sun, 23 Aug 2009 22:46:02 GMT

The BCL has a bunch of APIs which provide asynchronous versions of operations in the form of either Beginxxx/Endxxx or XyzCompleted, the former known as Asynchronous Programming Model(APM) and the latter known as Event Based Asynchronous Pattern (EAP). TPL provides a nice abstraction for performing asynchronous operations as Tasks using delegates, but what can you do for working with these existing BCL classes which already have an async version?

Here is an example.
Let's say we need to download some data from the web and save it to a file, you would typically use the WebClient class and write something like this today (wrapped in a method of course)

WebClient client = new WebClient();
client.DownloadDataAsync(new Uri("http://www.bing.com"));
client.DownloadDataCompleted += new DownloadDataCompletedEventHandler((s, e) =>
{
if (e.Error != null)
{
throw e.Error;
}
if (!e.Cancelled)
{
using (FileStream fs = new FileStream("bing.htm", FileMode.CreateNew))
{
fs.Write(e.Result,0,e.Result.Length);
fs.Flush();
fs.Close();
}
}
}
);
Console.Read();

Yuck not very pretty is it! It's kinda smelly and looking at the code, it doesn't really capture the essense of what we are trying to do, besides if the client were to call a method which does this work, we'd have to ensure that the client thread blocks till the continuation completes or conversely provide a mechanism such as a WaitHandle that the client can wait on, not very expressive is it?

Let's see how we can achieve the same results using the Task API.

private static TaskCompletionSource<byte[]> CreateSource(object state)
{
return new TaskCompletionSource<byte[]>(state);
}
private static void SetCompletionSource<T>(
TaskCompletionSource<T> tcs,
AsyncCompletedEventArgs e,
Func<T> getResult)
{
if (e.UserState == tcs)
{
if (e.Cancelled)
tcs.TrySetCanceled();
else
if (e.Error != null) tcs.TrySetException(e.Error);
else
tcs.TrySetResult(getResult());
}
}
public static Task<byte[]> DownloadBytesTask(this WebClient webClient, string uri)
{
var source = CreateSource(uri);
DownloadDataCompletedEventHandler handler = null;
handler = (object s, DownloadDataCompletedEventArgs e) =>
{
SetCompletionSource(source, e, () => e.Result);
webClient.DownloadDataCompleted -= handler;
};
webClient.DownloadDataAsync(new Uri(uri), source);
webClient.DownloadDataCompleted += handler;
return source.Task;
}

We've wrapped up the async network operation into a Task as an extension method.
Let's dig in a little...

In DownloadBytesTask, we first create a TaskCompletionSource which provides a mechanism to create a Task to hand out to consumers such that the only legal state modification to the Task can be performed via the methods available on the TaskCompletionSource itself and not on the instance of the Task directly, this is precisely the behavior needed for a Task that is downloading content from the web asynchronously;it doesn't make sense for the client to explicitly start such a Task which has already started downloading data and such an operation should really be considered illegal, TaskCompletionSource enables this behavior.

In the callback we call SetCompletionSource which is responsible for transitioning the state of the Task based on the results of the asynchronous operation such as whether it errored out, or completed or whether it was cancelled.

We then proceed to start the asynchronous download by calling DownloadDataAsync method of the WebClient instance.

Couple of things to note:

The callback has been unhooked from the event in the callback to ensure that we don't have a memory leak.
The Task has already started since "DownloadDataAsync" has already been invoked, and it is this started Task that we return from the method.

The client can now perform the asynchronous download and saving of content like so:

public class Program
{
public static Task WriteToFileTask(string fileName, byte[] bytes)
{
FileStream fs = new FileStream(fileName, FileMode.CreateNew);
var task = Task.Factory.FromAsync(fs.BeginWrite, fs.EndWrite, bytes, 0, bytes.Length, null);
return task;
}
static void Main(string[] args)
{
WebClient wc = new WebClient();
var task = wc.DownloadBytesTask("http://www.bing.com/");
var continuationTask = task.ContinueWith(a => WriteToFileTask("bing.htm", a.Result));
continuationTask.Wait();
}
}

The DownloadBytes extension method on the WebClient returns a Task which has already started, we then specify a continuation to execute "after" the Task completes by calling the "ContinueWith" method on the Task instance which in this case is itself a Task which works on the result of the antecedent task (a byte[]) obtained by calling the "WriteToFileTask" method which is responsible for writing out the byte[] to a file.

It's important to note that we have to wait for the "continuation" to complete by calling continuationTask.Wait(), otherwise the process will terminate since we are running on a console app. The same would hold true in case of a Webforms client since the calling Page would continue processing and not wait for the Task to complete.

Notice how the client code seems pretty terse in terms of expressing the intent. One can easily read the code and figure out what's going on.
As always happy coding!