Michael Stephenson

keeping your feet on premise while your heads in the cloud
posts - 356 , comments - 417 , trackbacks - 11

My Links

News

View Michael Stephenson's profile on BizTalk Blog Doc View Michael Stephenson's profile on LinkedIn

Twitter












Archives

Post Categories

Image Galleries

BizTalk

Mates

My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

I thought I’d brain dump a few thoughts after the recent BizTalk summit and how some of the information will help shape solutions with the customers whom I work with.

 

BizTalk On-Premise

Traditionally for a Microsoft focused integration team BizTalk was often used as the platform for nearly all integration solutions and this was often taken to the degree where some companies would make enterprise architecture decisions that “all integration would be done in BizTalk”.   As a product BizTalk often would allow you to do this because it has an extensive feature set which covers most of the core capabilities needed in an integration platform. 

In recent years the Microsoft Integration Developer’s tool set has been extended with other products which have become more mature and now mean that BizTalk is not the only way to solve an integration with Microsoft technology and now the BizTalk product itself is expanding to include the IAAS and PAAS offerings which should change the solutions that we build in the future.

I believe that this will change the way that organisations use BizTalk as part of their integration platforms.  I believe we will see fewer of those solve everything with BizTalk implementations and I believe we will see customers who have smaller BizTalk groups than we did in the past as they begin the embrace the use of other products along-side BizTalk.

I think BizTalk will also be used more to focus on the dirtier side of integration in the EAI space where you can use the many features of BizTalk and its adapter set to integrate into various line of business systems.

 

BizTalk IAAS

I think the benefits of the IAAS offering of BizTalk proposed in the next version of BizTalk will be particularly attractive to many organisations.  This will probably fall into two categories.  Firstly there will be those companies who are comfortable using the Windows Azure Service Bus and can bridge an on-premise and cloud instance of BizTalk using either the Service Bus Relay or Queue’s and Topics.  This will allow them to use BizTalk in the cloud for things like burst or batch patterns and then use Service Bus to integrate messages into on premise applications.  I can think of a number of customer scenarios where this option to process batch files in the cloud and to produce a queue of messages to process would be very attractive. 

The second scenario would be for customers who embrace the networking capabilities of Windows Azure and connect their data centre to a Windows Azure data centre hosting their new BizTalk IAAS instance.  This would allow for a greater use of the BizTalk feature set in the cloud and would mean you can integrate with applications exactly as you do now.  This would be very attractive for many customers who might wish to minimize their on-premise infrastructure investment.  One of the big benefits of the extended tool set which is available is that there are other alternatives for some of the traditional “as low as possible” latency solutions which opens up the option of moving some of all of your BizTalk investment off premise.

I would be surprised if in the future Microsoft didn’t offer pre-built templates for many of the different topologies BizTalk is often deployed in.  This would be a massive win because it is often time consuming and expensive to get your BizTalk installation setup correctly and to prove it performs well.  If this was a template, then all customers would be able to start with an environment that adheres to best practices rather than this being uncommon.

Customers using BizTalk IAAS will also have the ability to scale up and down their group on demand.  When I think back to some customer scenarios where you need to scale for peak demand scenarios and then have a BizTalk environment which has plenty of capacity for large periods.  These customers will eventually be able to automate scaling based on actual demand and predicted demand.  The IAAS offering will also be likely to make the licensing scenarios simpler so that a customer can have multiple BizTalk groups whereas with traditional on-premise setups it might not be practical.  I can think of one customer scenario where they have a weekend batch which requires the BizTalk group to require 4 BizTalk servers which are maxed out for the processing window of the batch, and then at other times this BizTalk group processes relatively low volume messaging.  In this customers scenario it might be feasible to separate the BizTalk group into two groups.  One small group of 2 BizTalk servers to provide highly available messaging but the batch stuff is on the 2nd group.  This group could then only be on for the duration of the batch window and turned off after.  Perhaps the 2nd group would utilize 6 BizTalk servers to process the batch and then be turned off the rest of the week.

Depending upon how Microsoft licenses the BizTalk IAAS offering, multiple group scenarios and part-time usage scenarios could be much more cost effective for customers that in the past.

I think it will also be interesting to see how BizTalk as an IAAS offering compares in its uptake to the way customers used to use BizTalk branch edition.  In my experience I haven’t really come across any customers who have used branch edition and I always felt that its limitations meant that bigger customers would just get standard edition setups in their local offices.  I would expect that companies who embrace the cloud may find BizTalk IAAS as an interesting alternative way of doing this.

 

BizTalk PAAS

The BizTalk PAAS offering also means that some of the traditional work done in an on-premise instance of BizTalk may be able to be done in the PAAS platform.  The features available in the PAAS offering for BizTalk will initially be small by comparison with on-premise BizTalk so you will only be able to do a limited number of things, but over time this is bound to extend.  I think its interesting that one of the key areas of focus is EDI and I believe that in recent years one of the key areas of growth for BizTalk was around EDI scenarios when BizTalk introduced a new version with some new EDI enhancements which other vendors had not already implemented.  This is an example of where the time to market offered by the BizTalk PAAS platform could be a key element in the future.  I would expect that other accelerators and industry vertical solutions would be areas where there is good value to be had in the PAAS platform, particularly if on-premise BizTalk plays well with the PAAS platform.

I think BizTalk PAAS will open up new opportunities which we have never had in the BizTalk space before.  I think small organisations who would never have considered BizTalk or any of the other big integration vendors will now have the ability to develop structured integration solutions using the Microsoft platform.  This will have the benefits that they will develop solutions which will have a better chance of being able to grow and scale as the organization grows.  It will also help in acquisition scenarios when smaller organisations have built solutions on a platform rather than the spaghetti custom solutions im sure we have all come across before.

I think BizTalk PAAS will also help for B2B scenarios with regard to organisations passing data between each other in a secure way.

 

BizTalk for Large Organisations

I think that in larger organisations you will tend to see smaller BizTalk setups than usual but also potentially more organisations with more than one BizTalk group.  These will still be some large organisations who do those massive BizTalk implementations with specialist requirements which occasionally come up but they will probably do more hybrid solutions using BizTalk plus other Microsoft integration technologies.

There are likely to be many organisations who will not really change much for many years, but at the same time there will be others who embrace some of the new opportunities.

I think in that the organisations who really take advantage of these changes you will find that they will have moved some of their existing BizTalk investment to the BizTalk IAAS offering because it offers cost savings.  I would expect they will still keep some BizTalk on premise but its likely to be smaller scale and to have a few constraints around what kind of patterns are implemented on premise to ensure they need to be on premise.

I think the most effective larger organisations will be likely to use most of the newer Microsoft integration technologies for example:

-          On-premise

o   BizTalk

o   Windows Server Service Bus

o   Workflow Host

-          Cloud

o   BizTalk IAAS

o   BizTalk PAAS

o   Windows Azure Service Bus

These organisations will have a great platform which will allow them to use the best technology suited to each integration problem and hopefully the integration between the technologies in the platform will be very seamless.

 

BizTalk for Medium Sized Organisations

Medium sized organisations are bound to be interesting places to work.  Typically you come across those who try to implement BizTalk but struggle for various reasons.  They usually struggle around the ability to get skilled resources and to implement and manage a good infrastructure.  I would expect that in the future BizTalk IAAS will be one of the attractive bits to these companies because it means some of the problem areas they typically face can be removed.  I would also expect that the IAAS offering will help many organisations find BizTalk is more affordable if it moves towards a usage based cost model.  These organisations may not have been able to afford a suitable BizTalk setup and implementation previously but when your deployment and management costs get smaller and you have the ability to pay based on CPU hour rather than the full cost up front then this becomes much more feasible for many companies.

There will still be medium sized organisations who do BizTalk just as they do now, but there will be many who can save money by considering the above and there will be those who have never had BizTalk before who suddenly become potential BizTalk users.

For some medium sized organisations they may find that they have BizTalk but don’t really need it.  They would be the kind of organization where they implemented a BizTalk solution because it was previously Microsoft’s only real integration offering and it did most things pretty well.  These organisations may find that they don’t necessarily need BizTalk anymore because there are other Microsoft technologies which do certain integration patterns slightly better or as well as BizTalk.  For these customers they may find that they can get migrate their BizTalk investment to take advantage of other Microsoft technologies which meet their requirements better than BizTalk does but offer a better value for money solution.  These organisations are typically ones where you might look at their BizTalk investment and feel it was overkill of the solution they were trying to achieve.

Medium sized companies are also more likely to consider BizTalk IAAS solutions because the risk profile around BizTalk projects will change significantly if the licensing becomes usage based.  In the past a medium sized company would be taking a reasonable risk to purchase licenses for SQL and BizTalk during their project life cycle as an up-front cost.  If the project failed to deliver its business value for some reason then they would still have purchased these licenses which would not be cheap.  In a usage based scenario if the business project failed to deliver results then you can just turn off and remove the BizTalk virtual machines and stop paying for them.  This would remove some of the barriers that would have previously been a blocker to companies considering a BizTalk project.

 

BizTalk for Small Organisations or Start-ups

Smaller organisations are one of the areas which I find most exciting.  Often these companies will not consider BizTalk solutions because the cost to implement a solution makes it unfeasible.  These companies are also some of the ones which can offer some of the most innovative opportunities.  With the changes coming in the BizTalk space and the extended Microsoft integration platform including the other technologies discussed earlier, these types of company will be in a better position than ever to start using a structured integration platform with Microsoft from day one.  This will create opportunities for Microsoft integration developers with companies who they have never worked with before.

Imagine small companies using an on-premise instance of Service Bus for Windows Server or BizTalk IAAS.  They will be able to create solutions when the business is a company of less than 10 people which will be on infrastructure which could scale with the company when it grows into a company with thousands of employees.  This scalability will allow them to take more iterative approaches to enhancing their integration platform rather than the typical distinct phases where a growing organisation makes periodic massive investments in IT projects because the organisation has outgrown their applications and integration solutions.

 

Conclusion

As I mentioned at the start of the article this has been a little bit of a brain dump of my thoughts following the BizTalk summit and Im hoping that I have articulated that I believe there some quite exciting opportunities ahead in the integration space around Microsoft technology and particularly with BizTalk. 

I think one thing that did come to mind while I was at the BizTalk summit was the marketing story Microsoft used a couple of years ago with BizTalk which was “Better Together”.  I believe this marketing story is still true and stronger than ever.  I believe as architects using these technologies it is important to understand the capabilities of each and the overlaps and distinctions between them to help customers in the future leverage the right tool for the right job.  There is a lot of talk around hybrid solutions but I think that in time people will appreciate that hybrid solutions do not just mean integrating on-premise with the cloud but also a hybrid integration solution can mean combining integration technologies that work together to deliver a solution regardless of where the technology execution is hosted.

I’m really looking to see what other people think and provoke some discussion around this

Print | posted on Tuesday, January 8, 2013 12:43 PM | Filed Under [ BizTalk ]

Feedback

Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

Very interesting reading and I have to agree with you on most points, but some of the onpremise solution is hard to know the future of. For example Appfabric vs Workflow Manager 1.0, Servicebus documentation. There are a great need for more business related scenarios for these new products. Those that you can find now is more just technology samples.
1/8/2013 7:40 PM | Torben Christiansen
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

Thanks for sharing. I think that BizTalk groups will become integration groups embracing all tool sets.
1/9/2013 7:47 AM | Mark Brimble
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

Torben

Thanks for the feedback. I agree with your points on the on premise technologies. I think with regard to these its important that integration teams understand the capabilities of the different offerings and where they fit so they can choose the right ones to invest in for their organisation.

In terms of business related scenarios and samples what would you like to see. Would case studies be sufficient?

1/10/2013 1:51 PM | Mike
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

Mike,

One thing you mention that I really don't understand is "I would expect that in the future BizTalk IAAS will be one of the attractive bits to these companies because it means some of the problem areas they typically face can be removed.". How does IAAS solve any issues related to the problems these companies are facing? IAAS won't make BizTalk integration challenges and administration go away. It merely helps not having to purchase and provision hardware and OS. All the other stuff remains the same.

We'll also have to see about IAAS costs. At the moment it is a lot cheaper for me to run it on my own hardware than spinning up some expensive VMs. MS needs to work on that... (believe me, we wanted to in some cases but couldn't because of price)

Nice brain dump though. Hope MS will bring us a nicely integrated dev, deploy and monitoring toolset that is target architecture agnostic :-)

Cheers, Gijs
1/12/2013 4:34 AM | Gijs in 't Veld
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

Hi Gijs

Thanks for your feedback, to elaborate a little:

"I would expect that in the future BizTalk IAAS will be one of the attractive bits to these companies because it means some of the problem areas they typically face can be removed.". How does IAAS solve any issues related to the problems these companies are facing?

I see many situations where projects struggle to setup their initial infrastructure for development, test and production environments. Many times the environments they end up with have issues which the organisation may not even be aware of until after the implementation is live. I hope that Microsoft introduce templates for many of the common topologies so that setting up a environments from a single developer machine to a multi server BizTalk environment can be easily done. These templates should deal with many of these common issues customers face. For many companies this environment provision piece is both costly and painful so i would see this as a big positive. So inline with your above comment i see purchase and provision of hardware/OS and the rest of the setup as being a big benefit

In terms of other administration absolutely technically nothing is really different but I think as companies get used to provisioning ourside of their own data centres the culture of these companies will hopefully change too and managed services opportunities will probably grow in the future, particularly for smaller companies who struggle to find people with the right skills. I think a company like BizTalk 360 would be in a great place with there solid track record around BizTalk support and operations to become a managed services provider in the future with some of these smaller companies. For the managed service provider environments in Azure should make it some what easier to manage environments for multiple customers concurrently. This all depends on companies being comfortable with outsourcing this which I think hosting in the cloud will encourage.
Perhaps some organisations will even buy integration services from an outsourcing partner who does every thing in a BizTalk environment for them and just delivers a queue of messages which the customers back end application processes and the customer doesnt need to care about BizTalk at all?

I think cost will be vital. I hope i put plenty of hints above in the article that if cost is competitive then there could be lots of opportunities - Hint again for any readers at Microsoft :-)

Cheers
Mike
1/13/2013 7:41 AM | Mike
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

I think that BizTalk IaaS/PaaS has another potential usage (if the pricing is right). This could be used a a real and effective DR site. Log shipping could occur on a continuous basis and the DR site would be ready to bring up on relatively short notice. Obviously, there are a lot of other issues associated with connecting to the endpoints referenced by the BizTalk applications, but this should be no more difficult that any other DR site.

Brad
1/15/2013 12:46 AM | Brad Friedlander
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

Hi Brad

I think the DR capability is a great idea. Hadnt thought of that option myself but once you have your virtual networking in place its an interesting option.
1/15/2013 2:20 AM | Mike
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

I think that
Log shipping could occur on a continuous basis and the DR site would be ready to bring up on relatively short notice. Obviously, there are a lot of other issues associated with connecting to the endpoints referenced by the BizTalk applications, but this should be no more difficult that any other DR site.
1/25/2013 5:36 PM | liton
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

People pursuing an Oracle certification exam often ask how much time they should allocate to prepare for the test. Unfortunately, there are so many variables involved in the amount of time required that most answers are simply a shot in the dark.
2/26/2013 2:01 PM | mike
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

"...I see many situations where projects struggle to setup their initial infrastructure for development, test and production environments. ...
I hope that Microsoft introduce templates for many of the common topologies so that setting up a environments from a single developer machine to a multi server BizTalk environment can be easily done..."
As I can see, the only solution for MSFT on this way (to simplify the initial infrastructure effort) is to modify the BizTalk installation procedures. In existed state it is near impossible to create the simple/reliable environment templates/preconfigured VMs. There are too many diverse, inconsistent, environment/platform related pieces in the BizTalk environment.
The whole installation should be drastically simplified (redesigned). And it will never happen. :)
3/14/2013 3:47 AM | Leonid Ganeline
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

"...I think cost will be vital. I hope i put plenty of hints above in the article that if cost is competitive then there could be lots of opportunities - Hint again for any readers at Microsoft :-)..."
+1
I see more and more medium size organization are looking for the BizTalk alternatives for one reason - the cost. There are plenty of alternatives, so the BizTalk is out of the picture. And what is MSFT doing with it? They increased the price. It is something really smart or really stupid. I am still hearing the same old song "the BizTalk is better then anything in this field".
3/14/2013 3:56 AM | Leonid Ganeline
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

OH, (
sac hermes)
I love how you describe these points here. Your article is pretty remarkable, and I really enjoyed reading it.
7/30/2013 1:17 AM | Yean
Gravatar

# PassbeeMedia

There are plenty of choices, and so the BizTalk will be out of your photograph. And what's MSFT undertaking with it? They will increased the purchase price. It can be something genuinely intelligent as well as genuinely silly. We are however hearing the same old music "the BizTalk is way better and then everything in this particular field".
2/25/2014 6:46 AM | how to make apple passbook
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

Obviously, there are a lot of other issues associated with connecting to the endpoints referenced by the BizTalk applications torrents , but this should be no more difficult that any other DR site.
3/9/2014 11:48 PM | darki
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

nice, learn how to write and read.
stage de pilotage
5/23/2014 4:37 AM | hamsdkj
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

we having, best information related to work.

karting
6/2/2014 5:33 AM | hamenrt.
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

You are allowed to post names, but not links, unless they are approved and on topic.
Gertrude Knight
6/28/2014 10:28 PM | qadir
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

I've never really considered how miserable a space walk could be until Dave described spitting onto his fogged up visor.

sustanon for sale
7/12/2014 4:37 PM | ssdffd
Gravatar

# re: My Thoughts on the future of BizTalk - Post BizTalk Summit 2012

your post has been beneficial. Can you please add more reference

sustanon for sale
7/12/2014 4:37 PM | ssdffd
Post A Comment
Title:
Name:
Email:
Comment:
Verification:
 
 

Powered by: