As a continuation to my previous post on Social Commerce, this one follows the implementation of a Social Commerce project I led as a technical director for almost 1.5 years. The project was for a very well known instrument manufacturer that set on a mission to create a very unique site offering engaging eLearning content, entertainment videos, Social Networking and eCommerce.

Site Features

With a laundry list of features, and a highly customized online eLearning system, we set out to deliver the following core site features/functions.

> User and group-level blogging and forums
> Live Chat sessions
> Streaming HD eLearning and entertainment video content (live and pre-recorded)
> Streaming audio content (live and pre-recorded)
> YouTube-like video sharing
> Flickr-like photo sharing
> News articles
> Wikipedia-like library of articles
> eCommerce Store
> End-to-end site search
> Single sign-on user accounts

Technology

To deliver the site, a combination of platforms and technical solutions were used.

> Community Server
- User for all social networking features and functionality
> AspDotNetStorefront
- Used for all eCommerce features and functionality
> Custom eLearning System
- This was built on a customized eLearning database, layered with rich .NET and Flash user controls (e.g. video players, chat with instructor, note taking etc.)
> Custom Flash Video Player
- These were used throughout the site to stream video content at multiple angles, resolutions and chapters/sections
> LHTTPD
- Used to allow for “scrubbing” across a video at any position and start the stream at that position without having to wait for all of it to buffer.
> FFMPEG
- Used to convert multi-format video content to Flash format when users and content producers uploaded their video and audio files.
> Representational State Transfer (REST) Web Services
- The core API that wrapped Community Server and AspDotNetStorefront API was built on REST for improved response times, scalability, compatibility.
> CuteChat for Community Server
- Used to deliver the live chat sessions

This blog post will be part of a string of articles related to Social Commerce and my first-hand experience at designing and building one of the most compelling and unique Social Commerce sites for the music industry. As for the details on this site, you will get a chance to see it publicly within a month and experience the rich media, content and social commerce model it delivers. Stay tuned!

To first set some perspective and align your understanding of Social Commerce, below are details on what Social Commerce is and the current opportunity in the market for e-Commerce sites to pursue it.

“Social commerce is a subset of e-Commerce in which the active participation of customers and their personal relationships are at the forefront. The main element is the involvement of a customer in the marketing of products being sold e.g. recommendations and comments from customers.” and the eventual monetization of this process through the sale of a product – Wikipedia

Your typical e-Commerce site converts at 2%. Meaning, an average of 2 in 100 people purchase products when visiting an e-Commerce site. Sounds unrealistic doesn’t it? Well, it is mostly true – granted sites like Amazon, Eastbay and NewEgg do much better.

Social Commerce models will help break this barrier by engaging buyers with entertainment and rich community content to keep them online longer, therefore increasing the conversion rate. The longer a user is on your site being entertained by video/photo/testimonial reviews of products, the more likely they will eventually buy something.

Taking this a step further, let’s take a look at the evolutionary steps of online commerce. Brick-and-mortar stores in the early/mid 1990’s started pursuing an online presence with e-Commerce sites and online catalogs. This led to the massive growth of online commerce during the Internet bubble with sites like Amazon for example, offering a wide variety of products for sale online.

The whole concept of shopping from your home or office was a breakthrough – not needing to go to the store and hassle with lines, low inventory etc. became a thing of the past.

The past 2-3 years have been shifting online commerce into a new evolutionary phase. This phase is driven by the fact that online commerce is unable to get anywhere close to the 70% offline revenue generated by brick-and-mortar stores. But why is this?! Well, simply because 2% of online shoppers actually buy something when visiting an average e-Commerce site, and also because e-Commerce sites are not “sticky” – meaning they are not engaging.

The current state of e-Commerce sites are that they act as online catalogs with some features of user participation (e.g. reviews, ratings and comments). Clearly not enough to keep buyers entertained. Alternatively, if you walk into the Apple store, for example, you are entertained and engaged – this keeps the customer in the store experiencing the product physically and sharing experiences with others. This enhances the emotionally-driven shopping cycle that attributes to 70% of offline revenue being generated by “product discovery”.

Product discovery is driven by advice from friends, feeling and trying a product out, learning from others what their experiences are etc. Social community sites that generate this content (e.g. Engaget, DP Reviews etc.) generate the online content necessary to bridge that “product discovery” experience. The future of social commerce is about blending content that these sites generate with an e-Commerce model – keep the buyer engaged, and provide that instant buy-now capability.

Now for some interesting numbers…

In an IDC estimate, social networks only made about $400 million in revenues in 2006, but could make as much as $1 billion in 2007. AC Nielsen also noted that nearly 40% of Americans say they participate in online communities, with sites around hobbies, shared personal interests, and health-related issues among the most popular. All these numbers point to signs of an emerging online market space.

Well, all this ideas and numbers are great and fantastic, but how can we get it done?

The answer lies in technologies/solutions that are already available, and were in fact used on the soon to be launched site.

There are several advanced e-Commerce platforms that offer the out-of-box functionality needed to put a store online almost instantly. Products like AspDotNetStorefront for small to mid, and soon large, sized businesses, MediaChase ECF for mid to large size businesses, and Microsoft Commerce Server for large to enterprise businesses.

Taking these platforms and blending/merging them with Community Server, allows you to leverage the community aspects/features into the e-Commerce model. Product reviews, videos, photos, forums, live chat and much more will help add that “stickiness” to an e-Commerce site and break the 2% barrier that many e-Commerce businesses are striving to breach.

From a technical aspect, these types of blended products will provide single sign-on and unified accounts, seamless community-to-commerce and commerce-to-community purchasing and publication processes, integrated administrative interfaces and highly customized and extended applications running on a unified SOA model.

In conclusion, there is a great market opportunity picking up steam, and solutions out there that can be leveraged to provide for a social commerce platform.

In my next post, I will present the project/site I worked on and discuss the technical solutions used to deliver it.

Leverage Internal Methodologies and Frameworks for Designing Applications

> Use existing examples of documentation from other projects.
> Use cases, detailed functional requirements and high-level business/entity objects.
> Enforce database design practices (e.g. ERDs, data models etc.)

Stub Generation and Low-Level Design Documents

> Technical meeting to review all requirements and scope low-level documentation requirements.
> Oversight by tech-lead/senior-dev/DBA during design or development phase.
> Document entities, data application layer, business logic layer and presentation layer.
> Create activity diagrams and sequence diagrams for application flow and object interactions.

Sign-off by Developer per Task

> Developers should fully understand all design requirements, and tech lead should enforce.

Code Review

> Code review as per development standards/methodologies.
> Tech lead should ensure architecture is scalable, extensible and modular.
> Tech lead should ensure proper source code versioning, branching and commenting/documenting.

Testing

> Create manual test scripts for the site and follow them for system and regression testing.
> Developer should test on latest version of IE, Firefox and Safari for basic browser compatibility testing.
> Create and enforce automated unit-tests and test scripts for custom development using tools like nUnit, SQLUnit, Visual Studio Test projects.

Standardize Output

> Enforce development tools across on-site and off-shore development teams.
> Enforce a library/framework based on design requirements.
> Tech lead should leverage UML and modeling tools (e.g. Enterprise Architect, Rational Rose etc.)
> Tech lead should be fully responsible for managing all builds and enforcing rules with team (e.g. branching, tagging etc.)
> Use collaboration tools like Team Foundation Server and Sharepoint to track issues/bugs across team members.

The ongoing debate and question continues… However, as of late, some breakthroughs on my end in this area.

Basically, with a little bit of tweaking, hacking, cheating, and fooling, AspDotNetStorefront (ASPDNSF) and Community Server (CS) can live happily ever after in a single user session and “share” user account information.

And now, for the approach… In broad strokes:

1. Setup ASPDNSF and CS in their own virtual Webs within the same domain (e.g. domain.com/community, domain.com/store/)
2. Set both ASPDNSF and CS Web.config machine keys and cookie names to be identical.
3. Modify ASPDNSF code where it reads/writes to the cookie to reference the new shared name.
4. Add a column in ASPDNSF customer table that stores the CS user name (so when a user account is created on CS it will create a user account in ASPDNSF with a matching user name)
5. Modify ASPDNSF code where it reads cookie to pickup the user name (since CS will write the user name to the cookie and not a ASPDNSF GUID as ASPDNSF normally does out of box), then using that user name lookup ASPDNSF’s customer GUID in the DB and reference that for the ASPDNSF session.
6. Locate all locations in stored procedures that create/update user accounts to handle the new CS user name column.

This will ultimately allow you to sign into CS, then go to domain.com/store/ and get automatically signed into ASPDNSF since the cookie already has your sign-in information and a matching session record is located in ASPDNSF’s database.

As for the rest of the details – specific code changes, stored procedures etc., more details to come later when time permits.

Finally, since CS and ASPDNSF have URL re-writing engines we can elegantly handle those elaborate URL’s so things look nice and clean when a user view’s a ASPDNSF page and a CS page.

Hope that helps with some people out there… Enjoy!

It has been a while since I posted an update on this project… So here it goes.

Since my last post, the project I am working on has evolved to a 3-piece solution tying in AspDotNetStorefront ML 7.0, Community Server 2007 SP1 and a fully custom e-Learning solution built on Flash and .NET controls.

Due to the complexity and unique features on this project, the architecture and design grew to be very specific and custom – beyond the normal skinning of the out-of-box products and turning features on/off. The final architecture came down to an intermediate Data Application Layer (DAL) and Business Logic (BL) layer that encapsulates and partly overrides the methods/classes provided by Community Server and AspDotNetStorefront. The thinking behind this implementation is to retain the core functionality of both systems, allowing us to implement software upgrades easily and support the application maintenance and enhancement lifecycle. The e-Learning system, being that it’s designed from scratch, will expose a custom BL and DAL.

Interfacing with Community Server’s and AspDotNetStorefront’s API allows us to work outside the framework of classes/methods provided by both products, as well as build our own custom layer of methods/classes to define and produce entities that consume/provide data apparent to the application as designed. The presentation layer, will be modeled around the common ASP.NET practices of .aspx files, custom controls and a selection of controls from ComponenetArt’s WebUI product.

The single sign-on architecture has changed slightly since my last post. The approach taken now, for the sake of simplicity and ease of management, is to have Community Server act as the central point for account management/creation using ASP.NET’s membership provider, and have back-end processes that replicate billing/transactional data to AspDotNetStorefront. This allows us to collect all the data we need about a user in a User entity from the Community Server and AspDotNetStorefront databases.

The project is currently undergoing the initial stages of development, with a target date for launch of mid-2008. Stay tuned for more updates…

Yes, unfortunately this is true, and is a major competitive factor between CS 2007 and products like AspDotNetStorefront.

Fear not, for there is hope, and a whole lot more!

IP Commerce, a software company enabling open commerce services between businesses, delivers a toolkit designed to integrate with Microsoft Commerce Server 2007 to support multi-service connectivity for retailers, end-to-end e-commerce solution that includes traditional and alternative payments, and provides for compliance with Payment Application Best Practices (PABP), a sub-set of the Payment Card Industry (PCI) data security standard.

Commerce Toolkit for Multi-Channel Retail (MCR), integrates with the Commerce Server 2007 Starter Site to deliver alternative payment options, including electronic check processing, stored value and gift cards, express checkout, and bank card processing as a traditional payment option.

Below is a list of the key features delivered:

• Access to new and emerging payment types
• Seamless integration of multiple e-commerce services
• Reduced transaction costs through flexible payment options
• Dynamic management of payment types from a single location
• Security-enhanced, PCI-compliant solution

Enjoy!

Below is a list of some “critical” items that should be configured in your AspDotNetStorefront production environments.

> Rename and secure the “admin” folder:

1. Change AppConfig.AdminDir
2. Change the folder’s name
3. Assign a Windows-level login to that folder

> Change admin username from admin@aspdotnetstorefront.com to something within the site’s domain

> Change admin password to something cryptic and set AppConfig.AdminPwdChangeDays to something reasonable/safe

> Set strong passwords (optional)

AppConfig.UseStrongPwd = true

> Cycling your encryption key

The admin will auto-notify you based on AppConfig.NextKeyChange value. Use this page in the admin to reset your encryption key manually: changeencryptkey.aspx

> Set this AppConfig so the user is not always trapped in an SSL state after hitting My Account and/or Checkout pages.

AppConfig.GoNonSecureAgain = true

> Reset Cache

This is actually a call to a stored procedure and can be automated in the DB as a trigger whenever a catalog change occurs.

exec aspdnsf_CreateMissingVariants

You should always run it after any product catalog changes, as well as AppConfig and String Resource updates.

> Admin SSL

Configure IIS to force SSL on the admin folder.

> Caching

AppConfig.CacheMenus = true

> Monthly Maintenance

This should be run monthly on weekends late at night… Admin/Misc/Monthly Maintenance

With the recent buzz and excitement around AspDotNetStorefront (ASPDNSF), and not to mention their amazing growth from a less than $100 shopping cart to what they are now, one can only wonder how far can this thing go? The moon? The stars? Well, it all depends on what you want to accomplish with it, and how scalable ASPDNSF is.

A little side note on the staff/team at ASPDNSF, who I had the pleasure of meeting (including the CEO – Rob Anderson) at a recent event in El Segundo hosted by them and Interprise Solutions (since they are partnered and “integrated” now). Overall, a great team and very energetic. Their hightened participation with the developer community has taken the Open Source model, to a certain extent, and brought it to the .NET community – offering their entire source code to customize as you please is a big plus. In fact, sending them recommendations for enhancements is encouraged, which is great. Keep on keeping on ASPDNSF!

Now, back to scalability… According to Wikipedia’s entry on scalability: scalability is a desirable property of a system, a network, or a process, which indicates its ability to either handle growing amounts of work in a graceful manner, or to be readily enlarged. So what does that mean for ASPDNSF?

If anything, the main area of focus for scalability concerns is with order processing – how many orders can the site process concurrently and continue to stay online. I cannot throw out any numbers because every environment is different – from hardware to bandwidth selection, and Windows to IIS optimizations.

ASPDNSF can scale very well in a Web farm and meet fairly high demands on order processing. For example, in a 4 server Web farm one can easily handle 2-3,000 orders per day and around 2-3 million hits. Selecting a good load balancer is critical, as well as configuring it right to handle requests gracefully enough so IIS can keep running smoothly.

These numbers are not entirely aligned with an “enterprise level” site (e.g. Amazon, Eastbay etc.), something Commerce Server 2007 is designed to scale and handle very well, but they are definitely ideal for small to mid-size businesses. ASPDNSF IS, which is still in its “birth phase”, offers more room for growth since the Web admin system has been removed and now entirely resides using the IS client-based Windows applications (this is very similar to the strategy Commerce Server 2007 has taken).

Some other key features to consider with ASPDNSF, so as to not put you in fear of how scalable it is:

• FAST SQL option on queries (increased db performance)
• Built in page and data caching
• Designed to handle up to 500,000 SKUs (ML/IS versions)

Another thing to consider are some of the impressive sites already running on ASPDNSF. Below are numbers/stats (collected from Compete) for some of the sites listed on ASPDNSF’s gallery:

• Crocs.com – 250,000 visitors per month
• InPhonic.com – 4M visitors per month
• ReStockIt.com – 150,000 visitors per month

That’s about it! Comments are welcome, and keep checking back for more ASPDNSF and Commerce Server articles.

Update on this project… So far I am in the stages of selecting an Learning Management System (LMS) that is SCORM compliant and offers tools to manage courses, students, learning material and deliver it in a lightweight format. One of the biggest hurdles is selecting one that has an open API/SDK to interface with Flash Streaming Video and even synchronize content with the video – e.g. time coding frames etc.

As for the social networking and commerce tools, I have selected Community Server 2007 Enterprise and AspDotNetStorefront ML. Integrating both solutions should not be too complicated since they are both .NET 2.0 solutions, offer the entire source code with the license, and operate on IIS, SQL Server 2005, ASP.NET etc.

The biggest challenge with integrating these pieces is architecting a single sign-on model. LDAP and Active Directory are possible options, with the latter more in the headlights since we are working in a 100% Windows environment. ASPDNSF and CS 2007 can integrate fairly easily for the single sign-on, and since both are somewhat independent systems, there should be little effort to get that going.

The LMS solution will be more involved since we have to map data across the community site and LMS site (e.g. learning material, class forums and discussion groups, blogs on courses etc.). Table structures are fairly open and scalable, however we will very likely use SQL Server Replication and SSIS packages to handle the back-end integration and sharing of data across systems. On the user-facing site, meshing everything together will involve a blend of ASP.NET Master Pages (what CS 2007 uses), and XML/XSLT packages (what ASPDNSF uses), and possibly a customized Master Page and .ascx control architecture for the LMS solution.

The physical architecture that has been mapped out so far includes:

> 2 load balanced Windows 2003 Web servers – 200GB HD, 4GB RAM, 32-bit dual-core, RAID config.
> Single 64-bit SQL Server, 8GB RAM, 200GB HD.
> 1TB SAN (EMC or DELL) – blogs, photos and a subset of videos.
> Fibre Channel across all machines
> Load balancer, firewall etc.
> Content Delivery Network for bulk of Flash videos and larger photos

More details on these integrations in my next post…

When faced with a Web project, one always wonders: Someone must have done that before, right?

Almost always the answer is a resounding “Yes!”, and that puts you on the path towards purchasing, customizing and launching the solution to meet the project’s requirements.

Recently, I took on a project involving a “mash-up” of a Social Networking, eLearning and eCommerce site. How do you even start on a project like that? What are the implications and costs? These are only a few of the questions that come to mind with a project of this size.

Aligning Requirements with Solutions

After extensive online research, and referencing past experiences with projects of a similar nature, I finalized the foundation of the site down to 3 products: AspDotNetStorefront ML (eCommerce), Community Server 2007 (Social Networking) and Adobe Connect Professional (eLearning).

The biggest task is to start aligning the client’s expectations and requirements with what each of the products above offer “out of the box”, and to also produce customization points that will be required in the final site.

This process generally involves hands-on meetings, product demos, documenting and the like, all towards an effort to produce documentation outlining the User Experience supported with Use Cases and Business Requirements.

Design Phase

Approaching the design is probably one of the most challenging parts of any IT project, as it requires you to essentially build the solution on paper. However, in this situation we have to approach things a little differently.

Since we are not building everything from scratch, we have to create documentation that supports several key areas of the project:

• Integration Requirements – how each solution will integrate together and deliver functionality, such as “single sign on” and data sharing
• Customization Requirements – what parts of each solution need to be customized accross all 3 layers (UI, business logic, database)
• Physical Requirements – what type of hardware and networking equipment are needed to meet the demands of the site and each solution

These documents create a foundation for us to start the project and move towards the development phase with near 100% certainty as to what the final site should look like and function. Furthermore, these documents should dictate the tasks required by a developer to be heads down in the project without much concern on how everything should be done.

Next month I will post an update on this project, with details on how the design phase progressed.