Big Data Frameworks for Sites and Products Recommendation

Abstract

The improvement of the IT infrastructure in an e-commerce platform is essential for both customer satisfaction and increased revenue. While different techniques had been applied towards achieving this, there is still need to engage customer feedbacks in providing an all-inclusive solution to the recommendation systems available in the ecommerce domain. The motivation is on making a more exact recommendation with the traditional collaborative system by mining the feedbacks and uncovering their sentiments using big data analytic systems. This paper describes the design of a big data framework that may be used for shopping sites recommendations and another that may be used for product(s) recommendations to prospecting customers. The use of the cross industry standard process for data mining is applied in proposing the new system. Although the techniques of Hadoop/MongoDB tools are described within the proposed designs, it concentrates mainly on the architecture and algorithm of the system in a holistic approach to enable the platform providers, e-commerce merchants and practitioners find a guided implementation of it using any tool of choice.Contribution/Originality: This study documents the use of the cross-industry standard process for data mining methodology to design big data frameworks that implement the application of sentiment analysis of review texts as preprocessed input into the collaborative filtering algorithm for both sites and product recommendation. INTRODUCTIONThere is a global transformation in the economic sector across nations. Electronic or Digital Commerce, commonly known as e-commerce, is thriving globally. The e-commerce businesses have the ability to digitally go outside the country to draw upon customer bases which are definitely larger in the e-commerce context than in a physical retail context. However, setting up a new and compliant IT infrastructure that would effectively handle the demands of the (current and future) e-commerce is always a herculean task. The IT infrastructure is perhaps the most important component in setting up an e-commerce business. The other important components are the merchants of the products/services, the consumers of those products/services and the service providers who deliver the products/services. The IT infrastructure which connects the consumers with the merchants of the products/services must be built on a set of objectives that would meet the needs of the consumers. Top among the needs of the consumers include reducing customer navigation time by offering a smart product recommendation system, providing additional value by profiling, customizing or personalizing offerings, increasing customer loyalty by incentive offerings and receiving customer feedback on the general products/service presentations, image