A Framework Based on K-Means Clustering and Topic Modeling for Analyzing Unstructured Manufacturing Capability Data

Abstract

The natural language descriptions of the capabilities of manufacturing companies can be found in multiple locations including company websites, legacy system databases, and ad hoc documents and spreadsheets. To unlock the value of unstructured capability data and learn from it, there is a need for developing advanced quantitative methods supported by machine learning and natural language processing techniques. This research proposes a hybrid unsupervised learning methodology using K-means clustering and topic modeling techniques in order to build clusters of suppliers based on their capabilities, automatically infer topics from the created clusters, and discover nontrivial patterns in manufacturing capability corpora. The capability data is extracted either directly from the website of manufacturing firms or from their profiles in e-sourcing portals and directories. Feature extraction and dimensionality reduction process in this work are supported by N-gram extraction and latent semantic analysis (LSA) methods. The proposed clustering method is validated experimentally based on a dataset composed of 150 capability descriptions collected from web-based sourcing directories such as the Thomas Net directory for manufacturing companies. The results of the experiment show that the proposed method creates supplier cluster with high accuracy. Two example applications of the proposed framework, related to supplier similarity measurement and automated thesaurus creation, are introduced in this paper.

Natural language processing in-and-for design research

“…They train the labelled dataset using the following classifiers: Naïve Bayes, k-NN, Random Forest and SVM. Sabbagh and Ameri (2020) obtain LSA-based vectors of manufacturing concepts and cluster these using the manufacturing capability data – ThomasNet for 130 suppliers in heavy machining and complex machining.…”

Towards Digitalization in Bio-Manufacturing Operations: A Survey on Application of Big Data and Digital Twin Concepts in Denmark

“…• Clustering methods can be divided into Hierarchical or Partitional methods (Jain et al, 1999). Methods include K-means (Sabbagh and Ameri, 2020;Singhal and Seborg, 2005), Density-based clustering, mean-shift clustering, BIRCH (balanced iterative reducing and clustering using hierarchies) (Thomas et al, 2018). Clustering, in general, is supported by dimensionality reduction methods.…”

A Review of Uncertain Decision-Making Methods in Energy Management Using Text Mining and Data Analytics

“…Several types of unsupervised text clustering learning algorithms have been defined in the literature, including hierarchical, k-means, and partitioning and probabilistic clustering [83]. Recent applications of text clustering include reverse engineering [90], vehicle marketing [91], supply chains [92], logistic optimization [93], and the analysis of manufacturing capability [94].…”