Analyzing big time series data in solar engineering using features and PCA

Abstract

In solar engineering, we encounter big time series data such as the satellite-derived irradiance data and string-level measurements from a utility-scale photovoltaic (PV) system. While storing and hosting big data are certainly possible using today's data storage technology, it is challenging to effectively and efficiently visualize and analyze the data. We consider a data analytics algorithm to mitigate some of these challenges in this work. The algorithm computes a set of generic and/or application-specific features to characterize the time series, and subsequently uses principal component analysis to project these features onto a two-dimensional space. As each time series can be represented by features, it can be treated as a single data point in the feature space, allowing many operations to become more amenable. Three applications are discussed within the overall framework, namely (1) the PV system type identification, (2) monitoring network design, and (3) anomalous string detection. The proposed framework can be easily translated to many other solar engineer applications.

Fiber recognition with machine learning methods by fiber tensile fracture via acoustic emission method

“…PCA, used as a statistical method, is realized by means of dimension reduction. 19 By using an orthogonal transformation, the original random vector relevant to the component is transformed into a new random vector unrelated to the component, followed by the implementation of dimension reduction to multi-dimensional variable system so as to achieve the goal of transforming the variable system with high dimensionality into a new one with low dimensionality. Its representation in algebra refers to the transformation of the covariance matrix of the original random vector into a diagonal matrix.…”

A Dirichlet-multinomial mixture model-based approach for daily solar radiation classification

“…It is known that different sampling rates correspond to different probability distributions of data (Yang et al, 2017). For this reason, a convenient way to specify the distribution from which our ON vectors X t are drawn is to initially assume that each day is a collection of clearness index values k t of size S, and that our data are sampled from this collection with a sample size of n = 144.…”

Enhancement of a Short-Term Forecasting Method Based on Clustering and kNN: Application to an Industrial Facility Powered by a Cogenerator

“…In [6], SVMs and ANNs are applied to predict heat and cooling demand in the non-residential sector, whereas in [7] ANNs and clustering are used to predict photovoltaic power generation. PCA is considered to analyze and forecast photovoltaic data in [8] and [9], meanwhile, in [10] and [11], SVM is used. Data are also used to perform analytics on energy: In [12], open geospatial data are used to plan electrification, whereas in [13] social media data are proposed to better define energy-consuming activities.…”