Adapting Shallow and Deep Learning Algorithms to Examine Production Performance – Data Analytics and Forecasting

Abstract

In the last few years there is an increasing interest in the industry to apply Machine Learning (ML) algorithms to improve business decisions and operational efficiencies. The driver behind are the 3V's (velocity, variety and volume) of data acquisition and synthesis. The enormity of making sense out of this data pile is either too cumbersome for direct human interpretability or insurmountably time consuming (and often impractical) for physics-based models. The Machine Learning techniques systematically unravel the underlying trends and interrelationships between the driver and response variables. However, the application of these data science techniques are still relatively new in the petroleum industry and needs careful selection and adaptability to improve their forecasting success. This paper contributes in applying some of these techniques, especially deep and shallow learning algorithms, in a systematic manner, traversing step-by-step methodology of data preparation, exploratory data analysis, model selection, model validation, model parameter tuning, selection of variable of importance and model application. In particular, data sets are prepared for both Supervised Regression (continuous) and Classification (categorical) methods. Post exploratory data analysis, multivariate regression along with Multicollinearity/Variation Inflation Factor and outlier tests are applied to reduce the predictor variable list. Thereafter, classification models e.g. Gradient Boosting, Support Vector Machine, k-Nearest neighbors, Decision Trees, Random Forest etc. are progressively disciplined on training data sets to be tested on the hold-out data sets. Accuracy of predictability is compared against standard goodness-of-fit metrics. Finally, stratified k-fold cross validation methodology is applied to tune model parameters and list variables of importance. First the Shallow and Deep Learning process flow is applied to a large Delaware basin data set comprising of 5716 horizontal wells scattered in the various members of Wolfcamp formations. The original database contains a total of 131 predictor variables containing 26 reservoir, 21 completion, 22 well architecture. 53 production and 9 reservoir fluid related. The dataset is mined for individual Wolfcamp members. Results are provided to demonstrate model's predictive accuracy, applicability to a new dataset and potential pitfalls in forecasting if certain statistical metrics are ignored. The important variables of interest (in the statistically reduced dataset) which are assigned more weights in the predictive process are also enlisted. Next, as a second case study, a different Deep Learning methods (Long Short Term Memory, LSTM) is applied to history match and forecast an Eagle Ford well decline curve, to demonstrate the viability of this method in forecasting production. The paper contributes towards better understanding of some of the ubiquitous black-box ML algorithms, define an appropriate process flow to analyze large datasets and help petroleum engineers and geoscientists to apply them more rigorously and robustly in their own applications.

Rapid Classification and Diagnosis of Gas Wells Driven by Production Data

“…The guiding rule is based on maximizing the margin between the hyperplane and the observations. This method relies more on the data points closest to the decision boundary, and as a result is less influenced by outlier data points [30].…”

Application of Long Short-Term Memory Neural Networks in Shale Gas Production Prediction using Production-Related Factors

“…석유 E&P 산업에서도 데이터 기반 분석(data-driven analysis)이 적용되고 있으며, 셰일 저류층의 생산량 예측 에 관한 정확도를 높이기 위해 자료로부터 특징을 도출하여 학습과 예측을 수행할 수 있는 기계학습(machine learning) 을 활용하고 있다. 셰일가스의 생산량과 저류층 물성, 수압 파쇄 인자 등의 자료를 바탕으로 인공신경망(Artificial Neural Networks, ANN), 랜덤 포레스트(Random Forest, RF) 등을 적용하여 특정 시점의 누적생산량(cumulative production)과 궁극가채량(Estimated Ultimate Recovery, EUR)을 예측하는 다양한 연구가 진행된 바 있다 (Alabboodi and Mohaghegh, 2016;Wang et al, 2019;Biswas, 2020)…”

Anomaly detection of wind turbine based on norm-linear-ConvNeXt-TCN

“…They are prone to logistic regression underfitting and decision tree overfitting [12]. Moreover, these approaches may suffer from slow convergence and low prediction accuracy when dealing with very large datasets [13].…”