The Changing Impact of Oil Well Design Completions Through Time: URTeC 2020 Novi Paper Summary

“Upsizing well completions increase production 37.5%*!!!” Sure, but when? Where that asterisk lands will have a huge impact on the returns of your well completions design. If it’s Peak Rate, that might shorten payback. If it’s EUR — now you might have a real valuable well.

Oil and gas machine learning models can be trained to predict a time series of production. This means you can evaluate the impact of any oil well completion through time, to see when a completions design has the biggest impact on well performance. Long story short, using a single scaling factor for something that should be a time series can ruin your oil & gas forecasts.

This is the subject of our URTeC 2020 paper: Deriving Time-Dependent Scaling Factors for Completions Parameters in the Williston Basin using a Multi-Target Machine Learning Model and Shapley Values.

The Well Completions Optimization process: time-series predictions and Shapley Values

How can our models estimate the impact of completions variables through time? What the machine learning model tries to predict is known as the “target.” In many instances within oil and gas, machine learning models will be single-target. That is, they will predict a single value for each well–often peak rate, 365-day cum, or EUR. We caution against using EUR as a target, as it already has interpretation and assumptions built into it. It is an Estimate after all!

Flowchart showing input features—such as well completion data and multiple columns per well ID—processed by a model to output a single production value (IP365 Cum) per well ID.

By contrast, a multi-target model predicts multiple production values. Our standard approach had been to predict cumulative oil at 30-day increments out to IP day 720. However, we now have the capability to forecast with 5-day increments and out to later days. Multi-target models provide several advantages: they capture not just a single estimate but the shape of the curve, which is critical to well planning and economics.

Oil well design matrix with Multi-Target Time-Series machine learning model

A flowchart showing a multi-target model predicting a vector of production values from well feature inputs, including tables for input features and predicted output values in the context of oil well design and well completion.

Additionally, multi-target models enable investigation of the time-series impact of input parameters. This means that you can start to answer not just whether an oil well design choice is impactful by when it is.

To estimate feature impact, we employ Shapley values. Shapley values are generated by training a model on top of our standard tree-based model. This “surrogate” model estimates how much each feature (proppant loading, fluid loading, closest-neighbor spacing, etc.) contributed to the model prediction for that IP day. Shapley values are expressed in units of barrels or mcf (in the case of a gas model).

Our customers have found tremendous value in using Shapley values for explainability and transparency, whether downloaded from Novi Cloud or accessed through Production Modeler. Shapley values aren’t a substitute for running hypothetical designs through the model (what our Forecast Engine software is designed for), but they are a great tool for examining the model and investigation/research purposes — like this URTeC paper!

Well Completions Example: changing impact of proppant through time

Our model-build pipeline produces Shapley values in terms of cumulative oil. For this study, we transformed them into rate values. Bucketing the wells by proppant loading, we can see that the largest designs have, on average, a huge uplift over small designs in early days (48%), but very little in later days (27%).

Smart well completion based in SHAP Value estimation
Average Shapley value for proppant (#/ft), compared to dataset average (oil rate in bbl/ft/day). Each line is the values binned for different proppant loadings.

The difference is even more acute for the >1400 lbs/ft designs compared to the 800-1000 lbs/ft designs. At IP120, the Shapley values show +15%, but by IP720, it’s only ~6%. This is the path towards a solid well design optimization model.

How does proppant compare to spacing and geology through time?

Proppant, of course, isn’t the only predictive feature in our model. You can use Novi outputs to make these charts for any variable, and can dive deeper by filtering to specific areas or well design groups. We find it useful to sum the Shapley values over our spacing and geology features; because we often train on 10+ spacing features and 10+ geology features, it is necessary to lump their Shapley values for comparison to completions parameters.

Below, I have filtered the dataset to just wells with >1000 lbs/ft proppant drilled at >6 wells per section spacing. I also took the absolute value of the Shapley values to show relative impact. Proppant quickly ramps up to the feature with highest contribution to the model prediction, but it falls below geology at IP330. By 720, spacing has passed fluid/ft and is about to pass proppant/ft. Stage length Shapley values are only ~2% on average relative to model average production rate, but I did not filter to short stages, which would show higher values here.

Average SHAP Value to forecast production from the machine learning model.
Average absolute Shapley values for geology, proppant, spacing, fluid, and staqe length, compared to dataset average (oil rate in bbl/ft/day). These are only for wells with >1000 #/ft proppant and >6 wells per section spacing.

Well Completion Design Conclusions & Paper Information

  • Multi-target models provide a powerful tool to investigate the impact of oil well drilling design choices on oil and gas production through time.
  • Wells with a large completions design show largest uplift over small ones at IP120; the uplift steadily diminishes through IP720.
  • Geology and oil well spacing increase in importance relative to completions designs with time.
  • This workflow is repeatable for any Novi model across a wide range of plays.

Paper Details ::

Deriving Time-Dependent Scaling Factors for Completions Parameters in the Williston Basin using a Multi-Target Machine Learning Model and Shapley Values Control ID: 3103

URTeC 2020, Wednesday, July 22, Morning Session, Theme 8: EUR and Performance Prediction: Decline Curve Analysis and Beyond III

Key Takeaways

  • Multi-target machine learning models forecast production as a time series, capturing production-curve shape instead of a single peak-rate or EUR value.
  • Single scaling factors for completions impacts can bias oil and gas forecasts when the true effect varies over time.
  • Novi Labs cautions against using EUR as a machine learning target because it embeds interpretation and assumptions.
  • Shapley values from a surrogate model quantify each feature’s contribution by IP day in barrels or mcf for explainability.
  • In Williston Basin results, large proppant-load designs averaged 48% higher early oil rates than small designs, falling to 27% later.
  • For >1400 lb/ft versus 800–1000 lb/ft proppant designs, uplift was +15% at IP120 and ~6% by IP720.
  • In filtered wells (>1000 lb/ft proppant and >6 wells per section), proppant impact fell below geology at IP330.
  • In the same subset, spacing surpassed fluid/ft by IP720 and approached passing proppant/ft in relative contribution.
A man with short brown hair smiles outdoors in front of leafy branches, wearing a dark collared shirt and textured jacket.
Ted Cross

Ted Cross is the former Vice President of Product Management at Novi. During his tenure, he led the development of advanced machine learning, data, and analytics products for unconventional oil and gas. Prior to Novi, Ted worked as a Senior Geologist at ConocoPhillips.

  • Ted Cross

    Ted Cross is the former Vice President of Product Management at Novi. During his tenure, he led the development of advanced machine learning, data, and analytics products for unconventional oil and gas. Prior to Novi, Ted worked as a Senior Geologist at ConocoPhillips.

Stay Ahead in the Energy Industry: Never Miss a Beat

A weekly newsletter packed with latest updates, in-depth expert analysis, key trends shaping the US upstream industry landscape, and updates on upcoming events you won't want to miss.
Subscribe to our newsletter

Get a weekly email with news and insights on important 
developments in one or two of the major tight oil & gas basins.

Blog subscription form (footer)

"*" indicates required fields

This field is for validation purposes and should be left unchanged.
News, trends and data for the US upstream industry
Receive latest updates on the energy industry into your inbox.

Sign up today for free and get a weekly email with News and insights on important developments in the major tight oil & gas basins.

Subscribe form (popup)

"(Required)" indicates required fields

This field is for validation purposes and should be left unchanged.
Meet Novi Labs' knowledgeable experts.
Invite to Speak

Please provide us some information about your event, and we will get back to you as soon as we can

Expert form

This field is for validation purposes and should be left unchanged.