• Home
  • Search
  • Optimizing Oil Field Development with Multi-Action Decision-Making in Deep Reinforcement Learning
  • Cite Icon1
  • https://doi.org/10.2118/227966-msCopy DOI Icon

Optimizing Oil Field Development with Multi-Action Decision-Making in Deep Reinforcement Learning

  • Oct 13, 2025
  • Y Falola +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Abstract Field Development Planning (FDP) has traditionally relied on conventional optimization techniques that are often static and struggle to adapt to the dynamic and uncertain nature of reservoir management. To address these shortcomings, this study develops a multi-action deep reinforcement learning (DRL) framework for autonomous and adaptive FDP. The approach utilizes the Proximal Policy Optimization (PPO) algorithm to train an agent that makes simultaneous decisions on well placement and well type (producer or injector) within a two-dimensional, two-phase reservoir environment integrated with a commercial simulator. The agent's objective is to learn a policy that maximizes the Net Present Value (NPV) over a four-year development period with yearly decisions. The results demonstrate that the agent successfully learns to optimize its strategy, with the mean reward increasing from approximately $12.5 million to over $20 million during training. On 100 unseen test cases, the trained agent achieved a mean NPV of $19.3 million, a value nearly three times higher than the best-performing conventional benchmark, the 4-spot pattern. The agent autonomously learned a robust strategy, favoring a 3:1 producer-to-injector ratio, on average, and discovered geologically sound well-spacing principles to optimize drainage and sweep efficiency. This work underscores the significant economic and strategic advantages of using a DRL-based approach, which can generate data-driven development plans that are superior to traditional, predefined strategies.

Similar Papers
  • Research Article
  • Citations6

Optimization of underground mining production layouts considering geological uncertainty using deep reinforcement learning

  • Oct 23, 2024
  • Engineering Applications of Artificial Intelligence
  • Roberto Noriega +1
  • PDF
  • Research Article
  • Citations8

A K-means Supported Reinforcement Learning Framework to Multi-dimensional Knapsack

  • Feb 15, 2024
  • Journal of Global Optimization
  • Sabah Bushaj +1
  • Conference Article
  • Citations22

Reinforcement Learning For Field Development Policy Optimization

  • Oct 19, 2020
  • Giorgio De Paola +3
  • Research Article
  • Citations5

Automating the optimization of proton PBS treatment planning for head and neck cancers using policy gradient-based deep reinforcement learning.

  • Jan 31, 2025
  • Medical physics
  • Qingqing Wang +1
  • Research Article
  • Citations1

Optimizing the user personalized recommendation system of new media short videos by using machine learning

  • May 08, 2025
  • Journal of Computational Methods in Sciences and Engineering
  • Danqing Zhu
  • Research Article

Assessing Rural Water Suitability for Small-Scale Aquaculture Using Proximal Policy Optimization: A Deep Reinforcement Learning Case Study from North Macedonia

  • Jun 17, 2025
  • Journal of Computer, Software, and Program
  • Enes Bajrami
  • Research Article
  • Citations14

Anti-Martingale Proximal Policy Optimization.

  • Oct 01, 2023
  • IEEE Transactions on Cybernetics
  • Yang Gu +3
  • Conference Article

Deep Reinforcement Learning Optimizing for Geological CO2 Storage Considering Geomechanical and Leakage Risks

  • Nov 18, 2025
  • Gamze Erdogan Erten +4
  • Conference Article
  • Citations4

Learning Similar Tasks Based On PPO By Transferring Trajectory

  • May 01, 2019
  • An Guo +2
  • Research Article
  • Citations122

Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach

  • Dec 29, 2022
  • Applied Energy
  • Yang Li +3
  • Research Article

Electric Energy Demand Response Algorithm based on Deep Reinforcement Learning

  • Mar 27, 2024
  • International Journal of Scientific Engineering and Research
  • Yun Ju +2
  • Research Article
  • Citations33

Improving the interpretability of deep reinforcement learning in urban drainage system operation

  • Nov 23, 2023
  • Water Research
  • Wenchong Tian +4
  • Research Article
  • Citations3

Energy-efficient Distributed Heterogeneous Hybrid Flow-shop Scheduling Using Graph Neural Network and Deep Reinforcement Learning

  • Jan 01, 2025
  • IEEE Transactions on Automation Science and Engineering
  • Haizhu Bao +4
  • Research Article

Value-added assessment of career planning for vocational competence based on deep learning.

  • Mar 29, 2026
  • Scientific reports
  • Wen Zhang
  • Research Article
  • Citations53

Deep Reinforcement Learning for Generalizable Field Development Optimization

  • Jul 12, 2021
  • SPE Journal
  • Jincong He +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.