The trade-off between charging duration and battery overheating is a critical issue in battery charging, which is essentially a multiobjective decision problem. In this article, we propose a battery charging strategy based on deep reinforcement learning (RL). In contrast to conventional methods, RL technology empowers our approach to adapt to dynamic
In Section II, a new integrated energy system is designed, and each unit''s fundamental structure and mathematical model are built. To optimize the energy, economic, and environmental benefits of the integrated energy system, the optimal scheduling problem is solved using a deep reinforcement learning algorithm, which is described in detail in
Since battery degradation is unavoidable during utilization, battery management is required to minimize it. This paper proposes state-of-health (SOH)-aware battery management based on deep reinforcement learning. Our experimental results demonstrate an average battery lifetime improvement of 11.2%.
Accurate estimation of battery degradation cost is one of the main barriers for battery participating on the energy arbitrage market. This paper addresses this problem by using a model-free deep reinforcement learning (DRL) method to optimize the battery energy arbitrage considering an accurate battery degradation model. Firstly, the control problem is formulated as a Markov
In this paper, we propose an energy management strategy based on deep reinforcement learning for a hybrid battery system in electric vehicles consisting of a high
In order to solve these problems, this study designed a secondary throttle (ST) orifice opening control at the refrigerant outlet of the battery branch and proposes a new cooling control strategy based on a deep reinforcement learning (RL) algorithm to control the compressor speed (N compressor) and ST orifice opening. We also compared the performance of the RL control
Data show that Guizhou''s large-scale new energy battery and material industry realized an industrial output value of 53.28 billion yuan in 2022. By 2025, Guizhou aims to
A framework using Reinforcement Learning (RL) to control the operation of a battery storage device in a microgrid and learns an optimal energy management policy by using its past experiences is presented. The intermittent nature of Renewable Energy Sources (RES) leads to a mismatch between electricity supply and demand, thus, there is a need for energy storage and
Request PDF | Bi-level optimization of charging scheduling of a battery swap station based on deep reinforcement learning | With the rapid increase of in the number of electric vehicle (EV
An improved actor-critic-based reinforcement learning is proposed for battery scheduling, where a distributional critic net is applied for faster and more accurate reward estimation under uncertainties, and a policy net incorporating protective secondary control is adopted to satisfy security constraints. The home energy system today involves multiple
Numerical tests show that the proposed approach outperforms conventional reinforcement learning algorithms, as well as the rule-based battery scheduling approach while
Investigating the Impact of New Energy Policy on the Market for New Energy Vehicles December 2023 · Advances in Economics Management and Political Sciences Zhenyu Gao
In this paper, we propose an energy management strategy based on deep reinforcement learning for a hybrid battery system in electric vehicles consisting of a high-energy and a high-power battery pack. The energy management strategy of the hybrid battery system was developed based on the electrical and thermal characterization of the battery
Summary The design of energy management strategy (EMS) plays a vital role in the power performance and economy of battery–ultracapacitor for electric vehicles. A reinforcement learning (RL)-based E...
Abstract: In this paper, a reinforcement learning-based multi-battery energy storage system (MBESS) scheduling policy is proposed to minimize the consumers'' electricity cost. The MBESS scheduling problem is modeled as a Markov decision process (MDP) with unknown transition probability. However, the optimal value function is time-dependent and difficult to obtain
In order to solve these problems, this study designed a secondary throttle (ST) orifice opening control at the refrigerant outlet of the battery branch and proposes a new cooling control strategy based on a deep
The proposed energy management strategy has demonstrated its superiority over the reinforcement learning-based methods in both computation time and energy loss reduction of the hybrid battery
A novel energy management strategy based on neural network (NN) and reinforcement learning is proposed to split the power of lithium battery and supercapacitor
Add a new dataset here Reinforcement Learning for Battery Energy Storage Dispatch augmented with Model-based Optimizer 2 Sep 2021 · Gayathri Krishnamoorthy, Anamika Dubey · Edit social preview.
A robust battery EMS is indispensable for ensuring the effective operation of a system utilizing BES to bolster RES or to store generated renewable energy. Intelligent algorithms are
Nevertheless, determining the optimal allocation ratio of electricity and heat to meet the diverse needs of users has emerged as a new challenge. To efficiently utilize energy, Hou et al. proposed and verified an integrated solar‑hydrogen battery energy system to meet the thermal and electrical loads for small-scale utilization [43].
This paper proposes a microgrid optimization strategy for new energy charging and swapping stations using adaptive multi-agent reinforcement learning, employing deep
The significance of the battery management system (BMS) [7] in ensuring the safe and efficient operation of LIBs in EVs cannot be overstated. As a crucial part of BMS, battery equalization is considered as one of the most effective methods for reducing the unbalanced effects within a battery pack [8].According to different methods of handling unbalanced energy,
As the market demand for battery pack energy density multiplies progressively, particularly in the context of new energy pure electric vehicles, where a 10% diminution in vehicle overall mass
Xiangyu Zhang, Xin Jin, Charles Tripp, David J Biagioni, Peter Graf, and Huaiguang Jiang. 2020. Transferable reinforcement learning for smart homes. In Proceedings of the 1st international workshop on reinforcement learning for energy management in buildings & cities. 43--47.
Wu et al. [11] proposed an energy management system based on double Q reinforcement learning, offering a new approach to optimizing the utilization of hybrid ships propulsion systems. Deng et al. [ 30 ] proposed a Q-learning-based EMS for hybrid electric buses, validating its effectiveness through simulations and hardware-in-the-loop (HIL) testing in two
If there is an opportunity to conduct a scale-up case study by encompassing various battery sizes, building use types, and regions within the energy-sharing community, future research can offer a more comprehensive insight into the potential effectiveness of the RL-based BESS scheduling model in a wider array of real-world settings.
Breakthroughs in energy storage devices are poised to usher in a new era of revolution in the energy landscape [15, 16].Central to this transformation, battery units assume an indispensable role as the primary energy storage elements [17, 18].Serving as the conduit between energy generation and utilization, they store energy as chemical energy and release
We explore cutting-edge new battery technologies that hold the potential to reshape energy systems, drive sustainability, and support the green transition.
In this study, a reinforcement learning (RL) algorithm is utilized within the energy management system (EMS) for battery energy storage systems (BESs) within a multilevel microgrid. This microgrid seamlessly integrates photovoltaic (PV) plants and wind turbines (WT), employing a multilevel configuration based on battery energy-stored quasi-Z-source cascaded H-bridge
In the current era of energy conservation and emission reduction, the development of electric and other new energy vehicles is booming. With their various attributes, lithium batteries have become the ideal power
Energy harvesting (EH) is a promising technique to fulfill the long-term and self-sustainable operations for Internet of things (IoT) systems. In this paper, we study the joint access control and battery prediction problems in a small-cell IoT system including multiple EH user equipments (UEs) and one base station (BS) with limited uplink access channels. Each UE
Battery 2030+ is the "European large-scale research initiative for future battery technologies" with an approach focusing on the most critical steps that can enable the acceleration of the
Ooi CA (2016) Balancing control for grid-scale battery energy storage systems. Cardiff Univ, Cardiff, U.K. Google Scholar Li W, Cui H, Nemeth T (2021) Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles. J Energy Storage. Google Scholar Download references
Comparative study with a reinforcement learning-based energy management strategy. In this paper, we propose an energy management strategy based on deep reinforcement learning for a hybrid battery system in electric vehicles consisting of a high-energy and a high-power battery pack.
While this study does not encompass a comprehensive comparison of all optimization methods, it highlights the deliberate choice of reinforcement learning for its adaptability and learning capabilities, which are particularly beneficial for the dynamic and real-time requirements of battery management systems. Fig. 9.
We explore cutting-edge new battery technologies that hold the potential to reshape energy systems, drive sustainability, and support the green transition.
After the error compensation, additional battery control is applied to utilize the energy arbitrage process considering the energy price. As there are energy price and renewable generation uncertainties, we propose a deep reinforcement learning based bidding combined with control, called DeepBid, for sequential decision making under uncertainty.
There are also a few works on active balancing using reinforcement learning. Lu et al. use DQN to balance multiple battery cells connected in series using a redundant battery which can become parallel to each of the cells. They also consider balancing the pack without too much switching. The downside of their work is the need for fine-tuning.
State-of-the-art learning-based methods, e.g., reinforcement learning (RL), are becoming one of the most popular methodologies for model-free and real-time energy management . They can learn from historical experience and gradually adapt the strategy by maximizing the estimated total rewards.
We are deeply committed to excellence in all our endeavors.
Since we maintain control over our products, our customers can be assured of nothing but the best quality at all times.