VidyutVanika - an autonomous intelligent agent for PowerTAC

TCS Research & Innovation

Introduction

In modern day, “smart grid” components can record energy usage in real time and help consumers better manage their energy usage. However, Energy prices that reflect energy surplus and scarcity can motivate consumers to micromanage their loads to minimize cost, and producers to better transmit their supply capacities. There is a large capacity reservoir for grid management and balancing among customer populations, such as water heaters, EV batteries, and cold-storage houses. The effective pricing and demand response can play a significant role in developing a more sustainable energy infrastructure based on increasing proportions of variable-output sources, such as wind & solar energy.

The performance of markets depends on economically motivated behavior of the participants, but proposed retail energy markets are too complex for game-theoretic analysis. Agent-based simulation environments have been used to study the wholesale energy market operations, but they didn’t explore the range of unanticipated destructive behaviors of the participants. On the other hand, Smart grid pilot projects are limited to test system dynamics for extreme situations. They lack the competitiveness of open markets, because a single project typically controls and optimizes the interaction of all parts of the pilot regions. Therefore, Power TAC is an competitive market simulation platform to address the need for policy guidance based on robust research on the structure and operation of retail energy markets. These results will help policy makers create institutions to produce the intended incentives for energy producers and consumers. This leads to development and validation of intelligent automation technologies for effective management of retail entities.

Overview of Competition

In this competition involving simulated ecosystem, participating teams will construct trading agents to act as self-interested brokers that aggregate energy supply and demand with an objective of earning a profit. In the real world, brokers could be energy retailers, municipal utilities, or cooperatives. Brokers will buy & sell energy through contracts with retail customers (households, small and medium enterprises, owners of electric vehicles), and by trading energy in a wholesale market that models a real-world European or North American wholesale energy markets.

Broker agents are challenged to operate profitably by planning and executing activities in three markets - a customer market, a wholesale market, and a balancing market. In any simulation over several weeks, brokers build portfolios of consumer, producer, and electric vehicle customers by offering tariff contracts with price specs and other incentives. At the operational level over 24 simulated hours, brokers must balance the fluctuating energy demands of their contracted consumers against the energy supply of their contracted producers. Estimated differences between supply and demand must be accommodated through price signals (demand response), by exercising controls on customer capacity (demand management), and by trading energy in the wholesale market. Residual imbalances between supply and demand in the portfolio are resolved in the balancing market, by exercising control over customer resources and wholesale regulation resources. Thus, Retail market dynamics influence the wholesale market and vice versa.

The main goals of the brokers in the competition are listed below:

Contributions

In developing a successful autonomous trading broker for Power Trading Agent Competition, I have contributed in designing and developing the following modules.

NOTE: There is only limited information regarding the project implementation and no project code here due to TCS confidentiality and Intellectual property rights

Research Outcomes

  1. VidyutVanika - a robust autonomous profitable broker which lead to winning the PowerTAC-2021.
  2. A system paper based on winning strategies of VidyutVanika-2021 (under submission).
  3. A constrained optimization strategy for optimal portfolio management in electricity retail market (under submission).
  4. A trade dynamics model based auction strategy to optimize power procurement costs in wholesale market (under submission).

References

  1. https://powertac.org/tournament/
  2. https://dx.doi.org/10.2139/ssrn.3564107