Blog

Insights on energy trading data.

Thoughts, deep dives, and updates from the team behind Numera.

Deep dive November 12, 2024

Numera: The Innovative Data Warehouse Solution for Energy Trading

An in-depth look at how Numera was built, what problems it solves, and where it's headed - featuring an interview with architect Nick Perrott and ROITI's CEO Ventsislav Topuzov.

Read article Nick Perrott
Deep dive

Numera: The Innovative Data Warehouse Solution for Energy Trading

November 12, 2024 · By Nick Perrott · Interview by Hristina Tankovska

Discover Numera

BGK Analytics and ROITI have revealed Numera - an innovative data warehouse solution for energy trading. The German energy trader EWE Trading GmbH was the first to implement it. In this interview with Numera's architect Nick Perrott and ROITI's CEO Ventsislav Topuzov, we unveil the why and what of this exciting solution.

How BGK Analytics and ROITI joined forces

Over the past decade, Nick has been interested in ROITI's growth in the European energy consulting space, having worked with one of its principals at a client site. They collaborated on various projects and shared late nights at various Brauhauser in Germany. ROITI's approach impressed Nick and he felt a strong affinity for their work. At some point in the past 3-4 years, Nick and ROITI started discussing the possibility of working together.

The use of modern cloud-based data stacks and changes in the energy business created a potential business opportunity - coinciding with Nick's ideas on meeting new requirements in risk reporting and management. Numera addresses Endur pain points while offering solutions for changing and increasing business demands, all in a very cost-effective way.

Revolutionizing P&L calculations

The BAV P&L (Best Available P&L) approach used by Numera provides the following:

  • P&L is always calculated using the "best available" source simulation results from Endur - responding gracefully to any operational challenges.
  • Automatic support for any partial or complete rerun scenarios.
  • Full and automatic support for start-of-day and intraday P&L calculations.
  • Period metrics such as DTD, MTD, or YTD are calculated in Numera rather than in Endur - lightening the operational load.

Enhancing operational efficiency

Numera ingests all Endur data in raw format, reducing the time required to incorporate new data into the data model. It also supports high-volume data series such as schedule data - vital for intraday and short-term trading areas where volumes must be seen at 15-minute or even 5-minute granularity.

The architecture enables data integration from multiple sources: clearing bank statements, CerQlar for renewable certificate data, and customer-specific extensions where necessary. This flexibility enables support for many new business cases, including reconciliations and multi-system valuation scenarios.

The power of cloud technologies

Numera's technology primarily focuses on Snowflake - a cloud-based analytical database that supports any volume of data at minimal storage costs. It can be hosted on AWS, Azure, or Google Cloud, allowing customers to store their data within their own accounts. Snowflake processes raw data into numeric data through SQL transformations and Python code for time series extraction.

Infrastructure is managed via Twingate for secure access and dbt for transformations. The Numera Data Pump is a JVM package running inside Endur that pushes data to Numera with minimal footprint on the source system.

Roadmap

Short-term: exporting all Endur data

The near-term focus is exporting all Endur data including granular schedule data down to 15-minute intervals for power markets. This enables P&L calculations by delivery period and supports intraday algo trading strategies.

Mid-term: renewable energy integration

Numera is integrating CerQlar - the leading system for Guarantee of Origin deal management. This brings together Endur and CerQlar data in one place, eliminating the need for separate platforms in renewable certificate reporting.

Long-term: AI-powered analytics

With an established customer base, the next step is advanced services - machine learning models built on Snowflake's AI capabilities, alternative valuations for delta positions, and real-time P&L perspectives trained on source data.

Interviewee: Nick Perrott · Editor: Hristina Tankovska