• Home
  • >
  • Case studies
  • >
  • Building a Custom Data Platform to Catalyze the Energy Transition

Building a Custom Data Platform to Catalyze the Energy Transition

We implemented a data platform for Flo Energy, an electricity retailer based in Singapore. Their mission is to switch everyone to clean, renewable energy by making renewable energy as cheap as conventional energy. How? By leveraging the perks of modern technology and automating processes. And that’s where we come into play!

Our task was to design and deploy a custom data platform for Flo Energy, focusing on scalability and maintainability. A multidisciplinary team of data experts worked on this project to quickly deliver a scalable solution that meets the needs of this growing company. Additionally, we made sure the platform was easily maintainable, enabling Flo to manage the platform themselves.

Approach

While building a custom data platform, we follow our own standardized process to make sure the requirements and functionalities align perfectly with the needs of the customer. It is important to meet the complex demands while not over-engineering, thus preventing unnecessary costs. We implement the solution incrementally to speed-up the first delivery of business value and maintain flexibility when requirements change, as can be found in the process flow below:

We build custom data platforms through a standardized process that ensures its functionalities align with the customer’s needs

Process

Our multidisciplinary team efficiently created business impact through this streamlined process. Initially, our Cloud Solutions Architect conducted research by interviewing stakeholders and reviewing the tech stack to understand the current and desired situations. This led to proposing a new architecture focused on scalability, reliability, and cost-effectiveness.

In the implementation phase, we set up a Stitch SaaS solution for TimescaleDB, utilized  an existing S3 data lake, integrated with Snowflake, and established version control, a scalable data model, orchestration and transformations with dbt. We set up Snowflake databases and schemas to facilitate progressive improvement of raw, source-specific data into clean, business-ready tables.

We provided Flo Energy with a user-friendly, cost-effective and scalable data platform that enables end-to-end data processing and reporting

Key deliverables in this process were among others: leveraging dbt for code reduction. Original files that were more than a 100 lines long could be reduced to 5 lines, giving the exact same outcome while improving readability and maintainability. Another deliverable was enabling self-service dasboarding, making Flo Energy’s data accessible for their employees to make informed, data-driven decisions. 

The final stage involved iterative platform improvements. We refined the data model, enhanced the data quality, optimized the infrastructure, included cost control and implemented data governance and security. Most importantly, we onboarded the internal employees to enable them to maintain the data platform themselves.

Result

We provided a user-friendly, cost-effective and scalable data platform that enables end-to-end data processing and reporting. Since Flo Energy is a growing company, we created a product that is easily scalable. Not only for their growing current office, but also to easily scale to foreign markets. Through our efficient process and innovative architecture, we delivered a robust, data platform that enhances data-driven decision-making. The successful integration of state-of-the-art tools, coupled with a focus on scalability and cost-effectiveness, resulted in a sustainable solution for our client that they can maintain themselves.

Would you like to know more about this project?

If you have any questions about the project, feel free to get in touch with us!

Contact