« Back to Posts Python ETL Database Data Analysis Data Pipeline Data Visualization

offshore platforms environmental loads data management system

Designed built & maintained a data management system for offshore platforms


This was a project I worked for SBM offshore. The design of the offshore platforms is governed by environmenatl loads such as wind, waves, current, in some areas, ice.  The goal of the management system is to build data pipeline architecture and process loads data to support structure analysis and specifications design.

  1. Responsible for the full life cycle of strategy, design, testing and implementation of data assets for analytics solutions to enable strategic and operational decision making.
  2. Processed and cleansed large volume of data from 20+ sources (Oracle, SQL Server,Text files, Excel files) and built data sets for analytical solutions.
  3. Analyzed and corrected critical issues  and created graphical visualization charts  which helped the manager to understand the complex processes.
  4. predictive Analytics module for failure detection of offshore platforms based on their history environmental loads data
  5. Reviewed constantly the  feedback and then suggested ways to improve the process.

Technologies:

  1. Traditional ETL method built based on relational database (SQL), data transformation using SSIS.
  2. Batch data processing in SQL stored procedures or Python.
  3. Data cleansing and maintenance.