company-logo-image

Data Engineer

PETRONAS Digital Sdn Bhd
ashley-avatar-image

AI-generated summary

beta
speech-bubble-tail-image

Oops, looks like Ashley forgot to summarize this job! We apologize for the inconvenience. Please read the complete Job Description for full details and additional information.

Undisclosed

Kuala Lumpur

Full-Time

Job Description

  • Provide data integration (including cloud) following PETRONAS standard and architecture in a standardize manner.
  • Provide data ETL/ELT between multiple data layers in PETRONAS Enterprise Data Hub (EDH).
  • Develop, construct, test and maintain data architectures, set or model based on business requirement.
  • Support and solve integration issues, either at application level or infra and network level,
  • Identify the bottlenecks in the existing data pipelines, propose and lead the efforts to optimize and automating the data pipeline works.
  • Leverages on variety of programming languages & data crawling/processing tools to ensure data reliability, quality & efficiency.
  • Ensures lake architecture is following company’s approved architecture.
  • Employ tools and techniques used to understand and analyze how PETRONAS should collect, update, store and exchange data.
  • Define and employ data modeling and design standards, tools, best practices, and related development methodologies.
  • Designs, reviews and maintains data models.
  • Performs the data analysis activities to capture data requirements and represent them in data models visualization.
  • Manages the life cycle of the data model from requirements to design to implementation to maintenance.


Job Requirements

  • Degree in IT, Computer Science or any related field.
  • Minimum 3 years of being in senior data engineer role.
  • Minimum 3 years of hands-on relational, dimensional, and/or analytic experience (using RDBMS, dimensional, NoSQL data platform technologies, and ETL and data ingestion protocols).
  • Experience in Data Transformation using ETL/ELT tools such as AWS Glue, Factory, Talend, EAI.
  • Experience in database query using SQL.
  • Experience in Cloud Data-related tool (Microsoft Azure, Amazon S3).
  • Experience with data warehouse, data lake, and enterprise big data platforms in multi-data-center contexts required.
  • Good knowledge of metadata management, data modeling, and related tools (Erwin or ER Studio or others) required.
  • Experience in team management, communication, and presentation.
  • Experience in data modeling data solutions including but not limited to Erwin Data Modeler Data Warehouse or equivalent knowledge.


Additional Info

Experience Level

1 - 7 Years of Experience

Job Specialisation

General IT


Company Profile

PETRONAS Digital Sdn Bhd-logo-image

PETRONAS Digital Sdn Bhd


company-logo-image

Data Engineer

PETRONAS Digital Sdn Bhd

Undisclosed

Kuala Lumpur

Full-Time

This job is no longer available