Data Engineer

Responsibilities

• Supporting the requirements including development needs and maintenance issues from business stakeholders. Currently, the Group Credit Risk team is the primary stakeholder though this may change over time

• Supporting the users in building the PowerBI dashboards

• Maintaining the Asset Master application including any technical or data support issues with the users

• Support the maintenance of the ADF, CI/CD pipelines and Databricks notebooks including trouble shooting, reviewing code discrepancies and source file management

• Help to prepare the operation documentation for the Data Warehouse tool from a technical perspective

• Support the team where required

Requirements

• Competency with Power BI and Azure cloud systems

• Knowledge of Big Data ETL processing tools

• Experience in Data Modelling, Data mapping for Data Warehouse (such as Synapse) and Data Analytical tool (such as Azure Analysis services)

• Experience with DAX and Good analytical skillset

• Basic knowledge of scripting (shell / bash)

• Experience of working with multiple data sources including relational databases (SQL Server / ADLS Gen2 / Synapse DW) and flat files

• Understanding of CICD tools such as Jenkins, JIRA, Bitbucket, Artifactory and Azure Dev-ops.

• DevOps practices using Git version control

• An interest in staying up to date with industry standards and technological advancements that will improve the quality of your outputs.

• Ability to debug, fine tune and optimize large scale data processing jobs

• Highly capable in SQL, DAX, DataBricks

• Experience in Azure Data Factory, Azure DevOps, BitBucket or GitHub

• Knowledge of Asset Management industry preferred.