Senior Data Engineer

Work closely with Data Science and BU team to build simple to complex data model that provide deep insights into data analytics. Support the implementation of high-quality analytics solutions. 

• Identify data source required for analytics 

• Responsible to perform thorough data testing and validation in supporting data ingestions while ensuring data quality 

• Analyse and organize raw data from different source systems to build dataset and data model adhering to the data architecture 

• Assembling simple to large sets of data that meet all functional business requirements 

• Work closely with the data science and business units to develop data models and pipelines for research, visual analytics and machine learning 

• Work closely with IT team to automate manual process in handling data scripts 

• Understand the data, maintain documentation and assist in data related queries 

• Ensure compliance with data governance and company security policies 

• Provide guidance and coaching to Data Engineer 

• Takes accountability in considering business and regulatory compliance risks and takes appropriate steps to mitigate the risks 

• Maintains awareness of industry trends on regulatory compliance, emerging threats and technologies in order to understand the risk and better safeguard the company 

• Highlights any potential concerns /risks and proactively shares best risk management practices

• At least a bachelor’s or master’s degree in computer science / IT / IS or its equivalent 

• Experience with distributed computing, data warehousing concepts, data modelling/architecture and building SQL scripts to support data transformation and data delivery 

• Experience with big data tools such as Hadoop, Spark, etc 

• Experience with cloud solutions preferably AWS 

• Minimum 3 years working experience, preferably in Insurance or FI domain 

• Proficiency in writing python, pyspark, SQL and UNIX 

• Excellent problem solving and troubleshooting skill  

• Results oriented. Able to identify the root issues, identify what need to be done and work as team to get the issues resolved 

• Familiarity with data science technique is a plus 

• High level of integrity, takes accountability of work and good attitude over teamwork 

• Takes initiative to improve current state of things and adaptable to embrace new changes