The Data Engineer supports the implementation of data structure and architecture master/meta-data management approach and data quality programme to facilitate access to data and information.
He/She support the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information from structured and unstructured sources in a scalable, repeatable and secure manner. He/She implements data management standards and practices.
Work with stakeholders to understand needs for data structure, availability, scalability and accessibility
Support translation of data business needs into technical system requirements
Identify opportunities for improvements and optimisation
Build data flow channels and processing systems to extract, transform, load and integrate data from various sources
Develop complex code, scripts and data pipelines to process structured and unstructured data
Work with data analysts, data scientists and other analytics stakeholders to implement data models to support analytics use cases
Make data science code production ready to ensure it is maintainable, scalable and debuggable.
Deploy machine learning models to production and build the framework to monitor the performance of the model.
Assist with integration of data systems into existing infrastructure
Test data system configurations to increase efficiency
Support the handling and logging of errors
Monitor data system performance
Automate data collection and analysis processes
Develop tools to improve data flows between internal/external systems and the data lake/warehouse
Contribute to defining data retention policies
Able to administer, design, develop, validate, deploy and maintain ETL tool such as Informatica, IBM Datastage, Talend
Requirements / Qualifications:
Degree/Master in Computer Science, Information Technology, Computer Engineering or equivalent.
Experience in providing data warehouse or advanced analytics solutions, especially in designing large Big Data technologies or analytics solutions.
Demonstrate good, in-depth knowledge in relevant Extract-Transform-Load (ETL) hardware/software products, frameworks and methodologies.
Experience with at least two of the following areas:
databases (e.g. Oracle, MS SQL, MySQL, Teradata)
big data (e.g. Hadoop ecosystem)
ETL development using ETL tools (e.g. Informatica, IBM Datastage, Talend)
data repository design (e.g. operational data stores, dimensional data stores, data marts)
data interrogation techniques (e.g. SQL, NoSQL).
structured and unstructured data analytics.
batch and real-time data ingestion and processing
data quality tools and processes.
data transformation and terminology equivalence mapping.
Experience in data modelling for analytics (e.g. star schemas, snowflake schemas).
Experience with data acquisition tools (e.g., ETL, real-time data capture, and change data capture).
Experience in interacting with analytics stakeholders (economists, statisticians,clinicians, policy makers) on a business or domain level
Deep understanding of analytical models and methodologies – especially in the context of health analytics for clinical use and clinical safety (e.g. data mining, predictive analytics) would be preferred.
Comfortable working independently to carry out data analysis, estimate data quality and sufficiency. Understanding and analysing huge volumes of data drawn from heterogeneous sources / repositories. Experience in working with Big Data technologies / solutions would be preferred.
Good interpersonal skills, a detail-oriented & flexible person who can work across different areas within the team.
A good understanding of Singapore Healthcare System would be preferred.
Familiarity or experience with health informatics would be preferred.
An understanding of healthcare data governance, data acquisition and data management would be an advantage.
Stratagem Global Recruitment Pte. Ltd., 105 Cecil Street, # 18-10 The Octagon, Singapore 069534
Registered in Singapore No.: 200915477N; Recruitment Licence number 10C3398
Registered in Singapore No.: 200915477N;
Recruitment Licence number 10C3398