Share this:
  • E-Mail
  • Facebook
  • Twitter
  • Linkedin
Apply Now

Job Title: Data Engineer

Company: Major Government Organisation

Corporate Title: Flexible Salary Range: Competitive Package
Location: Singapore Date Open: July 2019

Responsibilities / Duties:

  • The Data Engineer supports the implementation of data structure and architecture master/meta-data management approach and data quality programme to facilitate access to data and information.
  • He/She support the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information from structured and unstructured sources in a scalable, repeatable and secure manner. He/She implements data management standards and practices.
  • Work with stakeholders to understand needs for data structure, availability, scalability and accessibility
  • Support translation of data business needs into technical system requirements
  • Identify opportunities for improvements and optimisation
  • Build data flow channels and processing systems to extract, transform, load and integrate data from various sources
  • Develop complex code, scripts and data pipelines to process structured and unstructured data
  • Work with data analysts, data scientists and other analytics stakeholders to implement data models to support analytics use cases
  • Make data science code production ready to ensure it is maintainable, scalable and debuggable. 
  • Deploy machine learning models to production and build the framework to monitor the performance of the model.
  • Assist with integration of data systems into existing infrastructure
  • Test data system configurations to increase efficiency
  • Support the handling and logging of errors
  • Monitor data system performance
  • Automate data collection and analysis processes
  • Develop tools to improve data flows between internal/external systems and the data lake/warehouse
  • Contribute to defining data retention policies
  • Able to administer, design, develop, validate, deploy and maintain ETL tool such as Informatica, IBM Datastage, Talend

Requirements / Qualifications:

  • Degree/Master in Computer Science, Information Technology, Computer Engineering or equivalent.
  • Experience in providing data warehouse or advanced analytics solutions, especially in designing large Big Data technologies or analytics solutions.
  • Demonstrate good, in-depth knowledge in relevant Extract-Transform-Load (ETL) hardware/software products, frameworks and methodologies.
  • Experience with at least two of the following areas:
  • databases (e.g. Oracle, MS SQL, MySQL, Teradata)
  • big data (e.g. Hadoop ecosystem)
  • ETL development using ETL tools (e.g. Informatica, IBM Datastage, Talend)
  • data repository design (e.g. operational data stores, dimensional data stores, data marts)
  • data interrogation techniques (e.g. SQL, NoSQL).
  • structured and unstructured data analytics.
  • batch and real-time data ingestion and processing
  • data quality tools and processes.
  • data transformation and terminology equivalence mapping.
  • Experience in data modelling for analytics (e.g. star schemas, snowflake schemas).
  • Experience with data acquisition tools (e.g., ETL, real-time data capture, and change data capture).
  • Experience in interacting with analytics stakeholders (economists, statisticians,clinicians, policy makers) on a business or domain level
  • Deep understanding of analytical models and methodologies – especially in the context of health analytics for clinical use and clinical safety (e.g. data mining, predictive analytics) would be preferred.
  • Comfortable working independently to carry out data analysis, estimate data quality and sufficiency. Understanding and analysing huge volumes of data drawn from heterogeneous sources / repositories. Experience in working with Big Data technologies / solutions would be preferred.
  • Good interpersonal skills, a detail-oriented & flexible person who can work across different areas within the team.
  • A good understanding of Singapore Healthcare System would be preferred.
  • Familiarity or experience with health informatics would be preferred.
  • An understanding of healthcare data governance, data acquisition and data management would be an advantage.