This site uses cookies. To find out more, see our Cookies Policy

Data Engineer in Singapore at NTT DATA Singapore

Date Posted: 6/22/2018

Job Snapshot

  • Employee Type:
  • Location:
  • Date Posted:

Job Description

  • Contributes to creating Extract, Transform, and Load (ETL) tools to extract data from transactional or staging databases
  • Collaborates with Data Architect and other stakeholders to understand requirements, relation between various data sets, and frequency of updates.
  • Demonstrates basic understanding of data origin to ensure consistent and accurate data.
  • Assists in identifying and implementing any transformation or conversions necessary to provide consistency and usability of data.
  • Performs other related duties and projects as business needs require at direction of management.

Job Requirements

  1. Minimum 3 years of experience in SQL queries and procedures including strong knowledge of optimization/tuning
  2. Excellent Python programming skills to cleanse, manipulate, and present data
  3. Experience with Big Data technologies like HDFS, Hive, Sqoop, Spark
  4. Experience in real time streaming/processing using Kafka
  5. Familiar with shell scripting
  6. Experience with cloud, preferably AWS (EC2, Lambda, Kinesis, S3, RDS, EMR etc.)
  7. Minimum 2 years of experience for the design and development of ETL process including fine tuning and optimization.
  8. Experience in noSQL databases will be advantageous