Data Engineer

Our Client, based in Umhlanga seeks a talented Data Engineer to join their dynamic team!

Role – Data Engineer

Responsibilities

• Identifying, selecting and integrating any Big Data tools and frameworks required to provide real-time analytics
• Continuous upskilling on new technologies, frameworks and market trends
• Provision of data from various sources for advanced analytics by Data Scientists.
• Monitoring performance and advising any necessary infrastructure changes
• Defining data retention policies
• Optimise existing data processes through automation
• Assist with all data-related reporting and documentation
• Maintenance and optimization of the Analytics data sources
• Data reporting
• Assist team in resolving data-related support queries
• Development of routines (ETL, ELT, data flows, automation of algorithms developed by Data Scientists)
• System architecture (technical design and implementation processes)
• Technical Test Plan Design
• Standards and governance
• Agile development life cycle

Experience & Technical Expertise

• Bachelor’s degree or higher in relevant field.
• Minimum 3 years’ applicable work experience in SQL, relational databases and data manipulation.
• SSIS and SSAS experience required.
• Programming languages: JAVA, C# or Python required, SAS or R advantageous.
• Experience in setting up and moving data from on premise databases to cloud databases advantageous.
• Experience in big data platforms (eg. Hadoop) or processing frameworks (eg. MapReduce/Spark) and querying tools (eg. Pig, Hive and Impala) will be highly beneficial.
• Experience with NoSQL databases and/or campaign management tools will be advantageous.

Employment Type – Permanent

Location – Umhlanga