Junior Data Engineer

We are looking for a Data Engineer that will work on the collecting, storing, processing, provisioning, and analyzing of large sets of data. You will be embedded as part of an advanced analytics team focused on supporting research and development efforts to bring new data products to life for customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

Responsibilities:

• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Partner with the advanced analytics and data science teams to prepare structured and unstructured data that they can use for predictive and prescriptive modeling
• Works with data warehouse architecture team to integrate our warehouse (SQL Server) with big data technologies (e.g. Hadoop)Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure in collaboration with stakeholders
• Communicate the teams work to a range of stakeholders and leaders in IT and the business
• Foster continuous learning and innovation

Qualifications:

• Minimum of 2 years’ experience with Distributed Data Storage technologies including the Hadoop Ecosystem
• Proficiency with integration of data from multiple data sources
• Experience with big data platforms – HDFS, Hive, LLAP/Impala, and NoSQL technologies (ElasticSearch, MongoDB, HBase, Redis, Etc.)
• Experience building stream-processing systems, using technologies such as Kafka, Storm and Spark-Streaming
• Experience with analytic programming languages – Python, R, Java
• Proficiency with relational data bases (T-SQL a plus)
• Proficiency with Linux BASH scripting
• Creative thinker able to provide an idea and execute it from inception to launch
• Ability to be resourceful and creative in a fast-paced daily release environment
• Passionate about learning new technologies and languages

Education:

• Undergraduate degree in computer science/software engineering, or equivalent work experience.

#LI-AB2