Senior Data Engineer

ProMedia is hiring engineers to be part of our team supporting a global technology development client based in Portland.

Scope of Assignment:

• Design and implement product features in collaboration with product owners, report developers, product analysts, and business partners within an Agile / Scrum methodology
• Provide engineering on modern data processing technology stack including Spark, EMR, Airflow, Python and Snowflake within AWS
• Contribute to overall architecture, framework, and design patterns to store and process high data volumes
• Support the culture of team empowerment and engagement through successful self-management. Own your workload and contributions to the team
• Proactively support product health by building solutions that are automated, scalable, and sustainable be relentlessly focused on minimizing defects and technical debt
• Build continuous integration and test-driven development environment
• Mentor and guide other software engineers within the team including review code and provide feedback relative to best practices and improving performance

Required Skills:

• Bachelor’s degree in Computer Science, Information Systems or other relevant subject area
• 2 years’ additional relevant experience in lieu of a degree
• 5+ years of experience with large-scale data engineering with emphasis on data analytics and reporting
• Strong experience with SQL and Relational database engineering (Oracle, SQL Server, Teradata) expert-level SQL abilities
• 3+ years of experience developing in the Hadoop ecosystem, leveraging tools such as Pig, Hive, Sqoop, Spark and others
• Good understanding of file formats including JSON, Parquet, and Avro
• Experience developing solutions in Snowflake
• Experience developing with the AWS EMR managed service
• Experience developing with scripting languages such as Shell and Python
• Experience with agile delivery methodologies in a fast-paced complex environment Scrum, SAFe, Extreme Programming
• Strong ability to multi-task and balance multiple priorities in a fast-paced environment
• A Bachelor’s degree in Business, Information Technology or related field
• Solid interpersonal and communication skills (written and verbal)
• Continuous Learner

Duration:

• 1 Year+