Sr Cloudera Hadoop Developer,Java,Impala,Hive,Scala – #2107

Job Description:

Responsibilities:

1. Work as a senior developer for the Hadoop enterprise data platform

2. Develop common components for big data platforms related to data ingestion, storage, transformations and analytics

3. Validate and test the data components and ensure they meet the functional and non-functional requirements

4. Ensure the unit of code and design follow reference architecture standards

5. Incorporate new and existing technology platforms with defined use

6. Collaborate with other developers and architects to enhance the capabilities of the platforms

7. Assist in cross-team collaboration and design discussions

8. Provide sandbox functionality to users of the datasets to build models for analysis in a secure way

Job Requirements:

Required Skills:

• 8-10 years of overall experience in Information Technology and Systems

• 2+ years of experience with Big data distribution and analytics, preferably in Cloudera Ecosystem. The must consist of hands-on experience with a full project life-cycle implementation with the following features: o data volumes in terabytes with vertical and horizontal scalability o structured and unstructured/semi-structured data o High speed querying o Analytics use cases including in-memory processing o Highly secure system o Metadata management

• 2+ years of experience in data modeling, relational and dimensional

• 5 years of experience in multiple relational database systems (SQL Server, Oracle, DB2)

• Experience with high volume systems

• Programming skills : Java -3 to 5 years, Scala/Python/or other scripting – 2 years, Impala – 2 years, Hive-2 years, Avro/Parquet – 1 year.

• Working experience in data architecture using industry best practices

• Strong verbal, presentation, and written communication skills

• Strong initiative, ability to self-manage, and also work in a team environment

Top 5 Required Technical Skills:

1. 3 – 5 years of Java programming

2. 2 years of Hadoop ecosystem, – preferably Cloudera

3. 2 years of Impala

4. 2 years of Hive

5. 2 years of any scripting language experience in the Hadoop ecosystem e.g. Python/ Scala / Spark

Preferred Skills:

• Experience in Cloudera distributed system

• Experience in Spark, Sqoop, Flume, Hive, Impala

• Experience in Unix (AIX) shell scripting

• Experience in Financial projects

• Experience in high volume Data migration projects