Specialist - Data Engineering

JD :
Resource should have worked on Spark - Scala/Java, Unix and sql, Eclipse, IntelliJ

Knowledge on Java and it’s frameworks .

Should have knowledge on Data analysis skills.

Resource with a BFS background will be good option

Should be able to work the team and track the activities.

Should be able to co-ordinate with onsite team and other stakeholders of the project.
• Should have strong knowledge in Bigdata, Spark, hive. Impala, Oracle as added advantage
• Create Scala/Spark jobs for data transformation and aggregation
• Produce unit tests for Spark transformations and helper methods
• Write Scaladoc-style documentation with all code
• Design data processing pipelines
• Knowledge on Big suites Hive, Oozie, Kafka, Cloudera
• Should have knowledge on Data analysis skills.
• Experience in Banking products with large datasets will be good option
• Should have worked on L3 development support, Good Communication skill
• Should be able to work the team and track the activities.
• Should be able to co-ordinate with onsite team and other stakeholders of the project.

Skills
• Scala (with a focus on the functional programming paradigm)
• Scalatest, JUnit
• Spark query tuning and performance optimization
• SQL database integration {{Oracle}}
• Experience working with {{ HDFS,Hive}}

Mandatory Certificate : Cloudera - CCA Spark and Hadoop Developer (CCA175)

Job Segment: Database, Developer, Java, Oracle, SQL, Technology