Module Lead Software Engineer

Department: Cloud & Data Engineering
Designation: Module Lead Software Engineer
Open Positions: 4Location: Noida / Indore / Gurgaon / Bangalore / Pune / Hyderabad
Experience: 5 to 8 Years

Skills Required: Python, Spark, Big DataJob Description:
• Do you love to work on bleeding edge Big Data and cloud technologies, do you want to work with the best minds in the industry, create high-performance scalable solutions Do you want to be part of the team that is solutioning next-gen cloud-based data platforms Then this is the place for you.
• You want to architect and deliver solutions involving data engineering, deep analytics, and ML use cases on Petabyte scale of data, that solve complex business problems
• Impetus is looking for a Big Data Developer that loves solving complex problems, architect and deliver scalable solutions across a full spectrum of technologies.
• You will be part of the team that is creating a Modern data platform (on cloud) and enabling enterprise-level adoption ETL (Extract Transform Load) modernization & Use case modernization]
· Develop and maintain data pipelines on Bigdata and cloud ETL stack
· Work closely with product owners to implementing data science use case and data analytic pipelines
· Anticipate on technological evolutions
· Design, build & maintain efficient, reusable & reliable code with quality & timely deliverables
· Drive various architectural, design and status calls with multiple stakeholders
· Help define data governance policies and support data versioning processes
· Maintain security and data privacy working closely with Data Protection Officer
· Provide the team technical direction(s)/approach(es) to be undertaken and guide them in resolution of queries/issues etc.
· Prepare training manuals for users
· Mentor the team in design & development of software application(s)/component(s)
· Fulfill organizational responsibilities (sharing knowledge & experience with other teams/groups)
· Conduct technical training(s)/session(s), write whitepapers/ case studies / blogs etc.

Roles:
Must have :

· We need a person from Java background with experience working on Hadoop (CDH/HDP/MapR) , MapReduce, Hive 2.x*, Spark 2.x*
· Conceptual knowledge of Data Structures & Algorithms
· Possessing in-depth knowledge of various Design Patterns (Java/BigData), Data Processing Patterns (Batch/NRT/RT processing) & capable of providing design & architecture of typical business problems
· Kafka, Redis, Distributed Message Queues along with Distributed Caching
· Proficient understanding of Build tools (Ant/Maven), Code Versioning tools (Git) with Continuous Integration
· Exposure and awareness of complete PDLC/SDLC. Good to have experience working in projects with Agile Scrum methodology
· Smart Bigdata engineer with strong problem-solving skills & ability to thrive in a fast paced, dynamic environment & operate under stringent deadlines
· Strong technical development experience in writing performant code leveraging best coding practices as well as conducting code reviews
· Self-starter & resourceful personality with good communication, problem solving & interpersonal skills.
· Confident, highly motivated, and passionate about delivery and customer satisfaction
· Out of box thinker and not just limited to work done in existing assignment(s)
· Knowledge of core Java, Linux, SQL, and any scripting language
· Good interpersonal skills and a positive attitude

Good to have :
· Knowledge and experience with NoSQL Database (Cassandra/HBase/MongoDB/CouchDB/Neo4j), SQL Database (MySQL/Oracle)
· Knowledge/experience working on Search Platforms (Solr/ElasticSearch), designing as well as implementing RESTful APIs
· Experience with Cloud environments (AWS/GCP/Azure), exposure to Containers & Container Management Platforms (Dockers/Kubernetes)
· Understanding of Data Lake vs Data Warehousing concept along with the ability to perform comparative analysis of Data Stores and knowledge/experience with creation & maintenance of the same
· Experience with Big Data & Cloud ML toolkits (SparkML)
· Knowledge on Data Privacy, Data Governance, Data Compliance & Security
· Programming experience with Python/Java
· Experience with building & maintaining optimal data pipelines in a reliable manner so as to deliver solutions on the fly
· Experience working on open-source products