Big Data Engineer
Published date: 2024/01/10
- Location: Mumbai, Maharashtra, India
Job Description
Big Data Engineer (Spark + SQL+ Scale)
Experience:
6 - 12 years
Locations: Mumbai, Pune, Chennai, Hyderbad,Coimbatore, Bangalore, New Delhi ,
Primary
Skills:
Spark , Scala , SQL
Secondary skills: ETL, Data Engineering, Cloud (Azure pref.), Python
Desired Skills &
Responsibilities
Should have at least 6 to 12 years of experience in developing end to end ETL and Data Engineering solutions.
Fluent in Azure, Spark, Scala and SQL with ability to migrate data from Azure gen1 to gen2, ingest, design, development and testing of ETL Pipelines
Build and maintain scheduled tasks with Airflow and Python
Understand the current architecture, data flow and code.
Coordinate with Onsite and own the code deployment to higher environments.
Create comprehensive documentation in the context of changes being done to ETL pipelines.
Operate in an environment following agile scrum methodology.
Provide support during SIT/UAT, Cut-Over, Implementation and Hypercare
Big Data Engineer (Spark + SQL+ Scale)
Experience:
6 - 12 years
Locations: Mumbai, Pune, Chennai, Hyderbad,Coimbatore, Bangalore, New Delhi ,
Primary
Skills:
Spark , Scala , SQL
Secondary skills: ETL, Data Engineering, Cloud (Azure pref.), Python
Desired Skills &
Responsibilities
Should have at least 6 to 12 years of experience in developing end to end ETL and Data Engineering solutions.
Fluent in Azure, Spark, Scala and SQL with ability to migrate data from Azure gen1 to gen2, ingest, design, development and testing of ETL Pipelines
Build and maintain scheduled tasks with Airflow and Python
Understand the current architecture, data flow and code.
Coordinate with Onsite and own the code deployment to higher environments.
Create comprehensive documentation in the context of changes being done to ETL pipelines.
Operate in an environment following agile scrum methodology.
Provide support during SIT/UAT, Cut-Over, Implementation and Hypercare
0 page views
Related listings
-
Software DeveloperSoftware DeveloperProven experience as a Full Stack Developer or similar role Experience developing desktop and mobile applications Familiarity with MERN stack Knowledge of multiple front-end languages and libraries (e.g. HTML/ CSS, JavaScript) Knowledge of multiple b...2026/11/09
-
Software Developer (PHP / PythonSoftware Developerhttp://sisys.co.in/career.html IoT Device Cloud application programming Database, backend, core logic, UI and reports PHP / Python Bootstrap UI odoo programming pandas and plotly for data reporting Basic on the job training will be provided Job Types...2026/11/09
-
Junior Software DeveloperSoftware DeveloperWe require dynamic, result oriented, enthusiastic software professionals for its Research and Development wing of operations at Navi Mumbai. · Programming : C#, .Net · Scripting : JavaScript, XML · Charting : .Net Chart and plotly.js · Database : MyS...2026/11/09