Bigdata Lead
Published date: 2024/01/10
- Location: Mumbai, Maharashtra, India
Exp: 6 to 9 Years
Work Location: only Chennai, Pune, Mumbai
Primary Skills : Databricks with Pyspark, Python
Secondary skills; ADF (Azure data factory)
JD:
• 7+ years of experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools.
• 4+ years of work experience with very large data warehousing environment
• 4+ years of work experience in Databricks, Pyspark and Python project development work
• Expertise in Bigdata Eco systems like HDFS and Spark
• Experience in GitHuB repository Analytics Data science and IOT Lead
• Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.
• Develop, design, tune and maintain SSIS packages to perform the ETL process.
• Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.
• SQL SERVER development work experience with relational databases and knowledge is a must
• Development of Stored Procedures for transformations in ETL pipeline
• Worked with large datasets in T-SQL batch processing
• Should have work experience in Agile projects
• Write and maintain documentation of the ETL processes via process flow diagrams
Work Location: only Chennai, Pune, Mumbai
Primary Skills : Databricks with Pyspark, Python
Secondary skills; ADF (Azure data factory)
JD:
• 7+ years of experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools.
• 4+ years of work experience with very large data warehousing environment
• 4+ years of work experience in Databricks, Pyspark and Python project development work
• Expertise in Bigdata Eco systems like HDFS and Spark
• Experience in GitHuB repository Analytics Data science and IOT Lead
• Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.
• Develop, design, tune and maintain SSIS packages to perform the ETL process.
• Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.
• SQL SERVER development work experience with relational databases and knowledge is a must
• Development of Stored Procedures for transformations in ETL pipeline
• Worked with large datasets in T-SQL batch processing
• Should have work experience in Agile projects
• Write and maintain documentation of the ETL processes via process flow diagrams
0 page views
Related listings
-
Software DeveloperSoftware DeveloperProven experience as a Full Stack Developer or similar role Experience developing desktop and mobile applications Familiarity with MERN stack Knowledge of multiple front-end languages and libraries (e.g. HTML/ CSS, JavaScript) Knowledge of multiple b...2026/11/09
-
Software Developer (PHP / PythonSoftware Developerhttp://sisys.co.in/career.html IoT Device Cloud application programming Database, backend, core logic, UI and reports PHP / Python Bootstrap UI odoo programming pandas and plotly for data reporting Basic on the job training will be provided Job Types...2026/11/09
-
Junior Software DeveloperSoftware DeveloperWe require dynamic, result oriented, enthusiastic software professionals for its Research and Development wing of operations at Navi Mumbai. · Programming : C#, .Net · Scripting : JavaScript, XML · Charting : .Net Chart and plotly.js · Database : MyS...2026/11/09