Senior Data Engineer
Published date: 2024/01/10
- Location: Mumbai, Maharashtra, India
Lead the design, development, and optimization of a multi-tenant data stack using managed stacks and services like AWS
• Design and implement scalable data models, ETL processes, and data pipelines using AWS services like Glue, Kinesis, and Lambda
• Develop and maintain data warehousing solutions using AWS services like Redshift, Snowflake, or BigQuery
• Implement efficient data ingestion techniques using technologies like Apache Kafka or AWS Kinesis
• Implement efficient data storage and retrieval techniques using technologies like S3, Parquet, and Protobuf
• Develop and maintain automated testing frameworks to ensure data quality and accuracy
• Develop and maintain data visualization dashboards and reports using AWS services like QuickSight or Tableau Server
• Monitor system performance and troubleshoot issues using AWS services like CloudWatch or X-Ray
• Continuously improve processes and systems to increase efficiency and scalability
• Lead and mentor a team of data engineers
Requirements
• Bachelor's degree in Computer Science, Mathematics, or a related field
• At least 7 years of experience in data engineering or a related field
• Proven experience leading a team of data engineers
• Extensive experience with data modeling, ETL processes, and data pipelines using AWS managed services like Glue, Kinesis, and Lambda
• Extensive experience with data warehousing solutions using AWS managed services like Redshift, Snowflake, or BigQuery
• Strong programming skills in Python, SQL, and ETL tools such as Apache Spark, Apache NiFi, and Airflow
• Experience with data visualization tools such as AWS QuickSight or Tableau Server
• Knowledge of database systems such as PostgreSQL, MySQL, and Oracle
• Familiarity with distributed computing systems such as Hadoop and Spark
• Strong problem-solving and analytical skills
• Ability to work independently and in a team environment
• Excellent written and verbal communication skills
• Strong attention to detail and ability to multi-task
This job is provided by Shine.com
• Design and implement scalable data models, ETL processes, and data pipelines using AWS services like Glue, Kinesis, and Lambda
• Develop and maintain data warehousing solutions using AWS services like Redshift, Snowflake, or BigQuery
• Implement efficient data ingestion techniques using technologies like Apache Kafka or AWS Kinesis
• Implement efficient data storage and retrieval techniques using technologies like S3, Parquet, and Protobuf
• Develop and maintain automated testing frameworks to ensure data quality and accuracy
• Develop and maintain data visualization dashboards and reports using AWS services like QuickSight or Tableau Server
• Monitor system performance and troubleshoot issues using AWS services like CloudWatch or X-Ray
• Continuously improve processes and systems to increase efficiency and scalability
• Lead and mentor a team of data engineers
Requirements
• Bachelor's degree in Computer Science, Mathematics, or a related field
• At least 7 years of experience in data engineering or a related field
• Proven experience leading a team of data engineers
• Extensive experience with data modeling, ETL processes, and data pipelines using AWS managed services like Glue, Kinesis, and Lambda
• Extensive experience with data warehousing solutions using AWS managed services like Redshift, Snowflake, or BigQuery
• Strong programming skills in Python, SQL, and ETL tools such as Apache Spark, Apache NiFi, and Airflow
• Experience with data visualization tools such as AWS QuickSight or Tableau Server
• Knowledge of database systems such as PostgreSQL, MySQL, and Oracle
• Familiarity with distributed computing systems such as Hadoop and Spark
• Strong problem-solving and analytical skills
• Ability to work independently and in a team environment
• Excellent written and verbal communication skills
• Strong attention to detail and ability to multi-task
This job is provided by Shine.com
1 page views
Related listings
-
Remote Photographer Job at TrampolineWork from homeApply Remote Photographer Job at Trampoline Trampoline Anywhere Apply 17 hours ago Work from home Full–time About Company: Trampoline is building a 2-sided marketplace bridging Indian small-batch manufacturers in the home and living space with market...2026/11/06
-
Marketing CopywriterWork from homeWhy is this a great opportunity? Audacix is a fast-growing software and services company with customers across 4 continents. We are creating a paradigm shift in software quality and cybersecurity by helping our clients go live with zero bugs and zero...2026/11/06
-
Gather information from FRRO OfficeWork from homeI need someone to visit FRRO in Fort, Mumbai and get some information from that office for me. There are couple of questions that I need answers for. FRRO Office isn't receiving phone calls and emails haven't been helpful. So, I just need someone to ...2026/11/06