Senior Data Engineer

Job description - Data Engineer with 5+ years of experience

Location: Pune, MH/Remote

Type: Full Time

Responsibilities:

● Perform data engineering tasks, including data modelling, data pipeline development, andcube development.

● Work with relational databases, including schema design, queries, views, store procedures,and performance optimization.

● Data governance and master data management.

● Build data pipelines that execute ETL/ELT processes to move and integrate data betweendata sources.

● Conduct DevOps activities, including code reviews, testing, alerting, documenting,retrospectives, and incident analysis.

● Work with Azure's core data and analysis services, including Data Factory, SynapseAnalytics, Data Explorer, Power BI, etc.

● Build data warehouses, including the use of ETL/ELT, SQL, Data Lake, Spark, Azure Synapse,Databricks, and tabular cubes.

● Programming in Python or other languages to execute data engineering steps and automatedata pipelines and processes.

● Develop and manage data models for analytics purposes, working with data visualizationtools such as Power BI, Tableau, etc.

● Learning new and emerging technologies and looking for opportunities for adoption.

● Manage workloads and deliverables in a fast-paced environment with constant change.

● Consultative communication with clients, stakeholders, and team members.Required Experience/Qualifications:

● 2 - 5 years of relevant experience in data engineering, software engineering, or otherrelated roles.

● Experience working with big data databases and frameworks, such as Snowflake, AzureSynapse Analytics, Redshift, Databricks, BigQuery, and EMR.

● Strong understanding of various database management systems, architecture, and designprinciples including relational, non-relational, and/or distributed systems