Python, Pyspark
Published date: 2024/01/10
- Location: Bengaluru, Karnataka, India
Python, Pyspark
5
Technology Lead (Data Engineer)
BE
8+ years of industry experience as Lead Developer
Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred.
Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling bigdata
Familiarity with any data ingestion tools, Familiarity with working with different file formats. Delta-Lake is highly preferred.
Advanced Proficiency in Python and SQL.
Familiarity with Unix.
Familiarity with one of orchestration tools such as Airflow, DBT and Delta live tables.
Familiarity in cloud native tools - AWS is preferred
Familiarity with CI/CD process from developer point of view.
Familiarity with Change Data Capture systems is nice to have.
Familiarity with Docker is nice to have
5
Technology Lead (Data Engineer)
BE
8+ years of industry experience as Lead Developer
Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred.
Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling bigdata
Familiarity with any data ingestion tools, Familiarity with working with different file formats. Delta-Lake is highly preferred.
Advanced Proficiency in Python and SQL.
Familiarity with Unix.
Familiarity with one of orchestration tools such as Airflow, DBT and Delta live tables.
Familiarity in cloud native tools - AWS is preferred
Familiarity with CI/CD process from developer point of view.
Familiarity with Change Data Capture systems is nice to have.
Familiarity with Docker is nice to have
0 page views
Related listings
-
Application Firmware DeveloperSoftware DeveloperJob Location : Bangalore/Kochi Experience level: 4 to 8years Job description: Must have skills: • Extensive in C programming. • Developed Application framework based on using BT/BLE (Audio/media/telephony profiles) • RTOS based application developmen...2026/11/08
-
Systems ProgrammerSoftware DeveloperIntroduction Software Developers at IBM are the backbone of our strategic initiatives to design, code, test, and provide industry-leading solutions that make the world run today - planes and trains take off on time, bank transactions complete in the ...2026/11/08
-
Software Developer-JavaSoftware DeveloperGreetings ! Excellent Openings for Java Developer with Product based Company. Position - Software Developer/Sr.Software Developer-Java Experience - 3 to 7 Years Location - Bangalore(WFO) Notice Period - Immediate up to 30 Days Educational Qualifiatio...2026/11/08