Software Engineer
Published date: 2024/01/10
- Location: Bengaluru, Karnataka, India
JD / Skill set:
Responsible for designing, modeling and architecting data engineering solutions,
Building Enterprise Data Lake with a variety of data sources including internal and external datasets.
Big Data Lake Architect Experience for strategies around Data Ingestion, Automated Data Pipelines & Building different layers of Big Data Lake
Experience in Real-time Data Streaming and building pipelines and ETLs that transform structured and unstructured data sets in large-scale, complex datasets (Hadoop, Hive) into meaningful data models.
Proven experience with AWS technologies like S3, EMR, Cloudformation etc.
Experience with CI/CD related technologies
Experience working with real time data processing using Kafka, Spark Streaming or similar technology
Experience working with Hive, Presto or other querying frameworks.
Agile methodologies and an experience in Handling People & Processes to Deliver Business Value.
Technology:
AWS – Data Engineering tools (S3, Database Kinesis, Glue, Athena, Lambda, EMR, Lake Formation, Redshift)
Kafka, Spark, Hadoop, Hive
Python
Experience: 4 to 6 Years
• Location: Bangalore
Responsible for designing, modeling and architecting data engineering solutions,
Building Enterprise Data Lake with a variety of data sources including internal and external datasets.
Big Data Lake Architect Experience for strategies around Data Ingestion, Automated Data Pipelines & Building different layers of Big Data Lake
Experience in Real-time Data Streaming and building pipelines and ETLs that transform structured and unstructured data sets in large-scale, complex datasets (Hadoop, Hive) into meaningful data models.
Proven experience with AWS technologies like S3, EMR, Cloudformation etc.
Experience with CI/CD related technologies
Experience working with real time data processing using Kafka, Spark Streaming or similar technology
Experience working with Hive, Presto or other querying frameworks.
Agile methodologies and an experience in Handling People & Processes to Deliver Business Value.
Technology:
AWS – Data Engineering tools (S3, Database Kinesis, Glue, Athena, Lambda, EMR, Lake Formation, Redshift)
Kafka, Spark, Hadoop, Hive
Python
Experience: 4 to 6 Years
• Location: Bangalore
0 page views
Related listings
-
Embedded Software EngineerSoftware DeveloperJob Description Embedded Software Developer for Android Middleware Development & Validation Skill Requirements • B.E in ECE/EEE/CSC with 2 – 4 years of experience in Embedded Software Development • Proficiency in C/C++ language • Expertise in And...2026/11/09
-
Senior Java Software EngineerSoftware DeveloperLooking for a Senior Java Developer to join a team of rockstar developers. The candidate should have a minimum of 5+ yrs. of experience.There are multiple openings. Company Background - We are a multinational software company that is growing at a fas...2026/11/09
-
Software Developer - CT AlgorithmsSoftware DeveloperResponsibilities: • As a developer in the team located in Bangalore, you will develop and integrate algorithm components for CT applications by taking care of all aspects of software engineering, from design and implementation, through testing and do...2026/11/09