Big Data Developer - Anblicks

Ahmedabad local candidates preferred

Job Designation / Role: Bigdata Engineer (Spark, Scala / Python)

Location: Ahmedabad

Exp - 4 Years+

Responsibilities :

- Analyze user requirements and design appropriate big data solutions that best fit those requirements

- Work in a cross functional Agile Scrum team to design, develop, test and maintain solutions

- Ensure that solutions are in line with department and domain architecture strategies and contribute to defining and improving those strategies

- Help build, maintain and continually implement tests for an automated testing framework that drives integration tests front to back across components

- Work collaboratively - sharing knowledge and helping teammates in your areas of expertise

- Building and optimizing Apache Spark

- Decompose high level business needs into functional needs by understanding problem and determining data needs

- Experience handling complex, high volume, multi-dimensional data and architecting data products in streaming, serverless and microservices based Architecture and platform.

- Design and create processes for contextualizing, cleaning, aggregating, and transforming data, making it better and more useful to the business

- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics

-Performance tuning in Spark Yarn cluster and Hadoop resources

Skills :

- SQL- 8/10 : needs to be strong on this

- Spark, Scala / Python - 8/10 : needs to be strong on this

- In-depth knowledge of Apache Spark and different Spark Frameworks/Cloud Services (e.g., Databricks, EMR, Azure HDI)

- Strong in stakeholder management & communication

- Strong Learning attitude

- Cloud desirable

Notice Period: 30 days