Software Engineer

Senior Software Engineer - Data

Job Description

We are looking for a tech savvy Data Engineer to join our growing data team. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. The hire must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

Data Engineer Job Responsibilities
• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Implement processes and systems to monitor data accuracy, ensuring 100% data availability for key stakeholders and business processes that depend on it.
• Write unit/integration tests and document work.
• Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Design data integrations and reporting framework.
• Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
• Design and evaluate open source and vendor tools for data lineage.
• Work closely with all business units and engineering teams to develop strategy for long term data platform architecture.

Data Engineer Qualifications / Skills
• 3+ years of Java development experience
• Experience with or knowledge of Agile Software Development methodologies
• Excellent problem solving and troubleshooting skills
• Process oriented with great documentation skills
• Experience with big data technologies like Kafka, BigQuery, etc
• Experience with AWS cloud services: EC2, RDS, etc
• Experience with message queuing, stream-processing systems

Education, Experience And Licensing Requirements
• Degree in Computer Science, IT, or similar field; a Master’s is a plus
• 3+ years of hands on development experience
• 3+ years of SQL experience (No-SQL experience is a plus)
• 3+ years of experience with schema design and dimensional data modeling
• Experience designing, building and maintaining data processing systems

Skills:- Java, MySQL, Big Data, Amazon Web Services (AWS), Apache Kafka and BigQuery