Data Engineer

Data Engineer/Python programmer

Job Description:

This ‘Data Engineer & Python program’ role requires a significant set of technical skills, including a deep knowledge of SQL database design and multiple programming languages. Data engineers also need communication skills to work across departments to understand what business leaders want to gain from the company’s large datasets.

· Managing the flow of data

· Database-centric data engineers work with data warehouses across multiple databases and are responsible for developing table schemas.

· Build and maintain data pipelines and maintain databases

· Collaboration with management to perceive organizational goals

· Develop, construct, test and maintain architectures

· Align architecture with business requirements

· Data acquisition & Develop data set processes

· Use programming language (Python, Shell script, Power shell) and tools

· Identify ways to improve data reliability, efficiency and quality

· Use & manage large data sets to address business issues

· Deploy sophisticated analytics programs, machine learning and statistical methods

· Prepare data (for predictive and prescriptive) modeling

· Find hidden patterns using data to meet business requirements

· Use data to discover tasks for automation

· Deliver updates to stakeholders based on analytics

· Build design and implement the end-to-end flow for data consolidation, Preparation and analytics

Tools & Technologies:

· Data modeling for DWH

· Data Warehouse Management & Administration for data consolidation

· Unix Shell script, Python, Script and use of tool to identify and implement with automation tools

· Data review for analysis using analytical tools – Tableau, Power BI, Google Studio, Excel Analytics – Any one of these experience will be good to have.

Automation Development:

Python

· Write data transformation scripts

· Python code for data visualization with Python IDE tool

· Write APIs (for app functions) for API based data transformation and operations automation

Unix Shell Script

· Write data

Data Development (PLSQL Development, Data Modeling)

· Develop data model

· Table and schema structure

· PLSQL blocks development for secured view of data sets

· Write triggers for trigger-based events, auditing