Data Engineer

Published date: 2024/01/10
  • Location: India
We are actively seeking Data Engineers - experienced in building data pipelines and integrations from 3rd party data sources by writing custom automated ETL jobs using Python. The role will work in partnership with other members of the Business Analytics team to support the development and implementation of new and existing data warehouse solutions for our clients. This includes designing database import/export processes used to generate client data warehouse deliverables.

Requirements
• 2 Years experience as an ETL developer with strong data architecture knowledge around data warehousing concepts, SQL development and optimization, and operational support models.
• Experience using Python to automate ETL/Data Processes jobs.
• Design and develop ETL and data processing solutions using data integration tools, python scripts, and AWS / Azure / On-Premise Environment.
• Experience / Willingness to learn AWS Glue / AWS Data Pipeline / Azure Data Factory for Data Integration.
• Develop and create transformation queries, views, and stored procedures for ETL processes, and process automation.
• Document data mappings, data dictionaries, processes, programs, and solutions as per established standards for data governance.
• Work with the data analytics team to assess and troubleshoot potential data quality issues at key intake points such as validating control totals at intake and then upon transformation, and transparently build lessons learned into future data quality assessments
• Solid experience with data modeling, business logic, and RESTful APIs.
• Solid experience in the Linux environment.
• Experience with NoSQL / PostgreSQL preferred
• Experience working with databases such as MySQL, NoSQL, and Postgres, and enterprise-level connectivity experience (such as connecting over TLS and through proxies).
• Experience with NGINX and SSL.
• Performance tune data processes and SQL queries, and recommend and implement data process optimization and query tuning techniques.

Skills:- ETL, Python, Amazon Web Services (AWS), Azure, Snowflake GCP, SQL

Apply

1 page views

Related listings

  • Brand Marketing Intern GSTFORBUSINESS.IN
    Work from home
    Jaipur (Rajasthan) Work from home
    The ideal candidate will possess strong Accounting skills and knowledge of Tally Prime Qualifications • Strong Communication and Written Skills • Knowledge of MS Office • Proficiency in MS Excel and Google Sheets • Must have laptop and internet conne...
    2024/01/10
  • Data Entry Operator/ Work From Home
    Work from home
    Work from home
    Are You Looking Best Legitimate Genuine Online/Offline Part Time/Full Time Work From Home Jobs In India If Yes You Are Welcome We Are Leading In This Field Since 2018. Starting 2 Types Of Home Based Data Entry Work. HOME BASED Data Entry JOBS/Works: ...
    2024/01/10
  • Online Tutor Jobs kvs-teacher-vacancy-2021
    Work from home
    Work from home
    Apply on Mysmartpros Online Tutor Jobs kvs-teacher-vacancy-2021 MySmartPros.com Anywhere Apply on Mysmartpros 7 hours ago Work from home Part-time Online Tutor Jobs kvs-teacher-vacancy-2021 Find home tutor jobs, online tutor jobs , online teaching jo...
    2024/01/10