Software Engineer Web Scraper
Published date: 2024/01/10
- Location: Mumbai, Maharashtra, India
What your average day would look like:
Apply knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it
Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store
Work closely with Database Administrators to store data in SQL and NoSQL databases
Develop frameworks for automating and maintaining constant flow of data from multiple sources Work independently with little supervision to research and test innovative solutions skill
Job Requirement
What you need to work with us:
Strong coding experience in Python (knowledge of Java, Javascripts is a plus)
Experience with SQL and NoSQL databases
Experience with multi-processing, multi-threading, and AWS/Azure.
Strong knowledge of scraping frameworks such as Python (Request, Beautiful Soup), Web Harvest and others Depth knowledge of algorithms and data structures & previous experience with web crawling is a must
Qualification and Experience Required:
1 - 5 years of relevant experience
Bachelor/ Master’s degree in computer science / Computer Engineering / Information Technology
Apply knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it
Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store
Work closely with Database Administrators to store data in SQL and NoSQL databases
Develop frameworks for automating and maintaining constant flow of data from multiple sources Work independently with little supervision to research and test innovative solutions skill
Job Requirement
What you need to work with us:
Strong coding experience in Python (knowledge of Java, Javascripts is a plus)
Experience with SQL and NoSQL databases
Experience with multi-processing, multi-threading, and AWS/Azure.
Strong knowledge of scraping frameworks such as Python (Request, Beautiful Soup), Web Harvest and others Depth knowledge of algorithms and data structures & previous experience with web crawling is a must
Qualification and Experience Required:
1 - 5 years of relevant experience
Bachelor/ Master’s degree in computer science / Computer Engineering / Information Technology
0 page views
Related listings
-
Hive Developer PuneSoftware DeveloperJob Description: • Overall 3+ years of experience in Hive Big Data, SQL. • Experience extracting data from a variety of sources, and experience in SQL. • Must have experience with Spark and Scala. • Hive with HQL and expertise in Unix Commands and Ba...2026/11/08
-
Software DeveloperSoftware DeveloperResponsibilities What will you contribute? Reporting to the Development Manager, the development, designs, develops, analyzes, and maintains high-quality software product applications. This position is located in Pune, India. Responsibilities & D...2026/11/08
-
iOS DeveloperSoftware DeveloperRole – iOS Developer Experience: Revelant 3 + Years Location : Mumbai/Pune About The Role: · We are looking for an iOS resource responsible for the development, delivery and maintenance of applications. Your primary focus will be the development of i...2026/11/08