Software Engineer Web Scraper
Published date: 2024/01/10
- Location: Mumbai, Maharashtra, India
What your average day would look like:
Apply knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it
Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store
Work closely with Database Administrators to store data in SQL and NoSQL databases
Develop frameworks for automating and maintaining constant flow of data from multiple sources Work independently with little supervision to research and test innovative solutions skill
Job Requirement
What you need to work with us:
Strong coding experience in Python (knowledge of Java, Javascripts is a plus)
Experience with SQL and NoSQL databases
Experience with multi-processing, multi-threading, and AWS/Azure.
Strong knowledge of scraping frameworks such as Python (Request, Beautiful Soup), Web Harvest and others Depth knowledge of algorithms and data structures & previous experience with web crawling is a must
Qualification and Experience Required:
1 - 5 years of relevant experience
Bachelor/ Master’s degree in computer science / Computer Engineering / Information Technology
Apply knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it
Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store
Work closely with Database Administrators to store data in SQL and NoSQL databases
Develop frameworks for automating and maintaining constant flow of data from multiple sources Work independently with little supervision to research and test innovative solutions skill
Job Requirement
What you need to work with us:
Strong coding experience in Python (knowledge of Java, Javascripts is a plus)
Experience with SQL and NoSQL databases
Experience with multi-processing, multi-threading, and AWS/Azure.
Strong knowledge of scraping frameworks such as Python (Request, Beautiful Soup), Web Harvest and others Depth knowledge of algorithms and data structures & previous experience with web crawling is a must
Qualification and Experience Required:
1 - 5 years of relevant experience
Bachelor/ Master’s degree in computer science / Computer Engineering / Information Technology
0 page views
Related listings
-
Associate Software Developer (Show Systems) MumbaiSoftware DeveloperDescription Position at DNEG Core Services is looking for an Associate Software Developer to join its Show Systems domain. The Core Services group provides foundational technologies to other technology groups within DNEG. We are a team of software de...2026/11/08
-
Software Developer✓MumbaiSoftware DeveloperResponsibilities Participate in all aspects of software development including requirements gathering, design, implementation, testing and deployment Build cutting edge applications both for web and mobile Write well designed, testable, efficient code...2026/11/08
-
Software Engineer Software Developer✓MumbaiSoftware DeveloperDescription Must be proficient in development environments debugging tools and source control systems Must have experience in cross platform development must have worked in products or technologies that have scalable and sustainable architectures Dev...2026/11/08