Data Engineer (Manager) - Web Scraping - GO/JC/21526/2025

Golden Opportunities

5 - 10 years

0 Lacs

Gurgaon Haryana India

Posted:2 weeks ago| Platform:

Apply

Skills Required

data extract support strategies extraction design etl integrity security efficiency processing compliance development scrapy selenium programming python java storage sql nosql integration hadoop spark leadership management engineering governance regulations taxation database visualization

Work Mode

On-site

Job Type

Full Time

Job Description

Job Description Data Engineer (Manager) - Web Scraping (Experience: 5 to 10 years) The Data Engineer specializing in web scraping will be responsible for designing, implementing, and maintaining automated systems to extract, process, and analyse data from various online sources. This role is critical for gathering valuable insights to support business decisions and strategies. Responsibilities ?Lead and manage a team of data engineers specializing in web scraping and data extraction. ?Design, develop, and maintain scalable web scraping pipelines and ETL processes. ?Collaborate with cross-functional teams to understand data requirements and deliver effective solutions. ?Ensure data quality, integrity, and security across all scraping systems. ?Optimize web scraping workflows for performance and efficiency. ?Evaluate and integrate new tools and technologies for web scraping and data processing. ?Develop and enforce best practices for web scraping, including compliance with legal and ethical standards. ?Provide mentorship and professional development opportunities for team members. Skills Required ?Proficiency in web scraping tools and frameworks (e.g., Scrapy, Beautiful Soup, Selenium). ?Strong programming skills in Python, Java, or similar languages. ?Experience with data storage solutions (SQL, NoSQL, cloud databases). ?Knowledge of APIs and data integration techniques. ?Familiarity with big data technologies (e.g., Hadoop, Spark). ?Leadership and team management skills. ?Excellent problem-solving and analytical abilities. Preferred Qualifications ?Bachelor?s or Master?s degree in Computer Science, Data Engineering, or related fields. ?Experience in handling large-scale data extraction projects. ?Knowledge of data governance and compliance regulations. Skills Required RoleData Engineer (Manager) - Web Scraping Industry TypeITES/BPO/KPO Functional AreaFinance/Accounts/Taxation Required EducationAny Graduates Employment TypeFull Time, Permanent Key Skills WEB SCRAPING TOOLS DATA PROCESSING DATABASE MANAGEMENT CLOUD PLATFORMS DATA VISUALIZATION Other Information Job CodeGO/JC/21526/2025 Recruiter NameSPriya Show more Show less