Lead Data/ Web scrapping Engineer Maventech Inida

7.0 - 11.0 years

12 - 19 Lacs

Bengaluru

Work from Office

Responsibilities:As a Data Engineer focused on web crawling and platform data acquisition, you will design, develop, and maintain large-scale web scraping pipelines to extract valuable platform data. Annual bonus Health insurance Provident fund

Posted 6 months ago

AI Match Score

Apply

Python Developer Manupatra Information Solutions

3 - 6 years

6 - 10 Lacs

Noida

Work from Office

Python Developer Location: Sector-1, Noida (Work from Office) Experience: Minimum 3 years Education: B.E./B.Tech Primary Role: Responsible for performing web scraping and crawling to extract and structure data from various websites. Handle data cleaning, transformation, and storage in structured formats. Write efficient and scalable Python scripts to manage high-volume data extraction tasks. Monitor and manage log files using automation scripts. Key Skills: Proficiency in Python with hands-on experience in web scraping and crawling . Strong working knowledge of BeautifulSoup , Selenium , NumPy , Pandas , and Pytest . Good understanding of JavaScript , HTML , and SQL (preferably MS SQL ). Exp...

Posted 7 months ago

AI Match Score

Apply

Data Engineer Aaxis Infotel

5 - 8 years

15 - 25 Lacs

Pune

Hybrid

Role & responsibilities Data Pipeline Development: Design, develop, and maintain data pipelines utilizing Google Cloud Platform (GCP) services like Dataflow, Dataproc, and Pub/Sub. Data Ingestion & Transformation: Build and implement data ingestion and transformation processes using tools such as Apache Beam and Apache Spark. Data Storage Management: Optimize and manage data storage solutions on GCP, including BigQuery, Cloud Storage, and Cloud SQL. Security Implementation: Implement data security protocols and access controls with GCP's Identity and Access Management (IAM) and Cloud Security Command Center. System Monitoring & Troubleshooting: Monitor and troubleshoot data pipelines and sto...

Posted 7 months ago

AI Match Score

Apply

Jr. Web Scraping Engineer AdvaRisk

2 - 4 years

5 - 12 Lacs

Nagpur, Pune, Mumbai (All Areas)

Work from Office

Role & responsibilities Job Overview: We are looking for a highly motivated Junior Data Engineer with a passion for web scraping and web crawling to join our team. The ideal candidate will have strong Python programming skills and experience with web scraping frameworks and libraries like Requests, BeautifulSoup, Selenium, Playwright or URLlib. You will be responsible for building efficient and scalable web scrapers, extracting valuable data, and ensuring data integrity. This role requires a keen eye for problem-solving, the ability to work with complex data structures, and a strong understanding of web technologies like HTML, CSS, DOM, XPATH, and Regular Expressions. Knowledge of JavaScript...

Posted 7 months ago

AI Match Score

Apply

Software Development Engineer Bungee Tech India

4.0 - 7.0 years

20 - 35 Lacs

chennai

Remote

Role & responsibilities: Architect, deploy, and manage scalable cloud environments (AWS/GCP/DO) to support distributed data processing solutions to handle terabyte-scale datasets and billions of records efficiently Automate infrastructure provisioning, monitoring, and disaster recovery using tools like Terraform, Kubernetes, and Prometheus. Optimize CI/CD pipelines to ensure seamless deployment of web scraping workflows and infrastructure updates. Develop and maintain stealthy web scrapers using Puppeteer, Playwright, and headless chromium browsers. Reverse-engineer bot-detection mechanisms (e.g., TLS fingerprinting, CAPTCHA solving) and implement evasion strategies. Monitor system health, t...

Posted Date not available

AI Match Score

Apply

Tech Lead - Full Stack(MERN) Rubick.AI

3.0 - 6.0 years

5 - 8 Lacs

bengaluru

Work from Office

Job Overview: We are looking for an experienced and visionary Tech Lead to lead our engineering team. The ideal candidate will oversee all technical aspects of our companys products and projects, driving innovation, maintaining high engineering standards, and ensuring the successful delivery of solutions that meet business objectives. Responsibilities: Collaborate with the Engineering team to develop and refine processes for task prioritization, breakdown, estimation, and delegation. Mentor Engineers in dissecting challenges into actionable tasks and overseeing their execution. Develop and execute engineering plans, strategies, and roadmaps aligned with the companys goals and objectives. Dri...

Posted Date not available

AI Match Score

Apply

Page 5 of 5

Previous 2 3 4 5

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.