Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Data Engineer

Black And White Business Solutions

5 - 8 years

15 - 20 Lacs

pune

Posted:-1 days ago| Platform:

Apply

Skills Required

airflow pandas azure devops python sql polars

Work Mode

Work from Office

Job Type

Full Time

Job Description

About Client

Qualification :ANY GRADUATE

Relevant Experience :

Required Skills & Experience

Proficient in Python, with deep experience using pandas or polars
Strong understanding of ETL development, data extraction, and transformation
Hands-on experience with SQL and querying large datasets
Experience deploying workflows on Apache Airflow
Familiar with web scraping techniques (Selenium is a plus)
Comfortable working with various data formats and large-scale datasets
Experience with Azure DevOps, including pipeline configuration and automation
Familiarity with Pytest or equivalent test frameworks
Strong communication skills and a team-first attitude.
Experience with Databricks
Familiarity with AWS services
Working knowledge of Jenkins and advanced ADO Pipelines

Key Responsibilities

Design, build, and maintain pipelines in Python to collect data from a wide range of sources (APIs, SFTP servers, websites, emails, PDFs, etc.)
Deploy and orchestrate workflows using Apache Airflow
Perform web scraping using libraries like requests, BeautifulSoup, Selenium
Handle structured, semi-structured, and unstructured data efficiently
Transform datasets using pandas and/or polars
Write unit and component tests using pytest
Collaborate with platform teams to improve the data scraping framework
Query and analyze data using SQL (PostgreSQL, MSSQL, Databricks)
Conduct code reviews, support best practices, and improve coding standards across the team
Manage and maintain CI/CD pipelines (Azure DevOps Pipelines, Jenkins)

Tech stack: Main/essential:

Python - Pandas and/or Polars - Essential
SQL
Azure DevOps
Airflow

Location :Pune

CTC Range :

Notice period :IMMEDIATE/CURRENTLY SERVING

Shift Timing :

Mode of Interview :

Mode of Work :

More Jobs at Black And White Business Solutions

Financial Benefit Associate

Pune, Mumbai, Bengaluru

Experience: Not specified

INR 2 - 4 Lacs

Kinaxis Supply Chain Planning

Bengaluru

10 - 16 yrs

INR 30 - 45 Lacs

Senior Associate - Property and Casualty Insurance

Bengaluru

3 - 8 yrs

INR 5 - 10 Lacs

Guidewire Claim Center Configuration Developer

Bengaluru, Hyderabad, Kolkata

10 - 13 yrs

INR 20 - 30 Lacs

Guidewire Billing Center Configuration Developer

Chennai, Bengaluru, Kolkata

5 - 7 yrs

INR 15 - 20 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Azure DevOps Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.