Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in pallavaram
>
Blackstraw Technologies
>
Senior/ Lead Data Engineer- Azure Blackstraw- Immediate Joiner

Senior/ Lead Data Engineer- Azure Blackstraw- Immediate Joiner

Blackstraw Technologies

10 - 15 years

15 - 30 Lacs

pallavaram

Posted:2 days ago| Platform:

Apply

Skills Required

pyspark azure databricks spark python azure data factory data bricks

Work Mode

Work from Office

Job Type

Full Time

Job Description

Data

Company

Job

Experience:

Candidates who can join immediately will be preferred.

Job

Key

Job Requirements:

Participate in the customers system design meetings and collect the functional/technical requirements.
Build up data pipelines for consumption by the data science team.
Skillful in ETL process and tools.
Clear understanding and experience with
Azure Data Factory, Python

and PySpark or Spark, with HIVE, Airflow, Impala, and Hadoop
and
RDBMS
architecture.
Experience in writing
Python
programs and
SQL
queries.
Experience in SQL
Query tuning
.
Experienced in Shell Scripting(Unix/Linux).
Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.
Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.
Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka
Suggest and implement best practices in data integration.
Guide the QA team in defining system integration tests as needed.
Split the planned deliverables into tasks and assign them to the team.
Needs to Maintain/Deploy the ETL code and follow the Agile methodology
Needs to work on optimization wherever applicable.
Good oral, written and presentation skills.

Preferred Qualifications:

Degree in Computer Science, IT, or similar field; a Masters is a plus.
Hands-on experience with
Python and Pyspark, Azure Data Factory
Hands-on experience with
Spark
Great numerical and analytical skills.
Working knowledge of cloud platforms such as MS Azure, AWS, etc...
Technical expertise with data models, data mining, and segmentation techniques.

Tech

Preferred

More Jobs at Blackstraw Technologies

Walkin Interview- Software Engineer - Chennai -Work from Office

Chennai

3 - 8 yrs

INR 6 - 16 Lacs

Walkin Interview- Java Developer - Chennai -Work from Office

Chennai

3.0 - 5.0 yrs

INR 6 - 16 Lacs

Sr Data Engineer- Blackstraw.ai - Chennai- Work From Office

Chennai

7.0 - 12.0 yrs

INR 20 - 30 Lacs

Senior Data Engineer- Blackstraw- Work from office- Chennai

Pallavaram

10.0 - 15.0 yrs

INR 15 - 30 Lacs

Sr Java Fullstack - Work From Office- Chennai - Immediate Joiner

Madurai, Chennai, Coimbatore

5.0 - 10.0 yrs

INR 12 - 22 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.