Senior Data Engineer/Python Developer

Luxoft

7 - 12 years

13 - 17 Lacs

bengaluru

Posted:2 days ago| Platform:

Apply

Skills Required

python developer snowflake python github data analytics streaming data data engineer airflow databricks microsoft azure redis sql spark apache spark kafka linux software engineering etl apache airflow azure

Work Mode

Work from Office

Job Type

Full Time

Job Description

Project description

Luxoft has been asked to contract a Developer in support of a number of customer initiatives. The primary objective is to develop based on client requirements in the Telecom/network work environment

Responsibilities

A Data Engineer with experience in the following techologies:
Databricks and Azure
Apache Spark-based, hands on Python, SQL, Apache Airflow.
Databricks clusters for ETL processes.
Integration with ADLS, Blob Storage.
Efficiently ingest data from various sources, including on-premises databases, cloud storage, APIs, and streaming data.
Use Azure Key Vault for managing secrets.
Hands on experience working with API's
Kafka/Azure EventHub streaming hands on experience
Hands on experience with data bricks delta API's and UC catalog Hands on experience working with version control tools Github
Data Analytics
Supports various ML frameworks.
Integration with Databricks for model training.
OnPrem
Exposure on Linux based systems
Unix scripting

Skills

Must have

Python, Apache Airflow, Microsoft Azure and Databricks, SQL, databricks clusters for ETL, ADLS, Blob storage, ingestion from various sources including databases and cloud storage, APIs and streaming data, Kafka/Azure EventHub, databricks delta APIs and UC catalog.
Education: Typically, a Bachelor's degree in Computer Science (preferably M.Sc. in Computer Science), Software Engineering, or a related field is required.
Experience: 7+ years of experience in development or related fields.
Problem-Solving Skills: Ability to troubleshoot and resolve issues related to application development and deployment.
Communication Skills: Ability to effectively communicate technical concepts to team members and stakeholders. This includes written and verbal communication.
Teamwork: Ability to work effectively in teams with diverse individuals and skill sets.
Continuous Learning: Given the rapidly evolving nature of web technologies, a commitment to learning and adapting to new technologies and methodologies is crucial.

Nice to have

Snowflake, PostGre, Redis exposure
GenAI exposure
Good understanding of RBAC

More Jobs at Luxoft

Murex XVA Functional BA

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Fullstack Developer (React, JavaScript, TypeScript)

Pune, Maharashtra, India

3 - 3 yrs

Salary: Not disclosed

Data Engineer

Pune, Maharashtra, India

5 - 8 yrs

Salary: Not disclosed

Power Bi Developer

Gurugram

7 - 10 yrs

INR 15 - 20 Lacs

Credit Risk Consultant

Gurugram

4 - 8 yrs

INR 7 - 11 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.