Lead Azure Big Data Engineer VidPro Consultancy Services

3.0 - 7.0 years

0 Lacs

hyderabad, telangana

On-site

Role Overview: As a Senior Data Engineer, you will be responsible for designing, building, and optimizing scalable data pipelines for large-scale data processing. Your expertise in Python, Spark, Databricks, and Azure will be crucial in handling complex data engineering tasks. You will work with cloud platforms, specifically Azure, to process and analyze large datasets efficiently. Key Responsibilities: - Design, build, and optimize scalable data pipelines using Python and Apache Spark. - Utilize Azure Databricks and PySpark for big data processing and analysis. - Implement data integration and orchestration using Azure Data Factory. - Utilize Azure Data Lake Storage for big data analytics a...

Posted 2 days ago

AI Match Score

Apply

Lead Azure Big Data Engineer VidPro Consultancy Services

3.0 - 7.0 years

0 Lacs

hyderabad, telangana

On-site

As a Senior Azure Data Engineer, you will be responsible for designing, building, and optimizing scalable data pipelines for large-scale data processing using Python and Apache Spark. Your role will involve leveraging Azure Databricks for big data processing, working with PySpark to analyze large datasets, and utilizing Azure Data Factory for seamless data integration across cloud environments. Additionally, you will implement and maintain solutions using Azure Data Lake Storage for big data analytics and transformation. Your key responsibilities will include writing efficient and reusable Python code, working with core Azure data services like Azure SQL Database and Azure Synapse Analytics,...

Posted 2 months ago

AI Match Score

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.