5.0 - 9.0 years

0 Lacs

hyderabad, telangana

On-site

As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You will also support the implementation and integration of these new data sources into our Azure Data platform. You are detailed in reviewing and analyzing structured, semi-structured, and unstructured data sources for quality, completeness, and business value. Your role involves designing, architecting, implementing, and testing rapid prototypes that demonstrate the value of the data and presenting them to diverse audiences. Additionally, you will participate in early-stage design and feature definition activities. Your responsibilities include implementing a robust data pipeline using the Microsoft Databricks Stack and creating reusable and scalable data pipelines. Collaboration is key as you will work as a team player, collaborating with members across multiple engineering teams to support the integration of proven prototypes into core intelligence products. Strong communication skills are required to effectively convey complex data insights to non-technical stakeholders. In terms of skills, you should have advanced working knowledge and experience with relational and non-relational databases, API data providers, and building and optimizing Big Data pipelines, architectures, and datasets. Strong analytic skills related to working with structured and unstructured datasets are necessary. Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines is essential. Proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages is required. Experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse is preferred. Familiarity with technologies such as Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services is a plus. Knowledge of Azure DevOps to deploy data pipelines through CI/CD is beneficial. For qualifications and experience, a minimum of 5-7 years of practical experience as a Data Engineer is required. A Bachelor's degree in computer science, software engineering, information technology, or a related field is preferred. Experience with the Azure cloud stack in-production is necessary for this role.,

Posted 1 week ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.