2920 Data Bricks Jobs - Page 44

Roles and Responsibilities Develop high-quality code in Python using PySpark, SQL, Flink/Spark Streaming and other relevant technologies. Design, develop, test, deploy, and maintain large-scale data processing pipelines using Azure Databricks . Troubleshoot issues related to On-prem(Hadoop) / Databricks clusters, and big data processing tasks Develop complex SQL queries to extract insights from large datasets stored in relational databases such as PostgreSQL. Desired Candidate Profile 6-8 years of experience in software development with expertise in BI & Analytics domain. Bachelor's degree in Any Specialization (B.Tech/B.E.). Strong understanding of cloud computing concepts on Microsoft Azur...

Strong experience with IBM DataStage for ETL development and data transformation. Proficiency in Azure Data Factory (ADF), Snowflake, Pyspark Interested candidate please fill the google form https://forms.gle/A5ieWPGMFWrCZSGy5

8+ years of experience in ETL/DW projects, having migration experience and team management having delivery experience with team of 10+ resources. Proven expertise in Snowflake data warehousing, ETL, and data governance.

Job Summary: We are looking for a talented Data Engineer cum Database Developer with a strong background in the banking sector. The ideal candidate will have experience with SQL Server, AWS PostgreSQL, AWS Glue, and ETL tools, along with expertise in data ingestion frameworks and Control-M scheduling Key Responsibilities: Design, develop, and maintain scalable data pipelines to support data ingestion and transformation processes. Collaborate with cross-functional teams to gather requirements and implement solutions tailored to banking applications. Utilize SQL Server and AWS PostgreSQL for database development, optimization, and management. Implement data ingestion frameworks to ensure effic...

Educational Requirements MCA,MSc,Bachelor of Engineering,BBA,BCom Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and facilitate deployment resulting in client delight. You will develop a proposal by owning parts of the proposal document and by giving inputs in solution design based on areas of expertise. You will plan the activities of configuration, configure the product as per the design, conduct conference room pilots and will assist in resolving any queries related to requirements and solution...

Educational Requirements MCA,Bachelor of Engineering,BCA Service Line Data & Analytics Unit Responsibilities Understand the requirements from the business and translate it into an appropriate technical requirements. Creating a detailed business analysis, outlining problems, opportunities and solutions for a business. Perform activities related to data wrangling, model building and model deployment. Stay current with the latest research and technology and communicate your knowledge throughout the enterprise. Lead initiatives to improve the team morale, camaraderie, and collaboration Technical and Professional Requirements: Generative AI, AI/ML, Python, Databricks Preferred Skills: Technology-...

Educational Requirements MCA,MSc,Bachelor of Engineering,BSc,Bachelor of Business Administration and Bachelor of Legislative Law (BBA LLB) Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code revi...

Educational Requirements MCA,MSc,Bachelor of Engineering,BBA,BSc Service Line Data & Analytics Unit Responsibilities Consulting Skills: oHypothesis-driven problem solvingoGo-to-market pricing and revenue growth executionoAdvisory, Presentation, Data StorytellingoProject Leadership and Execution Additional Responsibilities: Typical Work Environment Collaborative work with cross-functional teams across sales, marketing, and product development Stakeholder Management, Team Handling Fast-paced environment with a focus on delivering timely insights to support business decisions Excellent problem-solving skills and ability to address complex technical challenges. Effective communication skills to ...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 7+ Yrs total experience in Data Engineering projects & 4+ years of relevant experience on Azure technology services and Python Azure Azure data factory, ADLS- Azure data lake store, Azure data bricks, Mandatory Programming languages Py-Spark, PL/SQL, Spark SQL Database SQL DB Experience with AzureADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with object-oriented/object function scripting languagesPython...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Required education Bachelor's Degree Preferred e...

Full-time Are you ready for new challenges in an international and innovation-driven environment where you can make a difference? Apply and join our team, be curious, learn, grow, and develop your career together with us. We promise: you are in for a special ride! The location of the role is in Gurugram About the job As a Data Engineer at RHI Magnesita, you will be part of a global team of data engineers and data experts who report to the Head of Data & Analytics Delivery. Your focus lies in designing and implementing comprehensive analytics solutions, spanning from data extraction and ingestion to transformation and consumption. You will work closely with cross-functional teams to leverage ...

Job Description: As an ETL Developer, you will be responsible for designing, building, and maintaining ETL pipelines using MSBI stack, Azure Data Factory (ADF) and Fabric. You will work closely with data engineers, analysts, and other stakeholders to ensure data is accessible, reliable, and processed efficiently. Key Responsibilities: Design, develop, and deploy ETL pipelines using ADF and Fabric. Collaborate with data engineers and analysts to understand data requirements and translate them into efficient ETL processes. Optimize data pipelines for performance, scalability, and robustness. Integrate data from various sources, including S3, relational databases, and APIs. Implement data valid...

Job Title: ETL Lead Location: Hyderabad Work From Office Experience: 8+ years Job Summary: We are looking for an experienced ETL Lead to manage and deliver enterprise-grade data integration solutions using Azure Data Factory (ADF), SSIS, SQL Querying, Azure SQL, Azure Data Lake, and preferably Azure Databricks. The role includes leading a team, building scalable ETL pipelines, and ensuring data quality and performance through efficient CI/CD practices. Key Responsibilities: Lead a team of engineers and manage ETL project lifecycles. Design, develop, and optimize ETL workflows using ADF and SSIS. Write complex SQL queries and perform performance tuning. Integrate data from varied sources into...

Job Description- • Experience on implementing Snowflake utilities, SnowSQL, SnowPipe, Big Data model techniques using Python • Expertise in deploying Snowflake features such as data sharing, events and lake-house patterns • Proficiency in RDBMS, complex SQL, PL/SQL, performance tuning and troubleshoot • Provide resolution to an extensive range of complicated data pipeline related problems • Experience in Data Migration from RDBMS to Snowflake cloud data warehouse • Experience with data security and data access controls and design • Build processes supporting data transformation, data structures, metadata, dependency & workload management • Experience in Snowflake modelling - roles, schema, d...

We are looking for a Data Engineer to join a new data engineering team in Bangalore supporting our existing software application. This is an amazing opportunity to help positively reshape, grow, and support our application functionally into new frameworks within our fully cloud native environment, leveraging the latest in serverless technologies. We have a great skill set in microservice development and we would love to speak with you if you have a Java ETL background and are looking to expand your skill set. About You experience, education, skills, and accomplishments Bachelors Degree in Computer Science or equivalent experience Minimum 2 years of experience developing software in Java Fami...

We are looking for a Senior Software Engineer to join our IMS Team in Bangalore. This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 4 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Spark, Python/Java, Scala, AWS EMR, S3, SQS, Hive, XSLT Education (bachelors degree in computer scie...

Design and implement data migration pipelines using Azure Data Factory, Azure SQL Database, Azure Synapse Analytics, and other Azure data services. Develop comprehensive data migration plans, ensuring the integrity, security, and compliance of data with regulatory requirements throughout the migration process 8+ years of experience in data engineering, data integration, or database administration, focusing on Microsoft data platforms (MSBI, SQL Server). Proficiency in Azure services, including Azure Data Factory, Azure SQL Database, Azure Synapse Analytics, and Azure Blob Storage.. Microsoft Azure data engineer Certified.

We are seeking a skilled and motivated Application Operations Engineer for an SRE role with Java, React JS and Spring boot skillset along with expertise in Data Bricks, particularly with Oracle integration, to join our dynamic SRE team. The ideal candidate should have 3 to 6 years of experience in supporting robust web applications using Java, React JS and Spring boot with a strong background in managing and optimizing data workflows leveraging Oracle databases. The incumbent will be responsible for supporting applications, troubleshooting issues, providing RCAs and suggestive fixes by managing continuous integration and deployment pipelines, automating processes, and ensuring systems reliab...

Overview The Sustainability & Climate Engineering team is responsible for building and maintaining MSCI’s issuer-facing platform. This platform is strategically critical, serving as the interface between MSCI’s core data products and external issuers—supporting key datasets, with further expansions planned. The team ensures high availability, compliance with regulatory obligations and a seamless user experience through robust backend services and scalable architecture. Responsibilities Design, develop, and maintain scalable backend services using Java (Reactive programming) as part of the Data Provisioning application. Build and enhance event-driven flows using Azure Service Bus , and manage...

Working with data on a day-to-day basis excites you, and you are interested in building robust data architecture to identify data patterns and optimize data consumption for customers who will forecast and predict actions based on data. If this excites you, then working in our intelligent automation team at Schneider AI Hub is the perfect fit for you. As a Lead Data Engineer at Schneider AI Hub, you will play a crucial role in the AI transformation of Schneider Electric by developing AI-powered solutions. Your responsibilities will include expanding and optimizing data and data pipeline architecture, ensuring optimal data flow and collection for cross-functional teams, and supporting software...

Dear Candidate, This is with reference for Opportunity Senior Tech Lead Databricks professionals PFB the Job Description Responsibilities: Lead the design and implementation of Databricks-based data solutions. Architect and optimize data pipelines for batch and streaming data. Provide technical leadership and mentorship to a team of data engineers. Collaborate with stakeholders to define project requirements and deliverables. Ensure best practices in data security, governance, and compliance. Troubleshoot and resolve complex technical issues in Databricks environments. Stay updated on the latest Databricks features and industry trends. Key Technical Skills & Responsibilities Experience in da...

Experience: 7+yrs Location: Bangalore, hybrid We are seeking a Senior Data Engineer who has solid experience in Snowflake, Microsoft Azure Data Factory, Data Brick and Kafka.

Position : Azure Architect Work Location : Banga Experience : 10 to 12+ years with extensive hands-on experience in Azure Databricks, Apache Spark (PySpark), Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics. Primary Skills : Databricks, Azure, SQL, Python, PySpark. Key Responsibilities: Designing and Implementing Data Solutions: Architecting and building end-to-end data solutions on Azure, leveraging Databricks, Azure Data Factory, and other Azure services. Data Pipeline Development: Developing and maintaining data pipelines using Databricks, ensuring seamless data integration and processing. Performance Optimization: Optimizing Spark jobs for performance and cost-efficiency ...

Person should have 6+ years in Azure Cloud. Should have experience in Data Engineer, Architecture. Experience in working on Azure Services like Azure Data Factory, Azure Function, Azure SQL, Azure Data Bricks, Azure Data Lake, Synapse Analytics etc.