2920 Data Bricks Jobs - Page 41

About Tredence : Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia. We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of r...

Key Skills: Technical Skills: Proficiency with Data bricks Lakehouse platform, Delta Lake, Genie, ML Flow (e.g., Data bricks Certified Data Engineer Associate) is a plus. SQL and NoSQL: Experienced working with both SQL and NoSQL data sources (e.g., MySQL, PostgreSQL, MongoDB etc.) Strong knowledge of Spark, especially in PySpark or Scala, for data transformation. Proficiency in Python, R and other programming languages used in data processing. Experience with cloud platforms like Azure, AWS, particularly Azure storage & services Knowledge of ML Pipelines, data streaming platforms (e.g., Apache Kafka, AWS Kinesis). Familiarity with data visualization tools (e.g., Tableau, Power BI, Looker) E...

Responsibilities Azure Data Factory & Data Bricks Design and develop data pipelines, workflows, and data transformation processes. Integrate various data sources to ensure seamless data flow between systems. Optimize data processing and storage for performance and cost-efficiency. Databases (SQL, PostgreSQL, Azure Databases) Design, implement, and maintain database systems, including PostgreSQL and Azure databases. Monitor and optimize database performance. Implement robust backup and recovery strategies. ETL/ELT Concepts Extract data from various sources. Transform data to meet business requirements. Load data into target systems efficiently. DevOps and Agile Methodologies Implement and man...

Job Title: Lead Data Engineer (Full-Time) Department: Digital Data & Analytics (DDA) Responsibilities Techno Functional Management Manage and oversee technical and functional aspects of projects. Hands-on experience in Azure Data Factory & Data Bricks. Provide hands-on experience in Python and back-end programming languages. Utilize knowledge in data visualization tools and libraries. Knowledge in Graph-DB is a plus. People Management Lead and mentor team members, fostering a collaborative and productive work environment. Azure Data Factory & Data Bricks Design and develop data pipelines, workflows, and data transformation processes. Integrate various data sources to ensure seamless data flo...

You are looking for a talented Data Engineer with 4+ years of experience to join your team in Pune/Hyderabad/Gurgaon/Hybrid location. As a Data Engineer, you will be responsible for converting and optimizing SAS code into PySpark using in-house tools and participating in end-to-end migration projects. Your role will involve developing and maintaining data pipelines in PySpark, ensuring seamless integration with Azure cloud services, and conducting rigorous testing and validation of converted code to meet performance benchmarks and client requirements. To excel in this role, you must have at least 4 years of experience in SAS and PySpark coding, with proven experience in migration projects. Y...

As a Data Engineer, you will be responsible for designing and developing data solutions using Data Bricks. Your primary focus will be on creating and maintaining data pipelines for processing large datasets. Collaborating with data scientists and analysts, you will optimize data workflows and implement ETL processes to streamline data management. Utilizing Apache Spark, you will enhance data processing capabilities and conduct data analysis to derive actionable insights. Ensuring data quality and integrity throughout the data lifecycle is crucial, and you will be expected to monitor and improve existing data systems. Integrate Data Bricks with cloud platforms such as Azure and AWS, and devel...

As a Senior Data Lake Developer at BCSS, you will play a crucial role in the advancement and expansion of our advanced analytics practice. Your primary responsibility will involve designing and developing data lakes, managing data flows, and integrating information from diverse sources into a unified data lake platform through an ETL Tool. Furthermore, you will code and oversee delta lake implementations on S3 utilizing technologies such as Databricks or Apache Hoodie. It will be your responsibility to triage, debug, and resolve technical issues related to Data Lakes, as well as design and develop data warehouses for scalability. Evaluating data models, designing data access patterns, and co...

The BI Data Engineer is a key role within the Enterprise Data team. We are looking for expert Azure data engineer with deep Data engineering, ADF Integration and database development experience. This is a unique opportunity to be involved in delivering leading-edge business analytics using the latest and greatest cutting-edge BI tools, such as cloud-based databases, self-service analytics and leading visualisation tools enabling the companys aim to become a fully digital organisation. Job Description: Key Responsibilities: Build Enterprise data engineering and Integration solutions using the latest Azure platform, Azure Data Factory, Azure SQL Database, Azure Synapse and Azure Fabric Develop...

You will be joining our dynamic team as an Azure Data Engineer - L3 with 5-7 years of experience, based in either Hyderabad or Bangalore, working the shift timings of 2PM-11PM IST. Your responsibilities will include: - Utilizing your expertise in Azure Data Factory, Databricks, Azure data lake, and Azure SQL Server. - Developing ETL/ELT processes using SSIS and/or Azure Data Factory. - Building complex pipelines and dataflows with Azure Data Factory. - Designing and implementing data pipelines using Azure Data Factory (ADF). - Enhancing the functionality and performance of existing data pipelines. - Fine-tuning processes dealing with very large data sets. - Configuring and Deploying ADF pack...

About McKesson Compile Established in 1833, McKesson is a US Fortune 10 global leader in healthcare supply chain management solutions, retail pharmacy, healthcare technology, community oncology, and specialty care. We partner with life sciences companies, manufacturers, providers, pharmacies, governments, and other healthcare organizations to help provide the right medicines, medical products, and healthcare services to the right patients at the right time, safely and cost effectively. Based in Bangalore India, McKesson Compiles data is a comprehensive, full linked system of record for the US Healthcare market, with intelligence on 2M+ healthcare professionals (HCPs) and over 800K facilities...

As a skilled professional in Business Intelligence (BI), you will be responsible for developing reports and dashboards using BI tools. Your tasks will include deploying reports and dashboards, as well as gathering requirements and documenting both high-level and detailed designs. You will also be involved in creating unit test cases and functional test cases, and performing unit testing and functional testing. Proficiency in Power BI, including both Power BI Desktop and Power BI Service, is essential for this role. Additionally, experience with VBA, Power Query, and Power Pivot will be beneficial. Familiarity with Data Bricks, UI/UX design principles, documentation practices, requirement gat...

Northern Trust, a Fortune 500 company with a legacy dating back to 1889, is a renowned financial institution offering innovative financial services to a diverse clientele worldwide. With a team of over 22,000 partners and a commitment to service, expertise, and integrity, Northern Trust has established itself as a leader in the financial industry. As a professional contributing to the success of Northern Trust, you will utilize your expertise and knowledge to drive projects and initiatives within your domain. Your role will involve providing analytical support to enhance data quality and performance calculation processes within the organization. Collaborating with various stakeholders, inclu...

Genpact is a global professional services and solutions firm dedicated to delivering outcomes that shape the future. With over 125,000 employees spread across more than 30 countries, we are characterized by our innate curiosity, entrepreneurial agility, and commitment to creating lasting value for our clients. Our purpose, which is the relentless pursuit of a world that works better for people, drives us to serve and transform leading enterprises, including the Fortune Global 500, by leveraging our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. We are currently looking for a Principal Consultant - Data Scientist, specializing in ...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Manager Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and dat...

As a Senior Data Engineer at our Pune location, you will play a critical role in designing, developing, and maintaining scalable data pipelines and architectures using Data bricks on Azure/AWS cloud platforms. With 6 to 9 years of experience in the field, you will collaborate with stakeholders to integrate large datasets, optimize performance, implement ETL/ELT processes, ensure data governance, and work closely with cross-functional teams to deliver accurate solutions. Your responsibilities will include building, maintaining, and optimizing data workflows, integrating datasets from various sources, tuning pipelines for performance and scalability, implementing ETL/ELT processes using Spark ...

As a Pricing Revenue Growth Consultant, your primary role will be to advise on building a pricing and promotion tool for a Consumer Packaged Goods (CPG) client. This tool will encompass pricing strategies, trade promotions, and revenue growth initiatives. You will be responsible for developing analytics and machine learning models to analyze price elasticity, promotion effectiveness, and trade promotion optimization. Collaboration with CPG business, marketing, data scientists, and other teams will be essential for the successful delivery of the project and tool. Your Business Domain Skills will be crucial in this role, including expertise in Trade Promotion Management (TPM), Trade Promotion ...

As a Senior Infrastructure Architect at our organization, you will play a crucial role in our digital transformation journey. You will have the opportunity to be involved in cybersecurity, architecture, and data protection for our global organization. Collaborating with our team, you will provide expertise in designing and validating systems, infrastructure, technologies, and data protection. Your responsibilities will include participating in technical and business discussions to shape future architecture direction, analyzing data to develop architectural requirements, and contributing to infrastructure architecture governance. Additionally, you will be involved in designing and deploying i...

About Evernorth Evernorth? exists to elevate health for all, because we believe health is the starting point for human potential and progress. As champions for affordable, predictable and simple health care, we solve the problems others dont, wont or cant. Our innovation hub in India will allow us to work with the right talent, expand our global footprint, improve our competitive stance, and better deliver on our promises to stakeholders. We are passionate about making healthcare better by delivering world-class solutions that make a real difference. We are always looking upward. And that starts with finding the right talent to help us get there. Software Engineering Senior Manager Position ...

Position Summary We are looking for a highly skilled and experienced Data Engineering Manager to lead our data engineering team. The ideal candidate will possess a strong technical background, strong project management abilities, and excellent client handling/stakeholder management skills. This role requires a strategic thinker who can drive the design, development and implementation of data solutions that meet our clients needs while ensuring the highest standards of quality and efficiency. Job Responsibilities Technology Leadership- Lead guide the team independently or with little support to design, implement deliver complex cloud-based data engineering / data warehousing project assignmen...

We are hiring a Data Engineer to design and manage data pipelines from factory floors to the Azure cloud, supporting our central data lakehouse architecture You'll work closely with OT engineers, architects, and AI teams to move data from edge devices into curated layers (Bronze ? Silver ? Gold), ensuring high data quality, security, and performance Your work will directly enable advanced analytics and AI in production and operations, Key Job functions Build data ingestion and transformation pipelines using Azure Data Factory, IoT Hub, and Databricks 2) Integrate OT sensor data using protocols like OPC-UA and MQTT Design Medallion architecture flows with Delta Lake and Synapse Monitor and op...

Your Team Responsibilities We are hiring an Associate Data Engineer to support our core data pipeline development efforts and gain hands-on experience with industry-grade tools like PySpark, Databricks, and cloud-based data warehouses The ideal candidate is curious, detail-oriented, and eager to learn from senior engineers while contributing to the development and operationalization of critical data workflows, Your Key Responsibilities Assist in the development and maintenance of ETL/ELT pipelines using PySpark and Databricks under senior guidance, Support data ingestion, validation, and transformation tasks across Rating Modernization and Regulatory programs, Collaborate with team members t...

Microsoft Dynamics CRM Developer, 6 to 10 years of relevant experience, Remote. Pan India. Work from home, Mandatory Skills: Microsoft Dynamics CRM, Azure Data Factory, Azure Data Brick Immediate to 30 days Joiners. ------------------------------

1. Production monitoring and troubleshooting in on Prem ETL and AWS environment 2. Working experience using ETL Datastage along with DB2 3. Awareness to use tools such as Dynatrace, Appdynamics, Postman , AWS CICD 4. Software code development experience in ETL batch processing and AWS cloud 5. Software code management, repository updates and reuse 6. Implementation and/or configuration, management, and maintenance of software 7. Implementation and configuration of SaaS and public, private and hybrid cloud-based PaaS solutions 8. Integration of SaaS and PaaS solutions with Data Warehouse Application Systems including SaaS and PaaS upgrade management 9. Configuration, Maintenance and support f...

Datawarehouse Database Architect - Immediate hiring. We are currently looking for Datawarehouse Database Architect for our client who are into Fintech solutions. Please let us know your interest and availability Experience: 10 plus years of experience Locations: Hybrid Any Accion offices in India pref (Bangalore /Pune/Mumbai) Notice Period: Immediate – 0 – 15 days joiners are preferred Required skills: Tools & Technologies Cloud Platform : Azure (Data Bricks, DevOps, Data factory, azure synapse Analytics, Azure SQL, blob storage, Databricks Delta Lake) Languages : Python/PL/SQL/SQL/C/C++/Java Databases : Snowflake/ MS SQL Server/Oracle Design Tools : Erwin & MS Visio. Data warehouse tools : ...

Primary Responsibilities: Be a team player in an agile team within a release team / value stream Develop and automate business solutions by creating new and modifying existing software applications Be technically hands-on and excellent in Design, Coding and Testing End to End, product quality Participate and contribute to Sprint Ceremonies Promote and develop the culture of collaboration, accountability, and quality Provide technical support to the team and help the team in resolving technical issues Closely work with Tech Lead, Onshore partners, deployment, and infrastructure teams Basic, structured, standard approach to work Comply with the terms and conditions of the employment contract, ...