2920 Data Bricks Jobs - Page 24

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

About The Role Project Role : Application Designer Project Role Description :Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure DatabricksMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. A typical day involves collaborating with various stakeholders to gather insights, analyzing user needs, and translating them into funct...

About The Role Project Role : Application Lead Project Role Description :Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Analytics Services Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads.-Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.-Collaborate with Data Ana...

About The Role Project Role : Application Developer Project Role Description :Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Analytics Services Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads.-Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.-Collaborate with Data Analy...

About The Role Project Role : Application Lead Project Role Description :Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Analytics Services Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads.-Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.-Collaborate with Data Analy...

About The Role Project Role : Application Developer Project Role Description :Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Analytics Services Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads.-Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.-Collaborate with Data Analy...

About Position: The MDM Project Manager leads Master Data Management initiatives, ensuring high-quality, consistency, and governed data across systems. This role involves managing project delivery, collaborating with stakeholders, and driving data strategies to support business operations. Role: MDM-Project Manager Location: All Persistent locations Experience: 12-14 years Job Type: Full Time Employment What You'll Do: Lead MDM project delivery and execution. Collaborate with stakeholders to define data requirements. Ensure data quality, governance, and compliance. Manage timelines, risks, and resources. Provide regular project updates to leadership. Expertise You'll Bring: Strong understand...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 7+ Yrs total experience in Data Engineering projects & 4+ years of relevant experience on Azure technology services and Python Azure Azure data factory, ADLS- Azure data lake store, Azure data bricks, Mandatory Programming languages Py-Spark, PL/SQL, Spark SQL Database SQL DB Experience with AzureADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with object-oriented/object function scripting languagesPython...

We are looking for a Site Reliability Engineer to join our team and help us to: Provide best-in-class Production Support for Data Science engineering, application development, and production Line-of-Business teams Design, engineer, and implement critical infrastructure to support Data Science platforms such as Alteryx, Dataiku and Azure Machine Learning Act as a Problem Manager to troubleshoot and resolve complex Technical Incidents with an eye on developing sustainable automate Collaborate with cross-functional teams like engineering, hardware, platform services, cloud, and operations Monitor and Analyze MongoDB performance, with a foci on automation and reliability Ensure compliance with o...

Support Development, and maintain automated test frameworks, tools, and test cases for Data Engineering and Data Warehouse applications. Collaborate with cross-functional teams, including software developers, data engineers, and data analysts, to ensure comprehensive testing coverage and adherence to quality standards. Conduct thorough testing of data pipelines, ETL processes, and data transformations using Big Data technologies. Apply your knowledge of Data Warehouse/Data Lake methodologies and best practices to validate the accuracy, completeness, and performance of our data storage and retrieval systems. Identify, document, and track software defects, working closely with the development ...

• Proven expertise in building batch and streaming data pipelines using Databricks (PySpark) and Snowflake. • Strong programming skills in SQL, Python, and PySpark for scalable data processing Required Candidate profile • Proficient in processing structured (CSV, SQL), semi-structured (JSON, XML), and unstructured (PDF, logs) data • Experience with designing low-latency, high-throughput pipelines using Spark.

Project Role: Azure date engineer Work Experience: 3 to 8 Years Work location: Bangalore/Gururam/Kochi/Pune Work Mode: Hybrid Must Have Skills: Azure Data engineer, SQL, Spark/Pyspark Job Overview: Responsible for the on-time completion of projects or components of large, complex projects for clients in the life sciences field. Identifies and elevates potential new business opportunities and assists in the sales process. Skills required: Experience in developing Azure components like Azure data factory, Azure data Bircks, Logic Apps, Functions Develop efficient & smart data pipelines in migrating various sources on to Azure datalake Proficient in working with Delta Lake, Parquet file formats...

Role: Data Engineer Experience: 5+ Years Work Location: Chennai T. Nagar (Work from Office) About the Role: We are seeking a highly skilled Data Engineer to join our team and help us build robust, scalable, and efficient data pipelines. You will play a crucial role in designing, developing, and maintaining data solutions that power our business decisions. Skills and Technologies used Cloud platform: AWS AWS: Athena, AWS Glue, Lambda, S3, Redshift, EC2, EBS, CloudWatch, VPC, DynamoDB, API Gateway, IAM, SQS, SNS, Step Functions, Quick Sight. Programming languages: Python, JAVA, PySpark, SQL ETL tool: Talend, Airflow or any other Responsibilities Perform data engineering activities that include...

Responsibilities: 5+ years of hands-on experience in data engineering , particularly with Python , PySpark , and SQL . Proven experience building ETL pipelines using AWS services (Glue, Lambda, S3, Athena, Step Functions). Strong knowledge of Data Warehousing concepts , SCD Types (Type 1, Type 2) , and Medallion Architecture . Solid understanding of data modeling , partitioning , and performance optimization in big data environments. Excellent communication skills with the ability to explain technical topics to non-technical stakeholders. Nice-to-Have Skills: Experience with DBT for data transformation and testing. Hands-on exposure to Databricks and the Lakehouse architecture . Familiarity ...

Informatica Data Quality (IDQ) or Axon/EDC 3 days work from office Unity Catalog (Databricks) configuring access control, lineage, metadata DBT – defining validation rules in transformation layer BigQuery and Databricks – integrating quality checks or observability Strong understanding of data stewardship principles, metadata management, and data lifecycle policies. Experience building data quality dashboards, alerts, and monitoring rules. Familiarity with data catalogs, business glossaries, and data domain modeling.

Responsibilities: Lead the design and architecture of IDS Data and Cloud Platforms. Present technical solutions and their business value to stakeholders. Build scalable, secure, and cost-effective data platforms on the cloud. Define design patterns, frameworks, and reusable components. Collaborate with product, business, and engineering teams to deliver solutions. Mentor team members, review designs/code, and drive best practices. Requirements: Hands-on experience in AWS/Azure. Strong SQL skills (query optimization, schema design, analytics). Proficient in Scala, Java, or Python. Knowledge of Kubernetes, Docker, and containerized deployments. Familiar with Agile/Scrum methodologies. Strong l...

Proficiency in Python programming for data engineering tasks. Hands-on experience with Databricks for data processing and analytics Expertise in working with NoSQL databases (e.g., MongoDB). Strong knowledge of ETL (Extract, Transform, Load) processes for data pipelines. Experience in building, optimizing, and maintaining scalable data engineering solutions. Familiarity with big data frameworks and cloud-based platforms (Azure experience preferred). Knowledge of data modeling and database design principles. Ability to troubleshoot and resolve data pipeline and database issues. Soft Skillsets: Analytical thinking and problem-solving abilities. Effective communication and collaboration with cr...

Role & responsibilities Support in Configure and maintain pricing conditions, discounts, and rebates within SAP (specifically modules like SD, MM, and potentially PP). Analyze sales data, market trends, and competitor pricing to identify opportunities for price optimization and improvement. Collaborate with sales and marketing teams to understand customer needs and pricing expectations. Work with Sales & finance to ensure accurate cost calculations and pricing models. Monitor pricing performance and identify areas for improvement. Develop and maintain pricing documentation and procedures. Support the implementation of new pricing tools and systems. Participate in cross-functional projects re...

Ro We are seeking a highly experienced Data Engineer with over 10+ years of expertise in Data Engineering, Databricks, Azure, SQL, PySpark, and Python. The ideal candidate will collaborate with Business and functional teams and create the data pipelines, apply CICD and DevOps practices, and optimize query performance and data transformations. This role requires a deep understanding of data governance, quality, and access control policies, as well as the ability to support production data pipelines and contribute to architectural decisions. Key Responsibilities : Apply CICD and DevOps practices to automate data workflows and deployments (e.g., with GitHub Actions, Jenkins, Terraform). Optimiz...

Write SQL queries to manipulate and visualize data using data visualization tools Ensures design, development of software solutions is meeting Amgen architectural, security, quality and development guidelines Participates in Agile development ceremonies and practices Develops and delivers robust technology solutions in a regulated environment by collaborating with business partners, information systems (IS) colleagues and service providers Authors documentation for technical specifications and designs that satisfy detailed business and functional requirements Works closely with business and IS teams to find opportunities Responsible for crafting and building end-to-end solutions using cloud ...

If you are passionate about unleashing the power of data to drive bottom-line impacts and understand the various aspects of data engineering and governance, this role might be for you! As a Data Owner Senior Associate within the Marketing Platform Automation Team, you will manage all data created, provisioned, or consumed to support business objectives, advanced analytics, business operations, and reporting. You will play a crucial role in ensuring data quality and governance. Job Responsibilities Identify the scope of critical data within the product, ensuring well-documented metadata for understanding and control. Create plans for product data development and delivery to support strategic ...

Description - Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health equity on a global scale. Join us to start Caring. Connecting. Growing together. Primary Responsibilities: Follow the development practices, policies, and reporting expectati...

Responsibilities: * Deploy, Configure & Manage AWS data bricks clusters * Optimize performance through tuning and scaling * Collaborate with cross-functional teams on data engineering projects * Ensure security compliance and access control Work from home

JD Databricks platform expertise CI/CD and Data pipeline Good SQL, Python, and PySpark knowledge Unit test case implementation experience MongoDB, Aggregation A minimum of 5 years of experience.