6138 Data Bricks Jobs - Page 43

Company Overview Accordion is a global financial consulting and technology firm helping CFOs and their teams drive value creation. Rooted in private equity rigor and powered by data, analytics, and AI, we partner with companies across industries to turn insight into impact. Accordion works at the intersection of Private Equity sponsors and portfolio companies management teams across every stage of the investment lifecycle. We provide hands-on, execution-oriented support, driving value through the office of the CFO by building data and analytics capabilities and identifying and implementing strategic work, rooted in data, analytics and AI. Accordion is headquartered in New York City with 10 o...

Our NielsenIQ Technology teams are working on revamping multiple platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on NielsenIQs data and insights to innovate and grow. As a Data Software Engineer, youll be part of a team of smart, highly skilled technologists who are passionate about learning and prototyping cutting-edge technologies. Ingestion Services is working on unifying and standardizing several varied ingestion methodologies and convergence initiatives with latest Big Data services on Spark, Scala, Databricks, PySpark and leverage GitHub to support things like CI/CD and integrations and continuing to adopt the best in class...

Overview 170+ Years Strong. Industry Leader. Global Impact. At Pinkerton, the mission is to protect our clients. To do this, we provide enterprise risk management services and programs specifically designed for each client. Pinkerton employees are one of our most important assets and critical to the delivery of world-class solutions. Bonded together, we share a commitment to integrity, vigilance, and excellence. Pinkerton is an inclusive employer who seeks candidates with diverse backgrounds, experiences, and perspectives to join our family of industry subject matter experts. The Data Engineer will be part of a high-performing and international team with the goal to expand Data & Analytics s...

8+ years of experience in data engineering, with a focus on scalable architecture design. Strong proficiency in Python, PySpark, Python-based UI libraries and Gradio or Streamlit. Strong proficiency in Python, especially in Pandas and NumPy. Strong proficiency in Databricks environment and Native Apps Hands-on experience with Databricks (notebooks, jobs, lakehouse architecture). Experience building charts and dashboards using Matplotlib, Seaborn, or Plotly. Experience in python webapp and rest API development Good to have understanding of SAS (PROC steps, data handling, stored processes). Understanding of data structures, statistical methods, and basic analytical modeling. Good understanding...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will...

Azure Data Engineer 5+ yrs of Exp Upto16 LPA Pune/ Bangalore Immediate Joiner OR 30 Days Skills:Azure Data Factory, Data Bricks, Data Warehousing, Data Modelling, SQL, ETL, Python, Pyspark mansikohliimaginator@gmail.com Required Candidate profile Azure Data Engineer to join our dynamic team and contribute to our data management and analytics initiatives. Immediate Joiner OR 30 Days

Job Title: Senior Data Engineering & Power BI Consultant Experience: 5-7 years Location: Bengaluru Role Overview: We are looking for a highly skilled Senior Data Engineering & Power BI Consultant to design, build, and optimize scalable data solutions. The ideal candidate should have strong hands-on experience with Databricks Unity Catalog, Power BI, and modern data engineering practices, along with the ability to translate complex data into business-ready insights. Key Responsibilities: Design and implement robust data pipelines using Databricks (Delta Lake, PySpark, SQL). Manage and govern data assets through Unity Catalog (UC) defining lineage, access control, and data classification. Inte...

As an AWS Data Architect, you will lead the design of data ingestion, transformation, and summary layers, while creating optimized data models for data warehouses. You will drive architecture initiatives, enforce best practices.

Role & responsibilities As an ML Engineering Specialist you will be owning responsibility to operationalize ML models NLP Computer Vision and other type of models • End to End model lifecycle management starting from feature extraction to monitor machine learning models using high end tools and technologies • Design implementation of DevOps principles in Machine Learning • Model quality assurance governance and monitoring • Integrate models as part of business applications via APIs • Execute best practices in version control and continuous integration delivery • Collaborate with data scientists engineers and other key stakeholders • Work well in a fast-paced cross functional environment Mand...

Build and optimize Databricks ETL/ELT pipelines using PySpark/Spark, apply data warehouse concepts, collaborate with cross-functional teams, and automate workflows using orchestration and CI/CD tools.

Responsibilities Design and develop data pipelines using Databricks and PySpark to ingest, process, and transform large volumes of data Implement ETL/ELT workflows to move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using cloudnative tools Work with structured and unstructured data stored in AWS or Azure Data Lakes Apply strong SQL and Python skills to manipulate and analyze data efficiently Collaborate with crossfunctional teams to deliver cloudbased serverless data solutions Design innovative data solutions that address complex business requirements and support datadriven decisionmaking Maintain documentation and enforce best practices for data architecture, go...

Data Strategy Leadership: You will own and evolve the AI data strategy for Sales Assist. You will define vision, operating model, and governance for enterprise-wide data sharing. You will create a roadmap for readiness in large language models, predictive analytics, and generative AI. AI-Ready Data Architecture & Enablement: You will design AI-optimized data architectures for semantic search and retrieval-augmented generation. You will develop strategies for vector database integration and embedding storage. You will define GraphQL API approaches for secure, efficient data access. You will partner with engineering teams to build scalable ingestion and embedding pipelines. You will align with...

Play a major role in building and enhancing existing and new environments Work with an existing Agile team Collaborate with internal groups such as Cloud Team and Standard Datafeeds Collaborate with external vendors such as Snowflake, Databricks and Microsoft Balance stability and innovation in operational areas related to databases, runtime, on-call support, and deployment procedures Communicate with stakeholders regarding project status, challenges and obstacles. What Were Looking For Required Skills Track record of success on large scale projects in collaboration with others Bachelor s degree in computer science, Engineering, or equivalent practical experience 3 to 5 years of relevant exp...

Perform data analysis, exploration, and preparation to support business use cases. Design and develop data pipelines in Python/Databricks and work with cloud data platforms. Apply Generative AI techniques to build prototypes, create insights, and enhance solutions. Collaborate with cross-functional teams to understand requirements and translate them into data-driven/AI-driven outcomes. Conduct unit testing, validation, and data quality checks for datasets, pipelines, and AI outputs. Design and develop RESTful APIs to enable communication between different software components. Follow agile and DevOps practices for continuous development, testing, and deployment. Contribute to data governance,...

Job Title - ETL Automation testing with cloud or Python Experience - 6 to 12 years ETL Tester with 6+ Years of Cloud Data testing experience Experience with Python coding Experience in Pyspark Experience in data migration and ETL transformation testing Exposure to Azure Data lakes and data bricks is must Develop technical specifications for data loading rules ETL Automation Testing with python as well Cloud

About the Role The ML Developer will design, build, and maintain machine learning models and data pipelines powering core business use cases. The role is hands-on with Python for model development, feature engineering, and pipeline automation, leveraging Azure ML, and Azure DevOps. Success means robust, production grade models with proven business impact, traceable lineage, and operational excellence at scale. Role & responsibilities Feature Engineering & Model Development - Translate model prototypes from Data Scientists into Azure ML production pipelines, including data ingestion, training, inference, and retraining. - Build and iterate on ML models (forecasting/classification/regression) ...

Hi Looking for Lead Data Engineer. Min. 2yrs role as a Lead overall 5- 6 yrs of experience. Azure Data Factory Databricks (including Unity Catalog and Notebooks) Azure DevOps Pipelines Data Modelling and Analysis Proven Team Leadership Experience

Educational Requirements MCA,MSc,MTech,Bachelor of Engineering,BCA,BSc Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion • As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. • You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. • You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to Techno...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Responsibilities: Design, develop & maintain GCP data pipelines using Data Bricks, Unity Catalog, PySpark, SQL & Terraform. Collaborate with cross-functional teams on CI/CD processes for data solutions.

Duties/ Roles & Responsibilities Lead the design, optimization, and scaling of data pipelines using Data bricks, Spark, and advanced SQL. Drive architectural decisions, enforce best practices, and mentor teams on distributed data processing and lake house patterns. Collaborate with cross-functional partners to deliver high-quality, reliable data solutions that support analytics and business objectives.

Duties/ Roles & Responsibilities Lead the design, optimization, and scaling of data pipelines using Data bricks, Spark, and advanced SQL. Drive architectural decisions, enforce best practices, and mentor teams on distributed data processing and lake house patterns. Collaborate with cross-functional partners to deliver high-quality, reliable data solutions that support analytics and business objectives.

Roles and Responsibilities Location - Bangalore/Hyderabad/Noida Exp - 5 - 12 years Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions such as Blob Storage, File Share, and SQL Database. Collaborate with cross-functional teams to understand business requirements and design scalable data architectures that meet those needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure environments. Implement data bricks solutions using Azure Databricks for big data processing tasks. Interested candidates can share profiles to mary...

Job Summary: We are seeking a highly skilled Lead Data Engineer to join our dynamic team. The ideal candidate will possess a strong background in data engineering, with a focus on designing and implementing robust data solutions. This role requires expertise in AWS, PySpark, and Apache Flink for real-time streaming applications. The Lead Data Engineer will be responsible for architecting data solutions that meet business needs while ensuring scalability, reliability, and performance. Responsibilities: Design and implement data pipelines and architectures to support real-time data processing and analytics. Collaborate with cross-functional teams to gather requirements and translate them into ...

As a Data Engineering Manager at EY, you will be responsible for leading large scale solution architecture design and optimization to provide streamlined insights to partners throughout the business. You will lead a team of Mid and Senior data engineers to partner with visualization on data quality and troubleshooting needs. Your key responsibilities will include: - Implementing data processes for the data warehouse and internal systems - Leading a team of Junior and Senior Data Engineers in executing data processes and providing quality, timely data management - Managing data architecture and designing ETL processes - Cleaning, aggregating, and organizing data from disparate sources and tra...