2919 Data Bricks Jobs - Page 2

Primary Responsibility: Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so Required Qualifications: B.E./B Tech/MCA/M Tech / Bachelor''s degree C...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

IMMEDIATE JOINERS ONLY Job Title: Data Engineer Location : Pune, MH (WFO) Skills Required: Python PostgreSQL, Databricks Azure Data Factory Experience: 6-8 years(Rel 5 yrs.) Job Description: PostgreSQL, Databricks, Python, and Azure - PostgreSQL, Databricks, Python, especially with libraries such as Pandas and NumPy, and Azure services

Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology environment, enter...

Job Description- Lead Data Engineer Why would you like to join us? TransOrg Analytics specializes in Data Science, Data Engineering and Generative AI, providing advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, APAC and the Middle East. We leverage data science to streamline, optimize, and accelerate our clients' businesses. Visit at www.transorg.com to know more about us. Position Summary: Build a centralized data system/warehouse for unifying data, improving data integration, and enhancing reporting and business intelligence capabilities. Education & Experience Requirements Bachelors degree in data science, computer science, or IT-related fields w...

Databricks Developer Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation . Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Location- Pune, Bangalore, Coimbatore, Chennai Mandatory Skills: DataBricks - Data Enginee...

Role Description Develop, schedule, and manage ETL processes using SSIS and Azure Data Factory (ADF) Build and optimize data models and OLAP cubes using SSAS and Azure Analysis Services Design and deploy reports using SSRS and Power BI Migrate on-premises SQL workloads to Azure SQL, Data Lake, and Synapse Build scalable data pipelines and processing workflows using Databricks (PySpark) Write complex T-SQL queries, stored procedures, functions, and triggers. Implement DevOps pipelines for data deployment and automation using Azure DevOps Collaborate with stakeholders to convert business requirements into technical solutions. Track and resolve issues through ServiceNow, JIRA, or ALM Maintain t...

BMC is looking for a Java Tech Lead, an innovator at heart, to join a team of highly skilled software developers, responsible for BMCs Helix Capacity Optimization product. Here is how, through this exciting role, YOU will contribute to BMC's and your own success: Design and develop platform solution based on Java/J2EE best practices and web standards. Discover, design, and develop analytical methods to support novel approaches of data and information processing Lead/participate in all aspects of product development, from requirements analysis to product release. Lead feature/product engineering teams and participate in architecture and design reviews. Responsible for delivery of high quality...

Experience: 2-4 years Requirements: Bachelor'sinComputer Science, Information Technologyor any other equivalent degree. Basic experience with SQL and Python/Scala for data manipulation and automation. Basics of Power BI or Tableau or any other BI tool. Basic understanding of machine learning, specifically in regression, classification, and time series. Basic experience with data analysis techniques to support decision-making and business goals. Familiarity with ETL/ELT pipelines and cloud-based data processing. Knowledge of version control (Git) and CI/CD processes for data deployment. Strong problem-solving and analytical thinking. Ability to work in a collaborative, fast-paced environment....

Requirements: 5+ years of experience with Azure DevOps, including Boards, and Repos. Proficiency with Azure Pipeline Strong expertise in CI/CD processes and infrastructure automation. Hands-on experience with orchestration platforms. Proficiency with scripting tools (e.g., YAML, PowerShell, Bash). Knowledge of cloud architecture, security best practices, and monitoring strategies. Nice to have: GitHub Actions Data Factory Databricks Responsibilities: Build and maintain CI/CD pipelines for automated deployment of services and infrastructure. Manage Azure DevOps workflows and collaborate on project tracking with Boards. Configure and operate Azure Service Fabric clusters and related cloud infr...

Role Data Scientist LocationBangalore TimingsFull Time (As per company timings) Notice Period(Immediate Joiner Only) Experience5 Years : We are looking for a highly motivated and skilled Data Scientist to join our growing team The ideal candidate should possess a robust background in data science, machine learning, and statistical analysis, with a passion for uncovering insights from complex datasets This role demands hands-on experience in Python and various ML libraries, strong business acumen, and effective communication skills for translating data insights into strategic decisions. Key Responsibilities: Develop, implement, and optimize machine learning models for predictive analytics and...

We are looking forward to hireAzure Data Factory (ADF) Professionals in the following areas : Experience of 2-4 yrs in Azure services like Azure Data factory, Azure Databricks, Azure Synapse, Azure SQL, ETL Create Pipelines, datasets, dataflows, Integration runtimes and monitoring Pipelines and trigger runs Extract Transformation and Load Data from source system and processing the data in Azure Databricks Create SQL scripts to perform complex queries Create ADF pipelines to migrate data from Gen2 to Azure SQL Data Migration pipeline to Azure cloud (Azure SQL). Database migration from on-prem SQL server to Azure Dev Environment by using Azure DMS and Data Migration Assistant Experience in usi...

Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology environment, enter...

You should have a bachelors or masters degree in computer science, Information Technology or other quantitative fields You should have at least 5 years working as a data engineer in supporting large data transformation initiatives related to machine learning, with experience in building and optimizing pipelines and data sets Strong analytic skills related to working with unstructured datasets. Experience with Azure cloud services: ADF, Azure Synapse, Blob Storage, ADLS, App Insights, and familiarity with various log formats from Azure. Experience with object-oriented/object function scripting languages: Python, Py-spark, Java, etc. Experience with big data tools: Hadoop, Spark, Kafka, etc. E...

Experience in Azure Data Factory, Databricks, Azure data lake and Azure SQL Server. Developed ETL/ELT process using SSIS and/or Azure Data Factory. Build complex pipelines & dataflows using Azure Data Factory. Designing and implementing data pipelines using in Azure Data Factory (ADF). Improve functionality/ performance of existing data pipelines. Performance tuning processes dealing with very large data sets. Configuration and Deployment of ADF packages. Proficient of the usage of ARM Template, Key Vault, Integration runtime. Adaptable to work with ETL frameworks and standards. Strong analytical and troubleshooting skill to root cause issue and find solution. Propose innovative, feasible an...

We're Hiring Remote | Part-Time | All Experience Levels Santekk Technologies is looking for talented professionals experienced in Snowflake and/or Databricks for exciting remote, part-time, and moonlighting opportunities. Whether you're a: Senior consultant looking to take on additional projects Mid-level engineer looking for flexible work Junior developer with hands-on experience We want to hear from you! 100% Remote Flexible Hours Part-Time | Contract | Moonlighting Projects across data engineering, analytics, and cloud platforms Key Skills: • Snowflake (SQL, Performance Optimization, Data Warehousing) • Databricks (PySpark, Delta Lake, Notebooks) • ETL/ELT pipelines • Cloud platforms AWS,...

Role & responsibilities 4+ years of relevant experience in Pyspark and Azure Databricks. • Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources. • Good experience in SQL or native SQL query languages. • Strong experience in implementing Databricks notebooks using Python. • Good experience in Azure Data Factory, ADLS, Storage Services, Synapse, Serverless architecture, Azure functions. Good-to-Have • Strong knowledge of Data management principles. • Good experience in SSIS/ETL transformation processes. • Experience in Azure DevOps and CI/CD deployments • Strong problem solving and analytical skills. • Experience with Agile devel...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data Lake Storage. Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business objectives. Develop complex SQL queries to optimize database performance and troubleshoot issues in SQL Azure databases. Implement big data analytics solutions using PySpark on Spark Cluster or SCALA clusters. Ensure high availability of cloud resources by monitoring usage patterns and implementing cost optimization strategies. Desired Candidate Profile 5-7 years of...

Key Skills: Python, SQL, AWS, Spark - (Mandate) Databricks, Airflow- Good to have Mail id Gopi.c@acesoftlabs.com 9821256806

Databricks - Data engineer Years of experience: 4 to 10 years (with minimum 4 years of relevant experience) Key Skills: Python, SQL, AWS/ Azure, PySpark/Spark, Databricks - (Mandate) Airflow- Good to have Call me 9701923036 or Gopi.c@acesoftlabs.com

Hi, DMI is seeking a full-time Data Engineer to support our manufacturing clients large scale digital transformation. Duties and Responsibilities: Demonstrate skills in abstract development frameworks Demonstrate accountability to assigned work & timelines Demonstrated leadership skills. Demonstrated technical competency for the role. Demonstrated timely delivery on assigned tasks and effective communication on project status and escalation when needed. Education and Experience: 10+ Years or equivalent degree + experience Required Skills/Certifications: Estimating and Planning Work breakdown for the team. Data pipelines Data Transformations Code/Unit Test PR & Code Reviews Performance & Load...

Minimum Requirements: 5+ years of experience overall in IT Current - 2+ years of experience on Azure Cloud as Data Engineer Current - 1.5+ years of hands-on experience on Databricks/Azure Databricks Proficient in Python/PySpark Proficient in SQL/TSQL Proficient in Data Warehousing Concepts (ETL/ELT, Data Vault Modelling, Dimensional Modelling, SCD, CDC) Primary Skills: Azure Cloud, Databricks, Azure Data Factory, Azure Synapse Analytics, SQL/TSQL, PySpark, Python Technical Expertise: ETL/ELT Pipelines: Design, implementation, and optimization. Azure ADF and Synapse: Proficiency in creating pipelines, developing notebooks, and performing data transformations. Databricks: Hands-on experience w...

Minimum Requirements: 5+ years of experience overall in IT Current - 2+ years of experience on Azure and AWS Cloud as Data Engineer Current - 1.5+ years of hands-on experience on Databricks/Azure Databricks Proficient in Python/PySpark Proficient in SQL/TSQL Proficient in Data Warehousing Concepts (ETL/ELT, Data Vault Modelling, Dimensional Modelling, SCD, CDC) Primary Skills: Azure Cloud, AWS Cloud, Databricks, Azure Data Factory, Azure Synapse Analytics, SQL/TSQL, PySpark, Python Technical Expertise: ETL/ELT Pipelines: Design, implementation, and optimization. Azure ADF and Synapse: Proficiency in creating pipelines, developing notebooks, and performing data transformations. Databricks: Ha...

Minimum Requirements: 9+ years of experience overall in IT Current - 4+ years of experience on Azure Cloud as Data Engineer Current - 4+ years of hands-on experience on Databricks/Azure Databricks Proficient in Python/PySpark Proficient in SQL/TSQL Proficient in Data Warehousing Concepts (ETL/ELT, Data Vault Modelling, Dimensional Modelling, SCD, CDC) Logistics domain experience Primary Skills: Azure Cloud, Databricks, Azure Data Factory, Azure Synapse Analytics, SQL/TSQL, PySpark, Python Technical Expertise: ETL/ELT Pipelines: Design, implementation, and optimization. Azure ADF and Synapse: Proficiency in creating pipelines, developing notebooks, and performing data transformations. Databri...

DMI Innovations a Encora company is seeking a full-time Lead Data Engineer who has expertise with Logistic domain to support our manufacturing clients large scale digital transformation. The Lead Data Engineer is responsible for ensuring the day-to-day leadership and guidance of the local, India-based, data team. This role will be the primary interface with the management team of the client and will work cross functionally with various IT functions to streamline project delivery. Duties and Responsibilities: Work with a distributed team with primary focus on the management of resources, team assignments, and fostering career growth Input into the hiring of team members for the locally based ...