200 Spark Sql Jobs

Job Description: As a Graph Database Developer, your primary role will involve designing, developing, and maintaining graph database schemas using Neo4j. You will be responsible for optimizing Neo4j queries for performance and efficiency. Additionally, you will utilize Python, PySpark, or Spark SQL for data transformation and analysis. Your role will also include conducting User Acceptance Testing (UAT) to ensure data accuracy and overall system functionality. Moreover, you will be developing and managing scalable data pipelines using Databricks and Azure Data Factory (ADF) while working with Azure cloud services and being familiar with Azure data engineering components. Key Responsibilities...

As a Senior Data Engineer at SoftwareOne, you will be responsible for designing, developing, and maintaining the data lakehouse and pipelines. You will collaborate closely with the Data & Analytics teams to ensure efficient data flow and support data-driven decision-making. The ideal candidate should have a strong background in data engineering, expertise in Databricks, Azure Data Factory, and other Azure services, and a passion for working with large-scale data sets. **Key Responsibilities:** - Collaborate with the Product Owner, Business analyst, and team members to understand requirements and design scalable data pipelines and architectures. - Build and maintain data ingestion, transforma...

As a Data Engineering Lead, your role will involve architecting, building, and optimizing scalable data pipelines and platforms to support crucial business decisions. Your expertise in PySpark, ETL frameworks, SQL Stored Procedures, and Data Modeling will be key in ensuring performance tuning across large datasets. Key Responsibilities: - Lead the design and development of scalable data pipelines using PySpark and SQL - Develop and maintain Stored Procedures for batch processes and data transformations - Design robust data models (Star, Snowflake, normalized models) for data warehouse and lake environments - Collaborate with BI, Analytics, and Product teams to understand data requirements an...

Looking for a data engineer with strong experience in data modeling, ETL, data warehousing, Big Data tools (Hadoop, Hive, HBase, and Spark), and mandatory skills in Apache Spark, PySpark & Spark SQL.

As an Azure Data Engineer and Data Visualization Lead specializing in Tableau (with Databricks being mandatory), you will play a pivotal role in designing, developing, and maintaining interactive dashboards and visual analytics solutions to drive business insights and decision-making in the lending domain. **Key Responsibilities:** - Perform analysis of source systems data to derive meaningful insights. - Estimate and deliver adhoc and new Tableau MIS reports. - Design and develop visually compelling Tableau dashboards tailored to business needs, following data visualization best practices and data storytelling techniques. - Collaborate with business stakeholders to gather requirements and t...

As a Data Engineer at Data Bricks in Melbourne, you will be responsible for working with a specific tech stack and leveraging your experience to design and deploy data engineering pipelines. Your main responsibilities will include: - Having 6-10 years of experience in Data Lake, Azure Data Bricks - Designing and deploying Databricks platforms for AWS, Azure, or Google Cloud - Building and deploying data engineering pipelines into production with automation best practices for CI/CD - Guiding clients in implementing transformational big data projects from end-to-end - Working in Scrum Agile Technical environment - Streamlining the customer machine learning lifecycle and integrating it with the...

As a Software Developer at Revrr Technologies, you will be responsible for designing, developing, and maintaining high-performance, scalable data processing applications using Scala and Apache Spark. You will collaborate with cross-functional teams to define, design, and ship new features. Your role will also involve optimizing and refactoring existing applications to improve efficiency, reliability, and performance. Ensuring the quality of code through unit testing, integration testing, and code reviews will be a key part of your responsibilities. Additionally, you will troubleshoot and resolve complex issues in both production and non-production environments. As a mentor, you will work wit...

Role Overview: An Associate Engineer at Deutsche Bank in Pune, India is responsible for developing and delivering engineering solutions to achieve business objectives. They are expected to be aware of the fundamental engineering principles of the Bank and develop root cause analysis skills by addressing product enhancements and fixes. The focus is on building reliability and resiliency into solutions through early testing, peer reviews, and automating the delivery lifecycle. Key Responsibilities: - Designing and developing software applications as a Software Engineer - Collaborating with Team Leads, Software Development Managers, and key stakeholders to ensure high-quality, maintainable, sca...

Senior ML Engineer Experience: 4+ years | Location: Bengaluru (Hybrid) Akaike Technologies is a dynamic and innovative AI-driven company dedicated to building impactful solutions. Our mission is to empower businesses by harnessing the power of data and AI to drive growth, efficiency, and value. We foster a culture of collaboration, creativity, and continuous learning. Job Description: Focus on PySpark, Databricks & Real-time ML Pipelines We are seeking an experienced and highly skilled Senior Data Scientist to join our team in Bengaluru. This role focuses on driving innovative, large-scale solutions using cutting-edge Classical Machine Learning, PySpark , Spark SQL , and Generative AI. The i...

Role Overview: As a Lead Spark Scala Engineer under ICG TTS Operations Technology (OpsTech) Group, you will be responsible for developing and optimizing production-grade Spark applications in Scala. Your role will involve providing technical leadership, conducting code reviews, enforcing best practices, and optimizing performance. Your expertise in Spark, Scala, RDBMS, CI/CD tools, and other relevant technologies will be crucial in contributing to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization. - Provide technical lea...

Role Overview: As a Solutions Architect at Koantek, you will collaborate with customers to design scalable data architectures utilizing Databricks technology and services. You will build secure, highly scalable big data solutions to achieve tangible, data-driven outcomes while focusing on simplicity and operational effectiveness. Leveraging your technical expertise and business acumen, you will engage in complex technology discussions, demonstrating the value of the Databricks platform throughout the sales process. Working with Account Executives, you will interact with customers" technical leaders to become a trusted advisor who delivers concrete outcomes. This role involves collaborating w...

Role Overview: You will be working as a Lead Spark Scala Engineer under ICG TTS Operations Technology (OpsTech) Group to assist in the implementation of the next generation Digital Automation Platform and Imaging Workflow Technologies. Your role will involve managing development teams in the distributed systems Eco-System and collaborating effectively as a team player. Your primary objective will be to contribute to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization. - Provide technical leadership and guidance to a team o...

Role Overview: You are a seasoned Data/Information Management Senior Analyst with in-depth disciplinary knowledge and expertise. You will contribute to the development of new techniques, improve processes, and workflows within the area or function. Your role involves integrating subject matter expertise and industry knowledge within a defined area. You must have a deep understanding of how different areas integrate within the sub-function, coordinate effectively, and contribute to the function's objectives and overall business goals. Your analytical skills will be crucial in filtering, prioritizing, and validating complex material from multiple sources. Excellent communication, diplomacy, an...

Job Description: As a Spark Expert, you will be required to demonstrate expert proficiency in Spark and possess the ability to design and implement efficient data processing workflows. Your experience with Spark SQL and DataFrames, along with a good exposure to Big Data architectures and understanding of the Big Data ecosystem, will be crucial. Additionally, your expertise in framework building on Hadoop, strong DB knowledge with SQL tuning experience, and familiarity with Python APIs and exposure to Kafka will be valuable assets. Key Responsibilities: - Demonstrate expert proficiency in Spark - Design and implement efficient data processing workflows - Utilize Spark SQL and DataFrames effec...

Role:AWS Data Engineering Experience: 6-15 Years Relevant Experience in AWS Data Engineer:5+ Years Notice Period: Immediate Joiners Only Job Location: Bangalore,Pune and Mumbai Role & responsibilities Core skills : Spark SQL/PLSQL, DBT, Python OOP, AWS, Docker/Kubernetes Unix Shell Scripting Should be responsible for designing, building, and maintaining data infrastructure, supporting data transformation and analysis at scale. - Should play a critical role in enabling data-driven decision-making processes across the company - Should have strong background in data engineering, with extensive experience in DBT, Spark SQL, and managing containerized applications with Kubernetes. - Should have w...

Job Requirements • Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 10+ years work experience). • At least 7+ years of consulting or client service delivery experience on Azure Microsoft data engineering. • At least 5+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Synapse/Azure Databricks, Microsoft Fabric • Hands-on experience implementing data ingestion, ETL and data processing using Azure services: Fabric, one lake, ADLS, Azure Data Factory, Azure Functions, services in Microsoft Fabric etc. • Minimum of 5+ ye...

As a Data Engineer specializing in supply chain applications at NovintiX in Coimbatore, India, you will play a crucial role in enhancing our Supply Chain Analytics team. Your primary focus will be on developing intelligent data solutions that drive real-world logistics, procurement, and demand planning. Your responsibilities will include: - Creating and optimizing scalable data pipelines for inventory, shipping, and procurement data - Integrating data from ERP, PLM, and external sources through the development of APIs - Designing, building, and maintaining enterprise-grade data warehouses and data lakes while ensuring data quality, integrity, and security - Collaborating with stakeholders to...

We are hiring for one of the big 4 Requirement Details Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 4+ years work experience). At least 3+ years of consulting or client service delivery experience on Azure Microsoft data engineering. At least 1+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Synapse/Azure Databricks, Microsoft Fabric Hands-on experience implementing data ingestion, ETL and data processing using Azure services: Fabric, onelake, ADLS, Azure Data Factory, Azure Functions, services in Microsoft Fa...

As a skilled PySpark Developer with 4-5 or 2-3 years of experience, you will be responsible for developing and maintaining data processing pipelines using PySpark, Apache Spark's Python API. You will collaborate closely with data engineers, data scientists, and stakeholders to design and implement scalable and efficient data processing solutions. Key Responsibilities: - Designing, developing, and maintaining PySpark data processing pipelines to handle large volumes of structured and unstructured data - Collaborating with data engineers and data scientists to understand data requirements and create efficient data models and transformations - Optimizing and tuning PySpark jobs for improved per...

As a skilled Senior Engineer at Impetus Technologies, you will utilize your expertise in Java and Big Data technologies to design, develop, and deploy scalable data processing applications. Your responsibilities will include collaborating with cross-functional teams, developing high-quality code, and optimizing data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows with frameworks like Hadoop and Spark. - Collabora...

As a Pre-Sales Solution Engineer in India, your role will involve engaging with customers in the evaluation process, conducting product demonstrations, and supporting marketing activities. Your main focus will be on pre-sales experience with software or analytics products, demonstrating expertise in various technical skills and tools such as OLAP, Microsoft Analysis services, data engineering, ETL, Hadoop ecosystem, AWS, Azure, GCP Cluster, Tableau, Microstrategy, BI tools, Hive QL, Spark SQL, PLSQL, TSQL, SQL programming, MDX queries, Linux, Python, Java, and JavaScript. Key Responsibilities: - Act as the primary point of contact for customer interactions - Handle product demonstrations for...

You are ready to gain the skills and experience required to grow within your role and advance your career. As a Software Engineer II at JPMorgan Chase in the consumer & Community Banking Team, you will be part of an agile team dedicated to enhancing, designing, and delivering software components for the firm's state-of-the-art technology products in a secure, stable, and scalable manner. Your responsibilities will include executing software solutions, design, development, and technical troubleshooting with the ability to think beyond routine approaches. You will also be accountable for producing secure and high-quality production code and ensuring design constraints are met by software code ...

Senior MSBI Developer | Arise TechGlobal | Vizag / Hyderabad | Company: Arise TechGlobal Client: Mouri Tech Role: Senior MSBI Developer Experience: 7+ Years Work Mode: WFO Locations: Vizag & Hyderabad Employment Type: Permanent Job Description Arise TechGlobal is hiring a Senior MSBI Developer with strong experience in SSIS, SSAS, T-SQL, and Databricks for a permanent role. The position offers an excellent opportunity to work with a leading global client (Mouri Tech) on advanced BI and cloud data engineering initiatives. Key Responsibilities Design, develop, and maintain MSBI components including SSIS packages , SSAS cubes/models , and advanced T-SQL queries. Build and optimize ETL workflows...

As a Data Engineer at RBHU, you will play a crucial role in developing data-driven solutions to empower decision-making. Working at the intersection of Data, AI, and Analytics, you will be responsible for maintaining and optimizing ETL/ELT pipelines using Databricks. Your key responsibilities will include: - Developing, maintaining, and optimizing ETL/ELT pipelines using Databricks. - Integrating data from multiple sources into scalable and reliable data solutions. - Implementing data transformations, cleansing, and enrichment processes. - Collaborating closely with data analysts, data scientists, and business teams to deliver analytics-ready datasets. - Ensuring data quality, performance, a...

As a Solution Designer at Data Bricks in Melbourne, your role involves utilizing your 12+ years of experience in Data Lake and Azure Data Bricks to design and deploy Databricks platforms on AWS, Azure, or Google Cloud. Your responsibilities will include building and deploying data engineering pipelines into production, following automation best practices for CI/CD and guiding clients in implementing transformational big data projects. You will be involved in end-to-end development and deployment of industry-leading big data and AI applications, working in Scrum Agile Technical environment and streamlining the customer machine learning lifecycle while integrating it with the data platform. Ad...