74 Sparksql Jobs - Page 2

What this job involves: JLL, an international real estate management company, is seeking an Data Engineer to join our JLL Technologies Team. We are seeking candidates that are self-starters to work in a diverse and fast-paced environment that can join our Enterprise Data team. We are looking for a candidate that is responsible for designing and developing of data solutions that are strategic for the business using the latest technologies Azure Databricks, Python, PySpark, SparkSQL, Azure functions, Delta Lake, Azure DevOps CI/CD. Responsibilities Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed b...

What this job involves: JLL, an international real estate management company, is seeking an Data Engineer to join our JLL Technologies Team. We are seeking candidates that are self-starters to work in a diverse and fast-paced environment that can join our Enterprise Data team. We are looking for a candidate that is responsible for designing and developing of data solutions that are strategic for the business using the latest technologies Azure Databricks, Python, PySpark, SparkSQL, Azure functions, Delta Lake, Azure DevOps CI/CD. Responsibilities Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements. D...

What this job involves: JLL, an international real estate management company, is seeking an Data Engineer to join our JLL Technologies Team. We are seeking candidates that are self-starters to work in a diverse and fast-paced environment that can join our Enterprise Data team. We are looking for a candidate that is responsible for designing and developing of data solutions that are strategic for the business using the latest technologies Azure Databricks, Python, PySpark, SparkSQL, Azure functions, Delta Lake, Azure DevOps CI/CD. Responsibilities Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements. D...

The position is for a Full Time job with rotational shifts based in Nagpur, Pune, or Bangalore. We are looking to fill 4 positions with candidates who have 5 to 8 years of experience. As an AWS Data Engineer, you will be responsible for leading development activities for the Data engineering team. You will collaborate with other teams such as application management and product delivery, working closely with technical leads, product managers, and support teams. Your role will involve providing guidance to the development, support, and product delivery teams. Additionally, you will lead the implementation of tools and technologies to drive cost-efficient architecture and infrastructure. On the...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of yourself. We're counting on your unique voice and perspective to help EY become even better. Join us and build an exceptional experience for yourself, and a better working world for all. EY's Data n Analytics team is a multi-disciplinary technology team delivering client projects and solutions across Data Management, Visualization, Business Analytics, and Automation, covering a wide range of countries and industry sectors. As an Associate Manager - Data Engineering, your main objective will be to support cloud and on-prem platfo...

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality, and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer, you should have experience with: - Hands-on experience in PySpark and strong knowledge of Dataframes, RDD, and SparkSQL. - Hands-on experience in developing, testing, and maintaining applications on AWS Cloud. - Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambd...

The ideal candidate for this role should have a minimum of 5+ years of experience in designing Azure data lakes using tools such as Databricks, PySpark, and SparkSQL. Additionally, the candidate should possess hands-on experience working with Azure SQL Server and other Azure services like Function App, Event Hub, and Encryption/Decryption mechanisms. The successful candidate should have a proven track record of working on large and cutting-edge projects, leading cloud transformation initiatives, and managing operations effectively. They will be responsible for owning the technical architecture and providing guidance to clients on the direction of their projects. Key responsibilities will inc...

Genpact is a global professional services and solutions firm with over 125,000 employees in 30+ countries, driven by curiosity, agility, and a commitment to creating value for clients. We serve leading enterprises worldwide, leveraging our expertise in digital operations, data, technology, and AI. We are seeking a Lead Consultant- Databricks Developer to solve cutting-edge problems and meet functional and non-functional requirements. As a Databricks Developer, you will work closely with architects and lead engineers to design solutions and stay abreast of industry trends and standards. Responsibilities: - Stay updated on new technologies for potential application in service offerings. - Coll...

At Capgemini Invent, we believe in the power of diversity to drive change. As inventive transformation consultants, we leverage our strategic, creative, and scientific capabilities to collaborate closely with clients in delivering cutting-edge solutions. Join our team to lead transformation initiatives tailored to address both current challenges and future opportunities. Our approach is informed and validated by science and data, supercharged by creativity and design, and supported by purpose-driven technology. We are seeking a candidate with strong expertise in SSAS Tabular Model, proficient in DAX queries and query optimization, adept at resolving performance issues, database tuning, and d...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself and a better working world for all. EY's Data n Analytics team is a multi-disciplinary technology team delivering client projects and solutions across Data Management, Visualization, Business Analytics, and Automation. The assignments cover a wide range of countries and industry sectors. We're looking for a Manager - Data Engineering. The main objective of the role is to suppor...

You will be working as a full-time on-site Databricks Developer in Hyderabad. Your responsibilities will include designing, developing, and maintaining highly scalable efficient data pipelines using Databricks, PySpark, and other related technologies to process large-scale datasets. Collaboration with cross-functional teams to design and implement data engineering and analytics solutions will be a key part of your role. To excel in this role, you should have expertise in using Unity Catalog and Metastore, optimizing Databricks notebooks, delta lake, and DLT pipelines. You should also be experienced in using Databricks SQL, implementing highly configured data processing solutions, and solutio...

As a Senior Azure Data Engineer, your responsibilities will include: Building scalable data pipelines using Databricks and PySpark Transforming raw data into usable business insights Integrating Azure services like Blob Storage, Data Lake, and Synapse Analytics Deploying and maintaining machine learning models using MLlib or TensorFlow Executing large-scale Spark jobs with performance tuning on Spark Pools Leveraging Databricks Notebooks and managing workflows with MLflow Qualifications: Bachelors/Masters in Computer Science, Data Science, or equivalent 7+ years in Data Engineering, with 3+ years in Azure Databricks Strong hands-on in: PySpark, Spark SQL, RDDs, Pandas, NumPy, Delta Lake Azur...

You should hold a Bachelors or higher degree in Computer Science or a related discipline, or possess equivalent qualifications with a minimum of 4+ years of work experience. Additionally, you should have at least 1+ years of consulting or client service delivery experience specifically related to Azure Microsoft Fabric. Your role will involve 1+ years of experience in developing data ingestion, data processing, and analytical pipelines for big data. This includes working with relational databases like SQL server and data warehouse solutions such as Synapse/Azure Databricks. You must have hands-on experience in implementing data ingestion, ETL, and data processing using various Azure services...

You are a PySpark Developer with 3-8 years of experience and have expertise in Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, and Python. Your professional background includes working with Bigdata technologies like PySpark, HIVE, Hadoop, and PLSQL. You also possess a good understanding of AWS, Snowflake, CICD, and system design. It would be advantageous if you have prior experience in Fund transfer AML technologies. Strong communication skills, both written and verbal, are essential for this role. As a self-starter, you should have quick learning abilities and the capability to multitask effectively, even under stringent deadlines. You must be adept at understanding and working on variou...

The role of Scala Spark Developer requires 3-8 years of experience and can be based in Chennai or Pune with any notice period. As a Scala Spark Developer, you will need to have expertise in Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, and Scala. You should possess a minimum of 5 years of Scala+Spark experience, demonstrating hands-on experience in designing and developing big data platforms. Your responsibilities will include working on data engineering projects, utilizing modern data processing technology stacks such as Spark, HBase, Hive, and other Hadoop ecosystem technologies. You will be expected to have a deep understanding of streaming data architectures for real-time and low-la...

MongoDB's mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB Atlas, is the only globally distributed, multi-cloud database and is available in more than 115 regions across AWS, Google Cloud, and Microsoft Azure. Atlas allows customers to build and run applications anywhereon premises, or across cloud providers. With offices worldwide and over 175,000 new developers signing up to use MongoDB every mont...

As a Software Developer at our organization, you will be responsible for independently designing components, developing code, and testing case scenarios using Talend on Big Data while adhering to relevant software craftsmanship principles and meeting acceptance criteria. Your role will also involve completing the assigned learning path, participating in team ceremonies such as agile practices, and delivering on all aspects of the Software Development Lifecycle (SDLC) in-line with Agile and IT craftsmanship principles. You will be expected to deliver high-quality clean code and designs that can be re-used, collaborate with other development teams to define and implement data pipelines, and en...

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer, you should have experience with hands-on experience in pyspark and strong knowledge of Dataframes, RDD, and SparkSQL. Additionally, experience in developing, testing, and maintaining applications on AWS Cloud is crucial. A strong hold on the AWS Data Analytics Technology Stack (G...

About the job: At Citi, we're not just building technology, we're building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with a laser focus on evolving the ways of doing things. As one of the world's most global banks, we're changing how the world does business. Shape your Career with Citi We're currently looking for a high-caliber professional to join our team as AVP- Data Engineer based in Pune, India. Being part of our team means that we'll provide you with the resources to meet your unique needs, empower you to make healthy ...

You are a Staff Software Engineer (ETL) with 8-10 years of experience looking to join R1's ETL Development team. In this role, you will play a crucial part in designing, developing, and leading the implementation of ETL processes and data architecture solutions. Reporting to the Engineering Manager, you will be responsible for planning, designing, and implementing a centralized data warehouse solution for data acquisition, ingestion, large data processing, and automation/optimization across all company products. Your key responsibilities will include leading the design and architecture of ETL processes and data integration solutions, developing and maintaining ETL workflows using tools like ...

As a Test Engineer, you will be responsible for supporting the AI & Data science teams in testing their AI/ML flows. You will analyze system specifications, develop detailed test plans and test cases, execute test cases, and identify defects. Your role includes documenting and reporting defects to the development team, collaborating with them to resolve issues, and ensuring that the software meets quality standards and best practices. Participation in review meetings to provide feedback is also part of your responsibilities. It is essential to have excellent knowledge of SDLC and STLC, along with expertise in Agile methodology. Your technical skills should include a strong understanding of T...

As a valued member of Infosys Consulting, you will play a crucial role in supporting large Oil & Gas/Utilities prospects by showcasing Infosys" unique value proposition through practical use cases across the value chain. Your responsibilities will include gathering, identifying, and documenting business requirements, as well as creating functional specifications for new systems and processes. Utilizing your expertise in assessing current processes, conducting gap analyses, and designing future processes, you will recommend changes and drive continuous improvement using methodologies such as Six Sigma and Lean. In your role, you will be involved in Technology Project Management, which include...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. We are counting on your unique voice and perspective to help EY become even better. Join us and build an exceptional experience for yourself, and a better working world for all. We are seeking a highly skilled and motivated Data Analyst with experience in ETL services to join our dynamic team. As a Data Analyst, you will be responsible for data requirement gathering, preparing data requirement artefacts, data integration strategies, data quality, data cleansing, optimizing data pipelines, and solutions that support business ...

You should have strong experience in PySpark, Python, Unix scripting, SparkSQL, and Hive. You must be proficient in writing SQL queries, creating views, and possess excellent oral and written communication skills. Prior experience in the Insurance domain would be beneficial. A good understanding of the Hadoop Ecosystem including HDFS, Map Reduce, Pig, Hive, Oozie, and Yarn is required. Knowledge of AWS services such as Glue, AWS S3, Lambda function, Step Function, and EC2 is essential. Experience in data migration from platforms like Hive/S3 to Data Bricks is a plus. You should be able to prioritize, plan, organize, and manage multiple tasks efficiently while delivering high-quality work. As...

Data Engineer 3 to 6 yrs 1. Excellent Programming skills in Python with object oriented design 2. Strong programming skills with Pyspark, SparkSQL 3. Hands on experience in working with relational database like SQL, postgres database 4. Hands on experience on developing solutions on Big Data Clusters like MAPR Clusters or on cloud platform like Azure 5. Experience on working with Azure Databricks, Azure Data Factory is an added advantage 6. Deployment experience with Dockers and Kubernetes is an added advantage 7. Excellent logical , analytical and problem solving skills 8. Strong communication skills