530 Apache Spark Jobs - Page 15

Data Modular: JD details Work Location: Bangalore/Chenna/Hyderabad/Gurgaon/Pune Mode of work: Hybrid Exp Level- 7+ Years Looking only for immediate joiners. Experience with RDBMS, No-SQL (Columnar DB like Apache Parquet, Apache Kylin or alike) - Query optimization, performance tuning, caching and filtering strategies. Experience with Data lakes and faster retrieving processes and techniques Dynamic data modelling - enable updated data models based on underlying data Caching and filtering techniques on data Experience with Apache Spark or similar big data technologies Knowledge on AWS - IaaC implementation SQL transpilers and predicate pushing The top layer is GraphQL - good to have

Changing the world through digital experiences is what Adobe is all about. We give everyone - from emerging artists to global brands - everything they need to design and deliver exceptional digital experiences! We are passionate about empowering people to create beautiful and powerful images, videos, and apps, transforming how companies interact with customers across every screen. We are on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours! Role Summary: Digital Experi...

The Applications Development Group Manager is a senior management level position responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology Team. The overall objective of this role is to drive applications systems analysis and programming activities. Manage multiple teams of professionals to accomplish established goals and conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions). Provide strategic influence and exercise control over resources, budget management and planning while monitoring end results....

As an Individual Contributor at Adobe RTCDP, you will play a crucial role in the development of features of medium to large complexity. You will leverage your in-depth knowledge to transform requirements into feature specifications. Collaborating with product management and Engineering leads, you will contribute significantly to the analysis, design, prototype, and implementation of new features, as well as enhancements to existing ones. As a proactive self-starter and fast learner, you will be responsible for developing methods, techniques, and evaluation criteria to achieve desired results. Ensuring high-quality code and related documentation will be a key part of your responsibilities. To...

As a Software Engineer (A2), your main responsibilities will revolve around designing and developing AI-driven data ingestion frameworks and real-time processing solutions to enhance data analysis and machine learning capabilities across the full technology stack. You will be tasked with deploying, maintaining, and supporting application codes and machine learning models in production environments while ensuring seamless integration with front-end and back-end systems. Additionally, you will create and improve AI solutions that facilitate the smooth flow of data across the data ecosystem, enabling advanced analytics and insights for end users. Your role will also involve conducting business ...

The Applications Development Senior Programmer Analyst position is an intermediate level role where you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Your responsibilities will include conducting tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establishing and implementing new or revised applications systems and programs to meet specific business needs or user areas. You will...

As an individual contributor at P50 level, you will have the opportunity to work with our engineering team on developing the Adobe Experience Platform. This platform offers innovative data management and analytics solutions. Our focus is on building a reliable and resilient system at a large scale, utilizing Big Data and open-source technologies for Adobe's services. You will be responsible for managing disparate data sources and ingestion mechanisms across geographies, ensuring that the data is easily accessible at very low latency to support various scenarios and use cases. We are looking for candidates with deep expertise in building low latency services at high scales to lead us in accom...

As a Senior Backend Engineer with 7 to 10 years of experience, you will be responsible for developing backend systems and APIs using Python programming. You should have a strong understanding of Cloud platforms such as AWS or GCP and be proficient in CI/CD, Docker, and Linux. Your expertise in microservices architecture will be crucial for designing scalable and efficient systems. The ideal candidate will have hands-on experience with Cloud platforms like GCP or AWS and a good command of Python programming. Additionally, familiarity with data pipelines tools such as Airflow or Netflix Conductor would be advantageous. Experience working with Apache Spark/Beam and Kafka will be considered a pl...

At PwC, the focus is on leveraging data to drive insights and make informed business decisions in the field of data and analytics. The team utilizes advanced analytics techniques to help clients optimize their operations and achieve strategic goals. As a Data Analyst at PwC, your role will involve utilizing advanced analytical techniques to extract insights from large datasets and facilitate data-driven decision-making. Your responsibilities will include data manipulation, visualization, and statistical modeling to support clients in solving complex business problems. With a minimum of 12 years of hands-on experience, you will be responsible for designing and implementing scalable, secure, a...

The role of a software engineer in Corporate Planning and Management (CPM) involves providing engineering solutions that facilitate budget planning, financial forecasting, expense allocation, spend management, third-party risk assessment, and aiding in corporate decision-making aligned with strategic goals. As a member of the CPM Engineering team, you will play a pivotal role in creating and enhancing financial and spend management workflows, as well as developing intelligent reporting mechanisms to drive commercial benefits for the organization. In this dynamic role, you will have the opportunity to combine your software engineering expertise with an understanding of finance, thereby contri...

Role Senior Databricks Engineer As a Mid Databricks Engineer, you will play a pivotal role in designing, implementing, and optimizing data processing pipelines and analytics solutions on the Databricks platform. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable solutions, and ensure the reliability and performance of our data infrastructure. This role requires deep expertise in Databricks, strong programming skills, and a passion for solving complex engineering challenges. What you'll do : - Design and develop data processing pipelines and analytics solutions using Databricks. - Architect scalable and efficient data models and st...

Location- Pune, Mumbai, Nagpur, Goa, Noida, Gurgaon, Ahmedabad, Jaipur, Indore, Kolkata, Kochi, Hyderabad, Bangalore, Chennai,) Experience: 5-7 years Notice: 0-15 days Open position: 6 JD: Proven experience with DataStage for ETL development. Strong understanding of data warehousing concepts and best practices. Hands-on experience with Apache Airflow for workflow management. Proficiency in SQL and Python for data manipulation and scripting. Solid knowledge of Unix/Linux shell scripting. Experience with Apache Spark and Databricks for big data processing. Expertise in Snowflake for cloud data warehousing. Familiarity with version control systems (e.g., Git) and CI/CD pipelines. Excellent prob...

HCLTech is seeking a Data and AI Principal / Senior Manager (Generative AI) for their Noida location. As a global technology company with a workforce of over 218,000 employees in 59 countries, HCLTech specializes in digital, engineering, cloud, and AI solutions. The company collaborates with clients across various industries such as Financial Services, Manufacturing, Life Sciences, Healthcare, Technology, Telecom, Retail, and Public Services, offering innovative technology services and products. With consolidated revenues of $13.7 billion as of the 12 months ending September 2024, HCLTech aims to drive progress and transformation for its clients globally. Key Responsibilities: In this role, ...

As the Vice President of Engineering at Teradata in India, you will be responsible for leading the software development organization for the AI Platform Group. This includes overseeing the execution of the product roadmap for key technologies such as Vector Store, Agent platform, Apps, user experience, and AI/ML-driven use-cases. Your success in this role will be measured by your ability to build a world-class engineering culture, attract and retain technical talent, accelerate product delivery, and drive innovation that brings tangible value to customers. In this role, you will lead a team of over 150 engineers with a focus on helping customers achieve outcomes with Data and AI. Collaborati...

As an Expert Software Engineer Java at SAP, you will play a critical role in leading strategic initiatives within the App2App Integration team in SAP Business Data Cloud. Your primary responsibility will be to accelerate the development and adoption of seamless, low-latency integration patterns across SAP applications and the BDC data fabric. Your expertise in Java, ETL, distributed data processing, Kafka, cloud-native development, and DevOps will be essential in driving architectural direction, overseeing key integration frameworks, and providing hands-on leadership to build real-time, event-driven, and secure communication solutions across a distributed enterprise landscape. In this role, ...

The Lead Data Modeler role involves developing high performance, scalable enterprise data models on a cloud platform. You must possess strong SQL skills along with excellent data modeling expertise, and be well-versed in the Kimball methodology. Your responsibilities include participating in various activities throughout the systems development lifecycle, supporting activities, engaging in POCs, and presenting outcomes effectively. Additionally, you will be responsible for analyzing, architecting, designing, programming, debugging both existing and new products, as well as mentoring team members. It is crucial to take ownership and demonstrate high professional and technical ethics with a co...

As the Product Director at Rakuten Symphony, you will have the opportunity to lead a team of dedicated engineers in the creation of cutting-edge software solutions that cater to the unique requirements of our clients. Leveraging your expertise in Apache Spark, NoSQL databases, relational databases, Spring Framework, and cloud technologies, you will play a pivotal role in driving innovation and tackling intricate technical obstacles. This position necessitates exceptional leadership capabilities, a strategic outlook, and an unwavering commitment to delivering top-notch results. To excel in this role, you will be responsible for overseeing the entire product lifecycle by collaborating closely ...

We’re hiring a Scala Developer with 4+ years of experience in building scalable, high-performance backend systems. Strong in functional programming, backend services, distributed systems, and cloud environments.

Hi, Wishes from GSN!!! Pleasure connecting with you!!! We been into Corporate Search Services for Identifying & Bringing in Stellar Talented Professionals for our reputed IT / Non-IT clients in India. We have been successfully providing results to various potential needs of our clients for the last 20 years. At present, GSN is hiring DATA ENGINEERING - Solution Architect for one of our leading MNC client. PFB the details for your better understanding : 1. WORK LOCATION : PUNE 2. Job Role: DATA ENGINEERING - Solution Architect 3. EXPERIENCE : 13+ yrs 4. CTC Range: Rs. 35 LPA to Rs. 50 LPA 5. Work Type : WFO Hybrid ****** Looking for SHORT JOINERS ****** Job Description : Who are we looking fo...

Role Senior Databricks Engineer As a Mid Databricks Engineer, you will play a pivotal role in designing, implementing, and optimizing data processing pipelines and analytics solutions on the Databricks platform. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable solutions, and ensure the reliability and performance of our data infrastructure. This role requires deep expertise in Databricks, strong programming skills, and a passion for solving complex engineering challenges. What you'll do : - Design and develop data processing pipelines and analytics solutions using Databricks.- Architect scalable and efficient data models and sto...

Role Senior Databricks Engineer As a Mid Databricks Engineer, you will play a pivotal role in designing, implementing, and optimizing data processing pipelines and analytics solutions on the Databricks platform. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable solutions, and ensure the reliability and performance of our data infrastructure. This role requires deep expertise in Databricks, strong programming skills, and a passion for solving complex engineering challenges. What you'll do : - Design and develop data processing pipelines and analytics solutions using Databricks. - Architect scalable and efficient data models and st...

About CLOUDKEEPER: CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier Partner, Azure Technology Consulting Partner, Google,Cloud Partner, and FinOps Foundation Premier Member, CloudKeeper has helped 400+ global companies save an average of 20% on their cloud bills, modernize their cloud set-up and maximize value all while maintaining flexibility and avoiding any long-term commitments or cost. CloudKeeper hived off from TO TH...

The Applications Development Group Manager is a senior management level position responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology Team. The overall objective of this role is to drive applications systems analysis and programming activities. Responsibilities: Manage multiple teams of professionals to accomplish established goals and conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions) Provide strategic influence and exercise control over resources, budget management and planning while monito...

HCLTech is looking for a Data and AI Principal / Senior Manager (Generative AI) to join their team in Noida. As a global technology company with a strong presence in 59 countries and over 218,000 employees, HCLTech is a leader in digital, engineering, cloud, and AI services. They collaborate with clients in various industries such as Financial Services, Manufacturing, Life Sciences, Healthcare, Technology, Telecom, Media, Retail, and Public Services. With consolidated revenues of $13.7 billion, HCLTech aims to provide industry-leading capabilities to drive progress for their clients. In this role, you will be responsible for providing hands-on technical leadership and oversight. This include...

The ideal candidate for the role of People Analytics professional should have a strong background in transforming data into actionable insights to drive evidence-based HR decision-making. You will be responsible for designing, developing, and managing advanced dashboards and data visualizations using tools such as Tableau, Power BI, and other modern BI platforms. Building strong partnerships with key stakeholders across HR and the business is essential to deeply understand their challenges and translate their needs into actionable data solutions. In this role, you will need to develop and implement statistical models and machine learning solutions for HR analytics, while managing end-to-end ...