50049 Spark Jobs - Page 38

Description Job Title : Databricks Architect Location : : 10-15 years of overall experience and 5+ years in Data Architecture Budget : Open to discuss Notice Period : Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 days About The Role We are seeking a seasoned Databricks Architect with 10-15 years of overall experience and 5+ years in Data Architecture to lead the design and implementation of scalable, cloud-native data platforms. You will drive technical strategy, define Lakehouse architecture standards, and guide engineering teams in building high-performance data solutions. Key Responsibilities Architect and implement enterprise-scale data platforms using Da...

At ClearTrail, you will be part of a team dedicated to developing solutions that empower those focused on ensuring the safety of individuals, locations, and communities. For over 23 years, ClearTrail has been a trusted partner of law enforcement and federal agencies worldwide, committed to safeguarding nations and enhancing lives. We are leading the way in the future of intelligence gathering through the creation of innovative artificial intelligence and machine learning-based lawful interception and communication analytics solutions aimed at addressing the world's most complex challenges. As a Big Data Java Developer at ClearTrail, your responsibilities will include: - Designing and develop...

About The Role We are seeking a AI Engineer to join our team and play a critical role in the design and develop a cognitive data solution. The broader vision is to develop an AI-based platform that will crawl through unstructured data sources and extract meaningful information. The ideal candidate will possess full-stack development skills along with a strong understanding of database structures, SQL queries, ETL tools and Azure data technologies. Key Responsibilities Implement Architecture and design from definition phase to go-live phase. Work with the business analyst and SMEs to understand the current landscape priorities. Define conceptual and low-level model of using AI technology. Rev...

Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate...

As a Staff Software Engineer (Java) at Walmart Global Tech in Chennai, you will be responsible for guiding the team in making architectural decisions and implementing best practices for building scalable applications. Your role will involve driving design, development, and documentation, as well as building, testing, and deploying cutting-edge solutions that impact associates of Walmart worldwide. Collaboration with Walmart engineering teams globally, engagement with Product Management and Business to drive the agenda, and working closely with Architects and cross-functional teams to deliver solutions meeting Quality, Cost, and Delivery standards are crucial aspects of this role. **Key Respo...

As a Data Engineer at Synram Software Services Pvt. Ltd., a subsidiary of FG International GmbH, you will play a crucial role in delivering innovative IT solutions across various industries. You will work on designing, building, and maintaining scalable data pipelines and infrastructure to facilitate data-driven decision-making throughout the organization. Your key responsibilities in this role will include: - Developing, testing, and maintaining data architectures - Designing and implementing ETL processes - Optimizing data systems - Collaborating with cross-functional teams to understand data requirements - Ensuring data quality, integrity, and security - Automating repetitive data tasks -...

Position Overview Job Title: Senior Engineer, AVP Location: Pune, India Role Description An Engineer is responsible for designing, developing and support a strategic US Finance Regulatory Reporting platform for the Bank. Join us and you will be on the front lines of transformation for this domain - leveraging cutting edge open-source technologies and highly collaborative agile processes to deliver valuable business solutions that you can be proud of. You will share your passion for technical excellence and engage the full depth of your engineering skills in a diverse cross functional team that partners with business and technology experts globally to develop innovative solutions to complex b...

We are looking for a skilled Python Developer with experience in Pandas/NumPy to join our dynamic team. The ideal candidate should have a strong background in backend development, data manipulation, and API development. Preferably, the candidate should have hands-on experience with AI/ML technologies, enabling them to work on intelligent and data-driven applications. Key Responsibilities Develop, maintain, and optimize data-driven applications using Python and Pandas/NumPy. Design and implement RESTful APIs and integrate third-party services. Work with relational and non-relational databases such as PostgreSQL, MySQL, or MongoDB. Implement scalable backend architectures with security and per...

Role Overview: As a Sr. Data Scientist at Amgen, your primary responsibility will be to develop, design, and deploy AI-enabled forecasting models. You will have the opportunity to apply your deep technical expertise from data ingestion to model deployment to scale forecasting models across R&D, Manufacturing, and Commercial for critical needs. Additionally, you will play an integral part in a high-performing team of data scientists and engineers, translating machine learning algorithms into effective forecasting solutions. Key Responsibilities: - Be an integral part of a team focused on translating machine learning algorithms into effective forecasting solutions - Perform exploratory and tar...

Role Description This is a full-time hybrid internship based in Mumbai, with flexibility for some remote work. You will support our marketing and founder team in creating engaging visuals that match LIVE LOVE TRIP’s brand and travel storytelling. Selected Intern's Day-to-day Responsibilities Include Video editing for reels, travel films, ads, and lifestyle brand visuals. Designing visual assets and marketing creatives when required. Colour grading, basic motion graphics, and graphics design tasks, wherever applicable. Delivering clean, high-quality content consistently and on schedule. Contributing ideas, concepts, and design directions during team discussions. Working on official paid softw...

Position : Data Architect Location: Pune Experience Required: 8 -10 Years Roles & Responsibilities Design and implement scalable data architectures and pipelines Develop conceptual, logical, and physical data models Build & optimize Data Lakes / Data Warehouses Work on cloud platforms (AWS/Azure/GCP) Ensure data governance, security, and quality Collaborate with engineering, analytics, and business teams Mandatory Skills Strong Data Modeling experience SQL & NoSQL databases ETL/ELT & data pipeline development Big Data technologies (Hadoop, Spark, Kafka) Cloud data platforms (AWS/Azure/GCP) Data Governance, MDM, Metadata Management If you're interested, please reply with your details with upd...

As a Healthcare CCDA and FHIR Subject Matter Expert (SME) based in Chennai & Pune, you will play a crucial role in loading, transforming, and validating CCDA and FHIR data within clinical data repositories. Your responsibilities will include: - Lead the ingestion, parsing, and transformation of CCDA and FHIR resources into enterprise data platforms or Clinical Data Repositories (CDR). - Map and validate CCDA elements (e.g., encounters, allergies, medications, immunizations) to FHIR resources. - Design and implement data pipelines to load structured and semi-structured healthcare data (CCDA, FHIR, HL7) into target systems. - Collaborate with Data Engineering teams to ensure efficient and scal...

As a Senior Data Scientist at AuxoAI, you will be responsible for designing, deploying, and scaling production-grade ML systems. Your expertise in AI, machine learning engineering (MLE), and generative AI will be crucial in this role. You will have the opportunity to work on large language model (LLM)-based pipelines, AI copilots, and agentic workflows. This position is perfect for someone who enjoys combining cutting-edge research with production rigor and is passionate about mentoring while creating impactful AI applications. Your key responsibilities will include: - Owning the full ML lifecycle: from model design to training, evaluation, and deployment - Designing production-ready ML pipe...

As an engineer at Coupang, you will be part of the Global Operations Technology team, focusing on providing the best product experience for customers by leveraging cutting-edge technology. Your role involves architecting and designing large-scale systems, developing deep learning models, and training foundational models to enhance customer scenarios. You will work on NLP, LLM, ML, and software engineering at scale to deliver optimal technical solutions for an exceptional customer experience. Key Responsibilities: - Architect and design large scale inference, recommendation, and interactive agents system - Develop deep learning generative models and models for multi-modal eCommerce scenarios ...

You will be responsible for developing Risk Segmentation models using sophisticated statistical techniques such as CHAID, cluster analysis, and pattern recognition. These models will help in identifying credit abuse and first party fraud risks at Acquisition and Existing Customer Management stages. Additionally, you will work on establishing swap set analysis and P&L optimization using these models and have hands-on experience in Credit/Fraud Risk strategy development. - Preferred knowledge of credit/fraud risk analytics is required for this role. - Collaborate closely with cross-functional teams, including business stakeholders, MRM, governance teams, and strategy implementation teams. - Im...

Job Description Design and implement large-scale, fault-tolerant data pipelines on OCI, using services like OCI Data Integration, OCI Data Flow (Apache Spark), Object Storage, and Autonomous Database. Build and manage streaming data architectures using tools such as OCI GoldenGate, Apache Kafka, and Spark/Flink Streaming. Enforce standards and automation across the entire data lifecycle, including schema evolution, dataset migration, and deprecation strategies. Improve platform resilience, data quality, and observability with advanced monitoring, alerting, and automated data governance. Serve as a technical leader, mentoring junior engineers, reviewing designs and code, and promoting enginee...

**Job Description:** As an AI/ML Engineer at D Square Consulting Services Pvt Ltd in Bangalore, you will play a crucial role in leading the end-to-end design, development, and deployment of advanced AI/ML solutions for digital marketing and analytics. Your responsibilities will include driving innovation, leveraging cutting-edge techniques, and standardizing multi-cloud model deployment through collaboration to deliver profound data insights. **Key Responsibilities:** - Lead cross-functional teams to deliver and scale complex AI/ML solutions - Architect, design, develop, train, and evaluate high-performance AI/ML models - Drive implementation, deployment, and maintenance of AI/ML solutions -...

As a Strong Dremio / Lakehouse Data Architect, you will have the following responsibilities: - Deep experience with cloud object storage (S3 / ADLS / GCS) and file formats such as Parquet, Delta, Iceberg along with distributed query planning concepts. - Hands-on experience integrating data via APIs, JDBC, Delta/Parquet, object storage, and coordinating with data engineering pipelines (Airflow, DBT, Kafka, Spark, etc.). - Proven experience designing and implementing lakehouse architecture including ingestion, curation, semantic modeling, reflections/caching optimization, and enabling governed analytics. - Strong understanding of data governance, lineage, RBAC-based access control, and enterpr...

Role: Data Engineer (Spark | SQL | Big Data Pipelines) Location: Bengaluru, India (3 days Onsite/week) Must Have: Spark, SparkSQL, Data Streaming/Batch Processing, HDFS, Kafka Streaming Note : We’re specifically looking for immediate joiners or candidates who are ready to start immediately or with a very short notice period. Must be Local to Bengalore and comfortable working on Hybrid Model. About the Role We are looking for a Data Engineer with 3–5 years of hands-on experience in building and optimizing data pipelines using Apache Spark and SQL . The ideal candidate will have a solid understanding of batch data processing, Data Streaming , data reliability, and performance optimization. You...

Job Description Design and implement large-scale, fault-tolerant data pipelines on OCI, using services like OCI Data Integration, OCI Data Flow (Apache Spark), Object Storage, and Autonomous Database. Build and manage streaming data architectures using tools such as OCI GoldenGate, Apache Kafka, and Spark/Flink Streaming. Enforce standards and automation across the entire data lifecycle, including schema evolution, dataset migration, and deprecation strategies. Improve platform resilience, data quality, and observability with advanced monitoring, alerting, and automated data governance. Serve as a technical leader, mentoring junior engineers, reviewing designs and code, and promoting enginee...

As a Software Engineer II on the enterprise-wide Data Platform team at Pune, India, your focus will be on automating infrastructure, streamlining deployment processes, and improving system reliability. You will work closely with senior engineers to build and maintain DevOps pipelines, monitor distributed systems, and support platform operations using technologies like NiFi, Spark, MinIO, Kubernetes, Airflow, and cloud-native tools. **Key Responsibilities:** - Develop and maintain CI/CD pipelines for automated deployment and testing of data platform components. - Automate infrastructure provisioning and configuration using tools like Chef, XLR, etc. - Monitor system health and performance usi...

Role: Senior Front-End Developer Position Type: Full-Time Contract (40hrs/week) Contract Duration: 6 Months+ Work Hours: 11am – 7:00pm IST Work Schedule: 8 hours/day (Mon-Fri) Location: 100% Remote We’re seeking a Senior Front-End Developer with strong hands-on experience in React.js, Spring Boot, API integration , and backend database handling . The ideal candidate can work independently in complex environments , build responsive UIs, and collaborate effectively with backend teams in an Agile setup. Key Responsibilities: • Develop and enhance UI components for dashboards interacting with Databricks data. • Collaborate with cross-functional teams throughout design, development, and testing p...

As an Associate Product Support Engineer focused on Hadoop distributed systems, your role will involve providing technical support to enterprise clients. You will be responsible for troubleshooting and resolving issues within Hadoop environments to ensure the stability and reliability of customers" infrastructures. Working closely with experienced engineers, you will collaborate with customers to understand their problems and deliver effective solutions with empathy and professionalism. Key Responsibilities: - Address customer issues related to Hadoop clusters and core components such as HDFS, YARN, MapReduce, Hive, etc. - Perform basic administrative tasks including installation, configurat...

Role Overview: You will be responsible for designing and leading the architecture, training pipelines, and deployment of production-grade machine learning models that power real-world logistics operations. As the Founding AI Architect at Frontier Logistics AI Model, you will play a crucial role in building the next generation of intelligent logistics infrastructure. Key Responsibilities: - Design and implement AI/ML architectures for forecasting and logistics optimization. - Develop production-grade, real-time inference systems for large-scale data. - Build scalable training pipelines and establish MLOps workflows for retraining and monitoring. - Integrate ML models into operational systems ...

Role Overview: You will be responsible for fetching and transforming data from various systems, conducting in-depth analyses to identify gaps, opportunities, and insights, and providing recommendations that support strategic business decisions. Key Responsibilities: - Data Extraction and Transformation: - Fetch data from multiple systems, transform it to create a unified dataset, and ensure data accuracy. - Data Analysis and Insight Generation: - Analyze large datasets to identify patterns, gaps, and trends. - Develop actionable insights and recommendations that support business objectives. - Visualization and Reporting: - Create impactful visualizations and reports to effectively communicat...