50049 Spark Jobs - Page 33

Job Title: Data Engineering - Hadoop, SQL, R, or Python, GCP About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will ...

We are seeking an experienced and highly motivated Big Data Developer to drive the development, standardization, and governance of data across our Big Data Portfolio. This role is crucial in ensuring compliance with regulatory mandates, consent orders, and data governance policies, while also optimizing data pipelines and architectures for high-performance applications. The successful candidate will work closely with business stakeholders, data scientists, and engineering teams to establish enterprise-wide data consistency and improve data quality, lineage, and reconciliation processes. The ideal candidate will have a strong background in Big Data technologies, data standardization framework...

Plan, schedule, and publish engaging content on all major social media platforms (Instagram, Facebook, LinkedIn, Twitter, etc.) Create reels, posts, stories, and infographics using Canva or similar tools Respond to messages, comments, and queries in a timely and professional manner Track social media engagement (likes, shares, comments, etc.) and suggest content optimization Collaborate with the design and marketing team to maintain brand consistency Stay updated with current trends, hashtags, and algorithm changes Assist in running paid campaigns and analyzing their performance Create basic reports on social media performance using insights and analytics tools Requirements : Basic knowledge...

Location Ahmedabad, India (WFO) Experience 2-4 Years Job Code EDOSM112501 Education Qualification Bachelor Degree or Masters Job Briefing EvinceDev (Evince Development) is looking for Talented candidates as per the requirements described here. Following are the Brief points of the Job requirements Design, develop, and deploy machine learning and deep learning models for real-world business problems. Work on data collection, preprocessing, and feature engineering to ensure high-quality input data. Build and maintain end-to-end ML pipelines for model training, evaluation, and deployment. Collaborate with cross-functional teams to integrate ML models into production environments. Optimize model...

Customer Acquisition Associate (Insight Sales) Job Responsibilities: About the Role: We’re looking for a proactive and detail-oriented Customer Acquisition Associate (Insight Sales) with 1–2 years of experience to join our high-growth team. In this role, you’ll take ownership of researching high-quality leads and reaching out to potential customers to spark their interest in our solutions. This position is ideal for someone with a solid foundation in lead generation or inside sales support, who’s ready to take their skills to the next level and contribute more strategically. What You’ll Do: Conduct targeted research to identify, qualify, and prioritize high-potential leads across industries....

Job Description Global Gen AI Developer Enabling a software-defined, electrified future. Visteon is a technology company that develops and builds innovative digital cockpit and electrification products at the leading-edge of the mobility revolution. Founded in 2000, Visteon brings decades of automotive intelligence combined with Silicon Valley speed to apply global insights that help transform the software-defined vehicle of the future for many of the world’s largest OEMs. The company employs 10,000 employees in 18 countries around the globe. Mission of the Role: Facilitate Enterprise machine learning and artificial intelligence solutions using the latest technologies Visteon is adopting glo...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. JLL empowers you to shape a ...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. Mechanical Manager At JLL, t...

Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS). Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment. SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage. CI/CD, Version control tools like GitHub, Azure DevOps.

Job Description: Data Engineer Position: Data Engineer Location: Indore Experience: 0-7 Employment Type: Full-Time Job Summary: We are looking for a skilled Data Engineer to design, develop, and maintain data pipelines, ensuring efficient data processing, storage, and retrieval for business analytics and decision-making. The ideal candidate will have strong experience in working with large-scale data systems, ETL processes, and cloud-based platforms. Key Responsibilities: Data Pipeline Development: Design, build, and maintain scalable, reliable, and efficient data pipelines to process and integrate data from various sources. Ensure the timely and accurate flow of data across systems. Data Ar...

Summary Position Summary Analyst/Snr Analyst – Level 3 A Pyspark and Databricks Developer with a good understanding of the entire ETL/Azure lifecycle with a background of data projects. Work you’ll do Design and Build Data Pipelines Develop robust, scalable ETL/ELT pipelines using Databricks and Apache Spark. Integrate data from on-premises databases, cloud storage, APIs, and third-party sources into the enterprise data lake. Automate both batch and real-time data ingestion to support enterprise reporting and advanced analytics (with specific experience in SAP HANA integration being highly valuable). Enhance pipeline designs by leveraging Azure Data Factory (ADF), diverse connectors, and cor...

🌟 Senior Data Scientist SME & AI Architect (10+ Years Experience) 🧠 We are seeking a highly accomplished and results-oriented Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains, including Generative AI, Computer Vision, and Natural Language Processing (NLP) . You will be the principal technical leader, driving strategy, setting standards, and delivering high-impact solutions that transform business outcomes. Key Responsibilities AI/ML Strategy & Arc...

Experience: 4+Years Location: Hyderabad Primary Skillsets: Spark , Hive ,SQL and Hadoop technologies experience and should have strong experience in Hadoop, Spark, Scala, Java, Hive, Impala, CI/CD, Git, Jenkins, Agile Methodologies, DevOps, Cloudera Distribution. Strong Knowledge in data warehousing Methodology Roles & Responsibilities: 1. Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API. 2. Work closely with Business Analysts team to review the test results and obtain sign off 3. Prepare necessary design/op...

Company Description Our culture is defined by our values and our deep commitment to help our clients succeed. We are a division of the 38th largest company in the world and bring to bear the strength of a very large network of interconnected Hitachi companies. At the same time we remain absolutely committed to the nimble agility that helped us grow Hitachi Solutions from three founding partners to nearly 2,000 consultants, developers and support personnel all around the globe. Hitachi Solutions is a leader in providing industry solutions based on Microsoft Dynamics AX and Microsoft Dynamics CRM. Hitachi Solutions provides its customers with industry focus, software industry domain expertise,...

Job Opening: Content Writer Location: On-site, Noida Experience: 1–3 years (Freshers with strong portfolios can apply) Type: Full-time About the Role We’re looking for a Content Writer who understands how social media really works and can translate ideas into engaging, human, scroll-stopping content . If you can switch between writing a punchy Instagram caption, a value-driven LinkedIn post, a clean blog, or a newsletter that people actually read, you’ll be a perfect fit. What You’ll Do Write engaging content for Instagram, LinkedIn, Facebook, and X . Craft hooks, captions, carousel copy, and scripts that spark conversations. Write blogs , newsletters , website copy, and marketing content ac...

Area(s) of responsibility Design and develop robust AI/ML solutions tailored to industry verticals such as Banking, Financial Services, Insurance (BFSI), Energy & Utilities (EnU), Life Sciences, and Manufacturing. Collaborate with cross-functional teams to gather business requirements and translate them into scalable machine learning architectures. Lead the end-to-end lifecycle of ML projects—from data exploration and model development to deployment and monitoring—ensuring alignment with organizational standards and best practices. Evaluate and select appropriate ML algorithms, frameworks, and tools to optimize model performance, scalability, and interpretability. Conduct research on emergin...

Position: Lead AI/ML Engineer Location: Near Christ University, Bengaluru Employment Type: Full-time Work Mode - Hybrid About the Role We are seeking a highly skilled AI/ML Engineer with deep expertise in designing, developing, and deploying machine learning and generative AI solutions. The ideal candidate will have extensive hands-on experience with modern ML frameworks, LLMs, and RAG architectures, and be capable of building scalable, production-ready AI systems. Key Responsibilities Design, develop, and implement end-to-end AI/ML models and solutions for complex business problems. Work extensively with LLMs, Generative AI, and Retrieval-Augmented Generation (RAG) architectures. Build and ...

Job Description Description: Oracle Cloud Infrastructure (OCI) provides mission-critical cloud services to enterprises worldwide. The Network Reliability Engineering(NRE) Automation, Reporting, and Tooling team builds innovative solutions that boost the productivity and efficiency of the Global Network Operations Center (GNOC). Our tooling empowers the GNOC and Network Reliability Engineering (NRE) teams with observability, automation, and actionable insights at hyperscale. As a Principal Software Developer, you will design, build, and deliver scalable automation frameworks and advanced platforms leveraging AI/ML to drive operational excellence across OCI’s global network. This includes buil...

About the role : (Equivalent to Associate Engineering manager and 1st level technical manager in the industry role mapping) SDE4 TL are seasoned engineers who are quality conscious, product thinkers, business cognizant and smart. You will own one or more products or module. You will be responsible for HLD, LLD and architectural decision making. You will make decisions around scalability, future roadmap and partner with managers and product/business to take the product further. Along with hands-on technical delivery you will lead and mentor diverse groups of people who are moving towards realizing Flipkart’s vision. They are responsible for both building scalable systems and leading high-perf...

HIRING- Data Engineer || Hyderabad EXP-4-6Yrs 20LPA & 6-8/9Yrs 25LPA NP-Imm-15 days SHIFTS-Rotational SKILLS-Data pipeline, Data Engineer, Data Workflows, SQL, Data extraction, AWS, Pyspark, Python, Spark Drop your CV at rashibimaginators@gmail.com

5+ years of experience building and managing Data Lake Architecture on AWS Cloud 3+ years of experience with AWS Data services such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS, and Redshift. 3+ years of experience building Data Warehouses on Snowflake, Redshift, HANA, Teradata, or Exasol. 3+ years of hands-on experience working with Apache Spark or PySpark, on Databricks. 3+ years of experience implementing Delta Lakes using Databricks Delta or Apache Hudi. 3+ years of experience in ETL development using Databricks, AWS Glue, or other modern frameworks. Proficiency in Python for data engineering, automation, and API integrations. Experience in Databricks Jobs, Workflows, and Cluster ...

Job Description Description: Oracle Cloud Infrastructure (OCI) provides mission-critical cloud services to enterprises worldwide. The Network Reliability Engineering(NRE) Automation, Reporting, and Tooling team builds innovative solutions that boost the productivity and efficiency of the Global Network Operations Center (GNOC). Our tooling empowers the GNOC and Network Reliability Engineering (NRE) teams with observability, automation, and actionable insights at hyperscale. As a Principal Software Developer, you will design, build, and deliver scalable automation frameworks and advanced platforms leveraging AI/ML to drive operational excellence across OCI’s global network. This includes buil...

Role & responsibilities Very Strong Python knowledge Experience with pyspark, bigdata technologies Proficiency in Databricks Knowledge of cloud AWS Prefered Strong debugging skills Good SQL and higher-level programming languages with solid knowledge of data mining, machine learning algorithms and tools. Curiosity, creativity, and excitement for technology and innovation. Demonstrated quantitative and problem-solving abilities. Expert proficiency in using Python, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data Comfortable in developing shell scripts for automation. Proficient in standard software development, such as version control, testing, and deployment. Extensive data wareho...

Experience Level: 12+ years Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . E...

Experience Level: 12+ years Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . E...