9747 Big Data Jobs - Page 27

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qua...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Informatica PowerCenter Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, ...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Python (Programming Language), Data Warehouse ETL Testing Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Power Business Intelligence (BI), Microsoft Azure Databricks Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse, Core Banking Good to have skills : AWS BigData Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines,...

Role & responsibilities BA / Data Analyst Preferred candidate profile Exp: 10+Years Location: Bangalore or Chennai JD: 7+years of commercial project implementation experience ( Database | Data warehousing | ETL | BI | Big Data | Data Science ) Commercial experience working in Business Intelligence (SAP Analytics Cloud | Tableau | MS Power BI | MicroStrategy| Qlik ) Proficiency in SQL ( DML | DDL | DCL | TCL ) Commercial experience working on database/data warehouse projects ( Oracle | Exasol | SAP BW | Teradata ) Commercial experience creating ETL processes using data integration tools ( Dataiku | Informatica | Oracle DI | Talend | Pentaho DI | IBM DataStage

Experience: 4 to 10 Years Location: Mumbai / Bangalore (Hybrid / Onsite) Employment Type: Full-Time About the Role We are looking for skilled backend engineers proficient in Scala , Java , or PySpark , to join a dynamic global team working for a leading European & USA BFSI client . This role is ideal for professionals who enjoy solving complex data and performance challenges, building high-volume, low-latency financial systems , and working with modern data processing frameworks such as Apache Spark and Scala . Youll be part of a high-impact engineering team , collaborating with architects, data engineers, and product stakeholders across regions. Key Responsibilities Design, develop, and opt...

Talend Developer (6 Years experience) Upgrading Talend from 7.x to 8.0.1 involves not just infrastructure changes, but also project-level upgrades that require Talend Developers to adapt, refactor, and validate their ETL jobs. Below is a detailed overview of the skills, roles, and responsibilities of Talend Developers during this upgrade process: Key Skills for Talend Developers (Upgrade 7.3 8.x) 1. Talend Studio Expertise • Proficiency in Talend Studio for Data Integration/Big Data/ESB (based on edition). • Familiarity with job designs, components, contexts, routines, and metadata repositories. • Knowledge of repository-based project management and shared resources. 2. Component Compatibili...

Were looking for a skilled Data Engineer with strong expertise in SQL, BigQuery, Python , and Big Data Engineering . If youre passionate about building scalable data solutions and optimizing data workflows, this role is for you! Must-Have Skills: Strong in SQL – able to write & optimize complex queries Hands-on with BigQuery (tables, partitioning, clustering, etc.) Proficient in Python for application development Experience with Big Data Engineering projects Good to Have: Exposure to DBT and Alembic (big plus!) Be part of a dynamic engineering team driving data innovation and performance at scale!

3+ years of experience in a data engineering or related role, managing complex data workflows and large-scale datasets. Expertise in SQL, with the ability to write, optimize, Required Candidate profile Proficiency in Python, including libraries like Pandas, PySpark, and others used for data manipulation and processing. Experience with big data tools such as Apache Spark,

Position summary: We are seeking a Senior Software Development Engineer – Data Engineering with 3-5 years of experience to design, develop, and optimize data pipelines and analytics workflows using Snowflake, Databricks, and Apache Spark. The ideal candidate will have a strong background in big data processing, cloud data platforms, and performance optimization to enable scalable data-driven solutions. Key Responsibilities: Work with cloud-based data solutions (Azure, AWS, GCP). Implement data modeling and warehousing solutions. Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes. Designing and optimizing data storage solutions...

Key Skills: Team Management, Data Engineering, Azure Databricks, Big Data Roles and Responsibilities: Lead and mentor a team of engineers to deliver reliable, scalable, and high-quality data solutions. Define the vision and strategy for data platform scalability, availability, and performance. Collaborate with cross-functional teams to ensure alignment of data initiatives with business goals. Establish and enforce best practices for data governance, security, and compliance. Drive innovation and continuous improvement by evaluating and adopting emerging technologies. Monitor and analyze platform metrics to identify and implement enhancements. Ensure seamless integration of new data sources a...

• Experience on deploying shallow learning and deep learning models • Experience with Big Data Platform and cloud technologies • Building production grade Gen AI applications is a plus. • ML Design pattern, algorithm and the data structure skills

We are looking for a dynamic professional who brings a unique blend of software development expertise and business analysis acumen. The ideal candidate will have hands-on experience in coding and system design, coupled with a strong understanding of business processes and stakeholder management. Key Responsibilities: Collaborate with stakeholders to gather and analyze business requirements. Translate business needs into technical specifications and solutions. Participate in system design, development, and testing phases. Work closely with development teams to ensure business requirements are met. Create and maintain documentation including BRDs, FRDs, and user stories. Conduct gap analysis a...

TCS is looking for Java Azure Developers Experience: 5+ years Education: Minimum 15 years of full-time education (10th, 12th and Graduation) Location: Mumbai/ Bangalore/ Gurgaon/ Hyderabad/ Chennai Notice Period: 0 Day to 30 Days Please find a brief description of the role: Mandatory skills Strong experience with Azure native tools and technology (Azure Data Factory/Databricks) and Azure certified Hands-on experience as Azure Developer to build ETL process using Python or any other language. Knowledge on MS SQL Experience with PowerShell or Bash scripting. Able to build Azure DeVops pipelines either though UI or yaml Agile Way of working. Nice to have skills - Experience with Informatica Too...

Job Description: YOULL BUILD TECH THAT EMPOWERS GLOBAL BUSINESSES Our Connect Technology teams are working on our new Connect platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on Connect data and insights to innovate and grow. As a Senior Data Engineer, you’ll be part of a team of smart, highly skilled technologists who are passionate about learning and supporting cutting-edge technologies such as Spark, Scala, Pyspark, Databricks, Airflow, SQL, Docker, Kubernetes, and other Data engineering tools. These technologies are deployed using DevOps pipelines leveraging Azure, Kubernetes, Jenkins and Bitbucket/GIT Hub. WHAT YOU’LL DO: Dev...

Role & responsibilities Total Experience of 4-8years Hands on experience in python coding is must . Experience in data engineering which includes laudatory account Hands-on experience in Big Data cloud platforms like AWS(redshift, Glue, Lambda), Data Lakes, and Data Warehouses, Data Integration, data pipeline. Experience in SQL, writing code in spark engine using python,pyspark.. Experience in data pipeline and workflow management tools ( such as Azkaban, Luigi, Airflow etc.) Key Personal Attributes Business focused, Customer & Service minded Strong Consultative and Management skills Good Communication and Interpersonal skills Preferred candidate profile Interested Candidate Share your CV on...

Product Based IT Company Developing and maintaining our Python and PySpark based applications. Closely work with data engineers, scientists and other stakeholders to implement data pipelines and high performance across our data processing systems. Required Candidate profile 5+ years of experience in Python PySpark development Python, PySpark, Big Data, Distributed Computing, ETL Processes, SQL, Data Engineering, Cloud Computing (Azure), Data Warehousing, Apache Spark

JD : Must Have: SQL: Ability to read, write, test, and maintain complex SQL queries BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python application code Big Data Engineering: Experience in Big Data Engineering projects Good to Have (Added Advantage): Knowledge/experience with DBT and Alembic (availability of these skills will be a big push) Experience Requirement: Mid-level engineer with 7-8 years of experience

Job Title: Data Engineer Experience: 8+ years Location: Bengaluru Notice Period: Immediate to 20 Days Employment Type: Full-time About the Role We are looking for an experienced Data Engineer with strong expertise in Python, Spark, and PySpark to design, develop, and optimize large-scale data pipelines and distributed systems. The ideal candidate will possess a deep understanding of Big Data platforms , data modeling , and data quality frameworks , and will work collaboratively within a fast-paced, agile environment to deliver reliable and high-performing data solutions. Experience Requirements 5+ years of professional experience in Data Engineering , Data Pipeline Development , or Big Data ...

mPokket, a trusted instant loan app in India, caters to the financial needs of college students and young salaried professionals. Here are some key points about mPokket: Loan Availability: With over 7 million users in India, mPokket simplifies the process of receiving loans. It offers reliable short-term loans online where the application and sanctioning process is completely digitized, requiring minimal documentation1. Target Audience: mPokket specializes in extending small-ticket cash loans to self employed individuals, including entrepreneurs and freelancers & students. Features: Instant Access: Borrowers can download the mPokket app from the Google Play Store and take instant cash loans ...

Role & responsibilities Strategic and tactical leadership for services delivered under Data & Analytics team Performance management and operational excellence of the department Stakeholder management and leadership advisory Manage large multi locational teams in India and Europe Preferred candidate profile Engineers / MCA with 20 - 25 years of experience in Data Analytics teams Be responsible for managing and leading senior managers Strong communication, interpersonal and strategic leadership experience call ananth on 6301145639 mail info@kautilya.co.in

An experienced Python & PySpark Developer to design, develop, and optimize large-scale data pipelines and ML-driven app This role blends data engineering, machine learning, and cloud development on modern platforms like Azure and Hyperledger Fabric.

Title: SRE & Devops Engineer (Big Data) You will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization. You'll partner with vendors and the infrastructure engineering team for security and service availability You'll fix production issues with engineering teams, researchers, data scientists, including performance and functional issues Diagnose and solve customer technical problems Participate in training customers and prepare reports on customer issues Be responsible for customer service improvements and recommend product improvements Write support documentation You'll design and implement zero-d...