9747 Big Data Jobs - Page 28

Job Location: Hyderabad, Indore and Ahmedabad (India) What You Will Do: Following are high level responsibilities that you will play but not limited to: Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes. Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake. Enable business analytics and self-service reporting through Power BI and other visualization tools. Collaborate with data scientists, analysts, and business users to deliver reliable and high-performance data solutions. Implement and enforce best practices for data governance, data quality, and security. Mentor and guide junio...

Exp: 2+Years loc: Mumbai-Turbhe np: Immediate to 30 Days Only SKILLS: sql,python coding,azure cloud,tableau,databricks,HIVE,Big Data ankitapisal@peshr.com/9004076848

10+ years of experience in Data Engineering on Azure/GCP Should have worked as Data Project Lead for new initiative/greenfield projects Need to work project requirements grooming discussion and scope data specific activities Clear communication and should be able articulate problem/situation Past experience working in Insurance Data projects is plus Roles and Responsibilities 10+ years of experience in Data Engineering on Azure/GCP Should have worked as Data Project Lead for new initiative/greenfield projects Need to work project requirements grooming discussion and scope data specific activities Clear communication and should be able articulate problem/situation Past experience working in I...

Key Responsibilities Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF) , Databricks , Synapse Analytics , and related Azure services. Implement ETL/ELT processes to integrate data from multiple structured and unstructured data sources. Build and optimize data lake and data warehouse solutions in Azure Data Lake Storage (ADLS) and Azure Synapse . Collaborate with data scientists, analysts, and business stakeholders to deliver scalable data solutions. Develop CI/CD pipelines for data workflows using Azure DevOps or equivalent tools. Implement data governance, quality, and security best practices following enterprise standards. Monitor, troubleshoot, and opt...

Required Skills & Experience-Pharma Domain 5+ years of experience in IT with 3+ years in Big Data and Cloud Data Engineering. Strong expertise in Hadoop ecosystem HDFS, Hive, Sqoop, Spark. Proficiency in PySpark , SQL , and Python for data transformation and automation. Hands-on experience with Databricks notebooks and DBFS . Deep knowledge of AWS Cloud Services (S3, Glue, Redshift, Lambda, DMS, Athena, EC2, IAM). Experience with Azure Data Factory, Azure Synapse, and Azure Data Lake (ADLS) . Familiarity with Snowflake , DBT , and Airflow for pipeline orchestration and transformation. Strong understanding of data quality, performance tuning, and optimization techniques in Spark. Experience w...

Required Skills & Experience-Pharma Domain 5+ years of experience in IT with 3+ years in Big Data and Cloud Data Engineering. Strong expertise in Hadoop ecosystem HDFS, Hive, Sqoop, Spark. Proficiency in PySpark , SQL , and Python for data transformation and automation. Hands-on experience with Databricks notebooks and DBFS . Deep knowledge of AWS Cloud Services (S3, Glue, Redshift, Lambda, DMS, Athena, EC2, IAM). Experience with Azure Data Factory, Azure Synapse, and Azure Data Lake (ADLS) . Familiarity with Snowflake , DBT , and Airflow for pipeline orchestration and transformation. Strong understanding of data quality, performance tuning, and optimization techniques in Spark. Experience w...

Required Skills & Experience-Pharma Domain 5+ years of experience in IT with 3+ years in Big Data and Cloud Data Engineering. Strong expertise in Hadoop ecosystem HDFS, Hive, Sqoop, Spark. Proficiency in PySpark , SQL , and Python for data transformation and automation. Hands-on experience with Databricks notebooks and DBFS . Deep knowledge of AWS Cloud Services (S3, Glue, Redshift, Lambda, DMS, Athena, EC2, IAM). Experience with Azure Data Factory, Azure Synapse, and Azure Data Lake (ADLS) . Familiarity with Snowflake , DBT , and Airflow for pipeline orchestration and transformation. Strong understanding of data quality, performance tuning, and optimization techniques in Spark. Experience w...

Job Summary: We are seeking a skilled and detail-oriented Big Data Engineer with over 5 years of IT experience, including at least 3 years specializing in Big Data application development using the Hadoop ecosystem and Cloud platforms (AWS/Azure) . The ideal candidate will have strong expertise in PySpark , ETL pipeline development , data integration , and workflow orchestration to build scalable and efficient data solutions. Key Responsibilities: Design, develop, and optimize Big Data pipelines using PySpark , Hive , Sqoop , and Spark SQL . Implement ETL processes for ingesting, transforming, and loading large-scale structured and unstructured data from diverse sources (JSON, Parquet, Avro,...

Amex GBT is a place where colleagues find inspiration in travel as a force for good and through their work can make an impact on our industry. We re here to help our colleagues achieve success and offer an inclusive and collaborative culture where your voice is valued. Amex GBT seeks an innovative AI Solutions Architect at a senior level to drive transformative artificial intelligence strategies and implementations across our global enterprise. Key responsibilities will include Design and implement comprehensive AI/ML solutions. The candidate will be a member of the AI/ML and the Data Science team and will lead efforts around building solutions in the big data, data science, data quality and...

As part of the Client Services organization, this role will take ownership of this vision and deliver with excellence for our organization and our clients. The successful candidate will use strong big data and analytical skills, contextual business sense and a creative flair to solve real world business challenges for Visa issuing banks, acquirers and merchants. In addition, your analytic expertise will directly impact the strategic direction of the organization and how we'deliver value from our data assets. The Senior Consultant will be a key member in Global Business Optimization, within Client Services, supporting auth improvement activities based in Bangalore responsible for building and...

we're looking for a Senior Data Science /Full Stack Engineer who expects more from their career. It s a chance to make accessible to clients the latest and best ready-to-use science products and/or software modules, helping Dunnhumby and its clients serve billions of customers worldwide. What we expect from you Degree in a relevant subject Experience with and passion for buidling full-stack applications and an appetite for understanding and implementing ways to connect with various data science algorithms on the big data backend. Frontend stack Reactjs, Typescript, Redux, Cypress Backend stack Nodejs, Typescript, Postgres, GCP, Linux Good knowledge of SQL (joins, subqueries, etc) and optimis...

Bachelors degree, OR 3+ years of relevant work experience Preferred Qualification: Bachelors degree, OR 3+ years of relevant work experience Masters or bachelors degree in computer science or related fields required. Demonstrated ability in delivering high-quality, large-scale, enterprise-class data applications. Expertise in big data engineering with knowledge of Hadoop, Apache Spark, Python and SQL. Proficiency in creating and managing large-scale data pipelines and ETL processes. Experience developing and maintaining Spark pipelines and productizing AI/ML models. Proficient in technologies like Kafka, Redis, Flink,. Skilled in Unix or Python scripting and scheduling tools like Airflow and...

With the growing demand for electricity, the need for smart, clean energy sources is constantly rising. SolarEdge offers amazing opportunities to develop your skills in a multidisciplinary environment, covering everything from research and development to production and customer supply. Work with talented colleagues, tackle exciting challenges, and help create a sustainable future in an industry Key responsibility Looking for Lead inventory across global manufacturing & WH sites Enhance inventory tracking and reporting processes using advanced analytics and automation tools Monitoring costing error : Ensure cost accounting is finalized and fully distributed Validate closure of interfaced modu...

NEX Softsys is looking for Big Data Developer to join our dynamic team and embark on a rewarding career journey Design, develop, and maintain big data solutions to meet business requirements and support data-driven decision making Work with stakeholders to understand their data needs and determine how to best use big data technologies to meet those needs Design and implement scalable, high-performance big data architectures, using technologies such as Hadoop, Spark, and NoSQL databases Extract, transform, and load large data sets into a big data platform for analysis and reporting Write complex SQL queries and develop custom scripts to process big data Collaborate with data scientists, data ...

Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model Thorough understanding of React.js and its core principles Experience with popular React.js workflows (such as Redux, Context API, or MobX) Familiarity with RESTful APIs and modern front-end build pipelines and tools (Webpack, Babel, etc.) Knowledge of modern authorization mechanisms, such as JSON Web Token Our exceptional team of professionals across the globe are solving some of the world s most complex business problems, as well as directly supporting our communities, the planet, and each other. Know more in our Global

Lead Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have Big Data Concepts , Python(Core Python- Able to write code), SQL, Shell Scripting, AWS S3 Good to Have Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora We are seeking an experienced Architect (ATC) to join our team as a Lead Data Engineer. be responsible for designing, developing, and maintaining our data infrastructure. The ideal candidate will have at least 5 years of experience in Big Data Concepts, Python, SQL, Shell Scripting, and AWS S3. As a must-have, you should be proficient in Core Python and able to write code. It is also important t...

Experience with AWS and Redshift database models is a plus Designing L2 Layer experience for Large Data Transformation Program Experience of working as a Lead Data Modeler and working with senior stakeholders Knowledge of relational databases and data architecture computer systems, including SQL Experience of ER modeling, big data, enterprise data, and physical data models Experience of working with large data sets. Banking experience is a must. Finance data experience, Anaplan experience is a plus. Familiarity with data modeling software such as SAP PowerDesigner, Microsoft Visio, or erwin DataModeler Excellent presentation, communication, and organizational skills Strong attention to detai...

Design, develop AWS IoT/Cloud-based applications using Typescript, Node.Js Work closely with onsite, offshore, and cross functional teams, Product Management, frontend developers, SQA teams to effectively use technologies to build and deliver high quality and on-time delivery Proactively Identify risks and failure modes early in the development lifecycle and develop POCs to mitigate the risks early in the program Assertive communication and team skills This individual be self-directed, highly motivated, and organized with strong analytical thinking and problem-solving skills, and an ability to work on multiple projects and function in a team environment. Keep an eye on NFR s and ensure our p...

Amex GBT is a place where colleagues find inspiration in travel as a force for good and through their work can make an impact on our industry. We re here to help our colleagues achieve success and offer an inclusive and collaborative culture where your voice is valued. Amex GBT seeks an innovative AI/ML Solutions Engineer to drive transformative artificial intelligence strategies and implementations across our global enterprise. Key responsibilities will include design and implement comprehensive AI/ML solutions. The candidate will be a member of the AI/ML and the Data Science team and will support building solutions in the big data, data science, data quality and ML space. An ideal candidat...

ABOUT THE ROLE Role Description: We are looking for a highly motivated expert Data Engineer to design and develop advanced data pipelines and solutions for our Manufacturing Applications Product Team . The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics for Manufacturing and Operations use cases. This role requires deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Roles & Responsibilities Design,...

R1 is the leading provider of technology-driven solutions that transform the patient experience and financial performance of hospitals, health systems, and medical groups. We are the one company that combines the deep expertise of a global workforce of revenue cycle professionals with the industrys most advanced technology platform, encompassing sophisticated analytics, AI, intelligent automation, and workflow orchestration.As our Staff Software Engineer, you will be a key member of the engineering team and apply advanced technical knowledge, broad knowledge of software engineering best practices, problem-solving, and creativity to build and maintain software products that achieve technical,...

As our Senior Software Engineer, you will be a key member of the engineering team and apply advanced technical knowledge, broad knowledge of software engineering best practices, problem-solving, and creativity to build and maintain software products that achieve technical, business, and customer experience goals. To thrive in this role, you must have the ability and willingness to mentor and develop junior software engineers, and act as a thought leader and trusted subject-matter expert in a variety of technical domains. Heres what you will experience working as a Senior Software Engineer: Heavily participate in roadmap definition, working closely with engineering leaders. Evaluate and help ...

We are looking for a highly skilled Data Engineer to join our team in IBM India Pvt. Limited, responsible for designing and implementing data integration solutions. The ideal candidate will have a strong background in IT Services & Consulting, with expertise in data engineering and integration. Roles and Responsibility Design and develop scalable data integration architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize data integration requirements. Develop and maintain large-scale data pipelines using various technologies and tools. Ensure data quality and integrity by implementing robust testing and validation procedur...

Key Responsibilities: Proactively source candidates using a variety of unique and innovative channels, including social media, networking events, job boards, and employee referrals. Manage end-to-end recruitment for niche skills such as backend developer, applied scientist AI services, big data, SREs, cybersecurity, cloud infrastructure, and other specialized technology areas. Partner closely with hiring managers to understand business needs, provide market insights, and develop tailored sourcing strategies. Build and maintain strong pipelines for current and future talent needs across JAPAC, including India, Singapore, Australia, Malaysia, and Indonesia. Preference for those who have recrui...

Minimum 4+ years of working experience in Technology (application development and production support) and Minimum 5+ years of experience in developing & supporting ETLs and using Pyspark, Python/Scala in Databricks platform.