21920 Hadoop Jobs - Page 12

Director of Engineering Location:- Chennai, India About Arrcus Arrcus was founded to enhance business efficiency through superior network connectivity. The Arrcus Connected Edge (ACE) platform offers best-in-class networking with the most flexible consumption model at the lowest total cost of ownership. The Arrcus team consists of world-class technologists who have an unparalleled record in shipping industry-leading networking products, complemented by industry thought leaders, operating executives, strategic partners, and top-tier VCs. The company is headquartered in San Jose, California. For more information, go to www.arrcus.com or follow @arrcusinc.. We offer a variety of roles in softwa...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: * Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. * Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. * Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Cloud Architect - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Senior...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing.Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets.In this role, your responsibilities may include:Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporatin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: * Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. * Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. * Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education ...

About The Role Grade Level (for internal use): 05 About Company Statement: S&P Global delivers essential intelligence that powers decision making. We provide the world’s leading organizations with the right data, connected technologies and expertise they need to move ahead. As part of our team, you’ll help solve complex challenges that equip businesses, governments and individuals with the knowledge to adapt to a changing economic landscape. Role: Intern Key Responsibilities Assist in the design, development, testing, and deployment of software applications under the guidance of senior engineers. Collaborate with cross-functional and global teams to understand requirements and contribute to ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Cloud Architect - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Senior...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY-Advisory - Data and Analytics – Senior – Data Engineer(Scala) EY's Advisory Services is a unique, industry-focused business unit that provides a broad range of integrated services that leverage deep industry experience with strong functional and technical capabilities and product knowledge. EY’s financial services practice provides integrated advisory services to financial institutions and other capital markets participants, including commercial banks, retail b...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Cloud Architect - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Senior...

Dear Candidates, We have urgent openings for Big data engineer - CMM L5 Client- Permanent position Location-Chennai/Bangalore-Hybrid mode Exp-4-15yrs NP- Immediate to 20days max(Serving NP only) Job Description: Primary Skills: Hadoop, Hive, Python, Spark, SQL, Airflow... Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code. Very good proficiency in Hadoop, Python, Airflow, SQL and Spark programming. Implementation experience of Spark Core, Spark SQL and Spark Streaming Working with Spark in combination Hadoop Ecosystem. if anyone interested pls share your resume to Manasa@skyonn.com

We are seeking a highly skilled and experienced AWS Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS, Python, & Spark. The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache NiFi,...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data tra...

Job Summary We are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role involves developing and optimizing data solutions to drive business insights and efficiencies. The position is a day shift role with no travel requirements. Responsibilities Develop and implement data solutions using Databricks SQL to enhance business intelligence capabilities. Optimize data processing workflows with Databricks Delta Lake to ensure data integrity and performance. Design and manage Databricks Workflows to automate data pipel...

Key responsibilities Design, develop, and maintain scalable Scala applications and systems. Perform software analysis and write code according to application specifications. Collaborate with developers, testers, and product managers to ensure applications meet standards. Troubleshoot and debug complex issues in Scala applications. Contribute to architectural decisions and recommend improvements to processes and infrastructure. Participate in the entire software development lifecycle, including testing and deployment. Implement data validation and quality checks, especially in data-intensive applications. Contribute to CI/CD pipelines and automate build, test, and deployment processes.

Ascendeum is looking for veterans with extensive hands-on experience in the field of data engineering to build cutting-edge solutions for large-scale data extraction, processing, storage, and retrieval. About Us: We provide AdTech strategy consulting to leading Internet websites and apps globally hosting over 200 million monthly worldwide audiences. Since 2015, our team of consultants and engineers have been consistently delivering intelligent solutions that enable enterprise-level websites and apps to maximize their digital advertising returns. Job Responsibilities: Understand long-term and short-term business requirements to precisely match them with the capabilities of different distribut...

SUMMARY Job Description: As a Associate SRE, you’ll support the design, deployment, and monitoring of cloud and data systems to ensure reliability, scalability, and uptime. You’ll collaborate with developers and infrastructure teams to maintain production environments and automate routine operations. Responsibilities: Support CI/CD pipeline setup and basic monitoring systems for applications and data pipelines. Assist in automating deployments using tools like Jenkins, Git, and Terraform. Monitor performance metrics and escalate incidents to senior engineers. Maintain documentation and participate in root cause analysis for minor incidents. Work under supervision to implement application and...

Ascendeum is looking for veterans with extensive hands-on experience in the field of data engineering to build cutting-edge solutions for large-scale data extraction, processing, storage, and retrieval. About Us: We provide AdTech strategy consulting to leading Internet websites and apps globally hosting over 200 million monthly worldwide audiences. Since 2015, our team of consultants and engineers have been consistently delivering intelligent solutions that enable enterprise-level websites and apps to maximize their digital advertising returns. Job Responsibilities: Understand long-term and short-term business requirements to precisely match them with the capabilities of different distribut...

AI & ML Engineer (Senior) Location : Kochi / Infopark Phase II Campus Experience & Educational Requirements * Minimum of 7 years relevant experience in AI/ML engineering, data science or related roles (industry or product‑engineering). * Bachelor’s or Master’s degree in Computer Science, Information Technology or similar. * Strong preference: B.Tech/M.Tech in CSE/IT or equivalent and good depth in data structures, algorithms, mathematics for ML. * Demonstrable track record of building and deploying ML models in production (for at least 3–5 years within the 7+). * Experience in product‑oriented work (versus purely research) is advantageous. Key Responsibilities * Lead the design, development,...

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

Job Summary: We are seeking an experienced L3 Java Application Support Engineer to manage, troubleshoot, and optimize large-scale enterprise applications. The ideal candidate will have strong expertise in Java , Hadoop , and Spark , with exposure to AWS being an added advantage. You will collaborate with cross-functional teams to ensure smooth operations, high availability, and performance of critical systems. Key Responsibilities: Provide L3-level production support for Java-based applications. Analyze, troubleshoot, and resolve complex technical issues within SLA timelines. Perform root cause analysis (RCA) for recurring issues and implement permanent fixes. Support and optimize Hadoop and...

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...