21920 Hadoop Jobs - Page 18

Description: We are looking for a skilled Data Engineer/Developer with expertise in Snowflake and Spark as primary skills. The ideal candidate should also have a strong understanding of SQL and Hadoop. Primary Skills:Snowflake Spark Secondary Skills:SQL Hadoop Other Requirement:Strong communication skills Additional Details Global Grade : C Remote work possibility : Yes Global Role Family : Software Engineering Local Role Name : Developer / Software Engineer Local Skills : Snowflake Languages Required: : English

Must Have skills: 5+ years of Data Warehouse ETL development experience with Datastage, SQL, Stored Procedures, Teradata BTEQ 3+ years of Mainframe experience with Job Control Language(JCL), SYSIN, Zeke, DFSort, ICETools, etc. Experience with Devops techniques such as GitHub, Jenkins Nice to Have: Hadoop Data Lake (HDFS, Sqoop, Hive, etc Role description: Participate in daily stand ups and all project related meetings from Data Delivery Squads Deliver Impact Analysis and Data Lineage reports. Design new ETL jobs (Datastage/ SYSIN) or enhance existing jobs based on project requirements. Ensure Job Control Language (JCL) jobs are development ready. Complete development testing and necessary do...

Description India Template - R2D2 Global Interfaces Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade D Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills data architecture;AWS Languages RequiredENGLISH Role Rarity To Be Defined

Azure data factory 6 to 9 yrs Bangalore

Description ETL Ab-Initio Proficiency/good understanding in at least couple of the followingAb Initio SQL Data Modelling / relationships RDBMS Hadoop Machine Learning algorithms Ensure consistency in approach design and output to deliver quality and concise design solution documentation. Lead best practice methodology for design Define promote re-usable extendible scalable maintainable solution considering tradeoff for cost vs benefit Communicate at all levels in a clear and credible way about the importance of solution design. Lead developers in the team and foster a shared vision for design. Knowledgeable and skilled at the practice of data driven design solutions. Expert communications to...

JD for Unity Catalog and Databricks Engineer ClientPersistent Role C2H LocationPan India Job description Experience-6 to 9yrs overall, Also experience in Pyspark, Databricks Location-PAN INDIA(except Hyderabad and Chennai as preferred location) NP-Immediate/15 days Hybrid-2 or 3 days WFO "Unity Catalog Adoption Data Engineer 3-6 Years,PySpark,Databricks,Unity Catalog JD Design, develop, and maintain efficient and scalable data pipelines using PySpark, Databricks. Utilize Databricks to orchestrate and automate data workflows. Implement and manage data storage solutions using Unity Catalog for effective data governance. Collaborate with data scientists, analysts, and business stakeholders to e...

Abinitio Lead 7 +years Up to 25LPA Trivandrum, Chennai AbInitio,Java,Gde,Unix Immediate to 30 days

Department: Wealth Management Technology About Us: Morgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities, investment management and wealth management services. We advise, originate, trade, manage and distribute capital for governments, institutions and individuals. As a market leader, the talent and passion of our people is critical to our success. Together, we share a common set of values rooted in integrity, excellence and strong team ethic. We provide you a superior foundation for building a professional career where you can learn, achieve and grow. Technology Department at Morgan Stanley: Technology is the key differentiator t...

Position Overview: A&DT, UMO for Hygiene and Risk Squad to mitigate risk and abide to compliance policies and Secure the firm application architecture, design and platform from unidentified threats. Education: Bachelors / Masters Degree in Engineering, preferably Computer Science/Engineering Qualifications Primary Skills / Must have 3-5 years of experience with the technical analysis and design, development and implementation of data warehousing / Data Lake solutions; Well versed and Hand on in Python, SQL, TeraData, Shell, Unix Additional Skill : Pyspark, Spark, Hadoop, Autosys Strong UNIX Shell scripting experience to support data warehousing solutions; Process oriented, focused on standar...

Seeking an Azure Data Engineer with expertise in data architecture and .NET development. Responsibilities include building and optimizing data pipelines, as well as integrating .NET applications with cloud data solutions. Experience with Azure Data Factory, SQL, and .NET Core required. Strong data engineering and development skills are essential for the role. Location: Flexible.

Location : Hyd / Pune / Bengaluru JD 1: ETL, Pyspark Experience: 4 8 years Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Familiarity with Agile/Scrum development methodologies. Excellent analytical and problem solving skills. Strong c...

Description: Data Engineer : You will be responsible for designing building and maintaining our data infrastructure ensuring data quality and enabling data-driven decision-making across the organization. The ideal candidate will have a strong background in data engineering excellent problem-solving skills and a passion for working with data. Responsibilities: Design build and maintain our data infrastructure including data pipelines warehouses and databases Ensure data quality and integrity by implementing data validation testing and monitoring processes Collaborate with cross-functional teams to understand data needs and translate them into technical requirements Develop and implement data ...

Job Title: Engineer, Associate Location: Pune, India Role Description An Engineer is responsible for designing, developing and support a strategic US Finance Regulatory Reporting platform for the Bank. Join us and you will be on the front lines of transformation for this domain - leveraging cutting edge open-source technologies and highly collaborative agile processes to deliver valuable business solutions that you can be proud of. You will share your passion for technical excellence and engage the full depth of your engineering skills in a diverse cross functional team that partners with business and technology experts globally to develop innovative solutions to complex business problems. Y...

Location Chennai and Hyderbad preferred but customer is willing to take resources from Hyderabad Experience 5 to 8 yrs ( U3 ). Exp - 5- 10 Yrs Location - Hyderabad / Chennai Location Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Famil...

SQL Budget -13$ /Hour (18 LPA) Location - Bangalore 3-5 years Primary skill is SQL we are looking for someone with expertise in SQL, advanced SQLbasic working knowledge of Python, Shell scriptinggood to have Airflow and MDM conceptsNeed to work from Bangalore office of customer few days from customer and few days remotely.Good knowledge on SQLbasic knowledge on Python, Shellgood to have Airflow and MDM concepts

Description Detailed JD RTIM Pega CDH 8.8 Multi App Infinity 24.1 Java Restful API oAuth 1. Understanding the NBA requirements and the complete CDH architecture 2. Review of the Conceptual Design Detailed Design and estimations. 3. Reviewing and contributing to the deployment activities and practices 4. Contributing to overall technical solution and putting it to practise. 5. Contributing to the requirement discussion with the Subject matter expertise in relation to Pega CDH 6. Experience in Pega CDH v8.8 multi app or 24.1 and retail banking domain is preferred. 7. Conducting peer code reviews 8. Excellent communications skills Named Job Posting? (if Yes - needs to be approved by SCSC) Addit...

Description Overall 10+ years of experience in Python and Shell Knowledge of distributed systems like Hadoop and Spark as well as cloud computing platforms such as Azure and AWS Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade B Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills Ruby;automation;Python Languages RequiredENGLISH Role Rarity To Be Defined

SUMMARY Wissen Technology is Hirin g for Data Engineering Support Engineer / Manager About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domai...

We are looking for a skilled Data Engineer with a strong background in PostgreSQL, SQL, and Python to join our dynamic team in Kochi. The ideal candidate will be responsible for building and optimising data pipelines, ensuring seamless data flow across systems, and supporting our analytics and product teams with reliable data solutions. Job Title: Data Engineer Company: Pumex Infotech Pvt. Ltd. Experience: 5 to 10 Years Educational qualification: B Tech/ M Tech/ BCA/MCA (Computer Science) or related field. Location : InfoPark, Kochi Notice Period: Immediate Joiners Responsibilities: Design, develop, and maintain robust ETL/ELT data pipelines using tools such as Airflow or dbt . Optimize Post...

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

JR REQ--- Data Engineer --6to8year---PUNE, THANE----Bhalchandra Suryawanshi ---TCS C2H ---900000

Data Engineer : You will be responsible for designing building and maintaining our data infrastructure ensuring data quality and enabling data-driven decision-making across the organization. The ideal candidate will have a strong background in data engineering excellent problem-solving skills and a passion for working with data. Responsibilities: Design build and maintain our data infrastructure including data pipelines warehouses and databases Ensure data quality and integrity by implementing data validation testing and monitoring processes Collaborate with cross-functional teams to understand data needs and translate them into technical requirements Develop and implement data security and ...

R&D 60 Architect: Count : 1 position Total Experience : 10+ years, Relevant Experience: 3+ years Technology : Full stack, polyglot professionals, experience with innovative product development, research, tool selection, integrations, and hands-on development. Mandatory Skillset : 10+ years of hands-on experience in design, development and implementation of scalable cloud-based software. Have strong software architectural, technical design and programming skills. Experience in Application Security, Scalability and Performance. Knowledge of and skilled in various tools, languages, frameworks and cloud technologies with the ability to be hands-on where needed. Expertise on Kubernetes and Docker...

Summary Within this role, you would be a hands-on experience in data engineering functions including schema design, data movement, data transformation, encryption, and monitoring: all the activities needed to build, sustain, and govern big data pipelines. Responsibilities Own development of large-scale data platform including operational data store, real time metrics store and attribution platform, data warehouses and data marts for advertising planning, operation, reporting and optimization Wider team collaboration and system documentation Maintain next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and av...