599 Cloudera Jobs - Page 3

We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions. Key Responsibilities: Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering. Design and develop solution in combination of Cloudera, Palantir and Databricks. Develop Python-based automation scripts to optimize workflows and processes. Integrate Databricks with AWS ecosystem components such as S3, ...

Role & responsibilities Overall, 6 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering. Design and develop solution in combination of Cloudera, Palantir and Databricks. Develop Python-based automation scripts to optimize workflows and processes. Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda Define architecture for data-driven solutions. Provide solutioning for web applications and data pipelines. Solutioning data analytics requirements with Palantir. Stay updated with emerging technologies and quickly adapt to new tools and frameworks. Work with CI/CD pipelines. Ensure scalability, security, and pe...

Job Title: Hadoop Administrator Experience : 3 - 6 years in Systems Administration with at least the last 3 years in Hadoop Cluster Administration in Cloudera or Horton Works Shifts : 24*7 (Rotational Shift) Mode : Onsite Location : Chennai, India Department : IT Infrastructure and Operations Company : Smart Analytica is niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, telecom, manufacturing, i...

Job Title: Hadoop Administrator Lead Experience : 6 -12 years in Systems Administration with at least the last 3 years in Hadoop Cluster Administration in Cloudera or Horton Works Shifts : 24*7 (Rotational Shift) Mode : Onsite Location : Chennai, India Department : IT Infrastructure and Operations Company : Smart Analytica Private limited is niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, tele...

Project description We are seeking a skilled ML Platform Engineer, responsible for automating, deploying, patching, and maintaining our machine learning platform infrastructure. The ideal candidate will have hands-on experience with Cloudera Data Science Workbench (CDSW), Cloudera Data Platform (CDP), Docker, Kubernetes, Python, Ansible, GitLab, and MLOps best practices. Responsibilities Automate deployment and management processes for machine learning platforms using tools such as Ansible and Python. Deploy, monitor, and patch ML platform components, including Cloudera Data Science Workbench (CDSW), Docker containers, and Kubernetes clusters. Ensure high availability and reliability of ML i...

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

Job Title: - GCP Data Engineer with Big Query ( AIA Kolkata ) Location: - AIA Kochi Minimum 6 to 9 years of experience Mandatory Skills: GCP Services – Big Query, Cloud SQL, Data flow Around 7+ years of experience in development in Data warehousing projects in GCP platforms, Good understanding of dimensional modelling Expertise in MySQL & SQL/PL GCP & BigQuery knowledge is must, GCP certification is added advantage Good experience in Cloud Composer, DAGs , airflow REST API development experience Good in analytical and problem solving, efficient communication Ability to lead the team members, convert requirements into technical solutions, assign the work, coordinate the team and review the de...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities In-depth knowledge of the Palantir Foundry platform, including data integration (Data Connections), Data Transformation (Code Repository & Pipeline Builder), analysis (Contour and Quiver), visualization (Workshop) and Ontology Manager. Must also have a good knowledge of Spark (PySpark) & TypeScript. Knowledge on AIP is an added advantage. Additional Responsibilities: Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability Good knowledge on software configuration management systems Awareness of latest techn...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities In-depth knowledge of the Palantir Foundry platform, including data integration (Data Connections), Data Transformation (Code Repository & Pipeline Builder), analysis (Contour and Quiver), visualization (Workshop) and Ontology Manager. Must also have a good knowledge of Spark (PySpark) & TypeScript. Knowledge on AIP is an added advantage. Additional Responsibilities: Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability Good knowledge on software configuration management systems Awareness of latest techn...

? Mentor and guide engineering teams in all aspects of the SDLC. ? Lead technical design sessions and translate ideas into robust technical architecture. ? Develop and maintain scalable, high-performance data pipelines and streaming systems. ? Use Python, SQL, Scala, NodeJS, and work with relational databases, NoSQL stores, and Kafka. ? Refactor and optimize legacy codebases for improved performance and scalability. ? Collaborate with product and engineering teams to deliver innovative solutions in an agile environment. ? Support technical support teams with ad-hoc data queries and operational troubleshooting. ? Ensure data pipelines and APIs meet enterprise-grade performance and usability s...

? Design, develop, and maintain scalable data pipelines and streaming systems. ? Work with Python, SQL, Scala, NodeJS, and various data stores (relational, NoSQL, Kafka). ? Analyze healthcare and marketing datasets using SQL. ? Refactor and optimize existing codebases for performance improvements. ? Collaborate closely within an agile team to deliver creative technical solutions. ? Support ad-hoc data requests and assist technical support teams as needed. ? Ensure high performance of data ingestion, transformation, and API consumption layers. ? Follow best practices for coding, testing, CI/CD, and cloud deployments

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Job Role Very good Understanding of current work and the tools and technologies being used. Comprehensive knowledge and clarity on Bigquery, ETL, GCS, Airflow/Composer, SQL, Python. Experience working with Fact and Dimension tables, SCD. Minimum 3 years" experience in GCP Data Engineering. Java/ Pytho...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time educationBTech or MTech or MCA with IT or CSE or EEE or ECE Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creatin...

Your key responsibilities Have proven experience in driving Analytics GTM/Pre-Sales by collaborating with senior stakeholder/s in the client and partner organization in BCM, WAM, Insurance. Activities will include pipeline building, RFP responses, creating new solutions and offerings, conducting workshops as well as managing in flight projects focused on cloud and big data. Need to work with client in converting business problems/challenges to technical solutions considering security, performance, scalability etc. [ 10- 15 years] Need to understand current & Future state enterprise architecture. Need to contribute in various technical streams during implementation of the project. Provide pro...

Data Engineer Life Sciences R&D (Senior Level) Experience8+ Years Role Overview As a senior Data Engineer, you will be responsible for building robust, scalable, and compliant data pipelines from raw scientific sources to integrated and consumption-ready data products in the R&D landscape. You will partner with architects, domain SMEs, and analysts to develop re-usable components supporting early discovery, development, and regulatory needs. Key Responsibilities Design and implement pipelines across L1L3 layers using Databricks and Spark. Develop modular, parameterized ETL processes for large-scale scientific data integration. Implement and maintain STTM mappings and transformation logic wit...

Project description We are seeking a skilled ML Platform Engineer, responsible for automating, deploying, patching, and maintaining our machine learning platform infrastructure. The ideal candidate will have hands-on experience with Cloudera Data Science Workbench (CDSW), Cloudera Data Platform (CDP), Docker, Kubernetes, Python, Ansible, GitLab, and MLOps best practices. Responsibilities Automate deployment and management processes for machine learning platforms using tools such as Ansible and Python. Deploy, monitor, and patch ML platform components, including Cloudera Data Science Workbench (CDSW), Docker containers, and Kubernetes clusters. Ensure high availability and reliability of ML i...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. RoleData Architect Preferred Experience10+ years Key Responsibilities: Design and implement robust data architectures on Azure, Google Cloud, or on-premises platforms like Cloudera. Develop and optimize data pipelines, architectures, and data sets for real-time data integration. Ensure data architecture aligns with business requirements and sup...

Description: Overall 10+ years of experience in Python and Shell Knowledge of distributed systems like Hadoop and Spark as well as cloud computing platforms such as Azure and AWS Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :B Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remote work possibility :No Global Role Family :To be defined Local Role Name :To be defined Local Skills :Ruby;automation;Python Languages Required::ENGLISH Role Rarity :To Be Defined

Description: About The Role :: Minimum 5 years of experience in a data-driven information environment, designing and implementing analytic/data systems, ideally in a IOT context Detail-oriented and comfortable working with requirements that are open-ended Experience and familiarity with big data tools and services, such as Kafka, AWS, S3, Flink, Spark, Lambda, Experience working in a cloud-based environment, ideally familiar with the AWS toolset Expertise in one or more programming languages (Java mandatory, Scala and Python beneficial) Comfort with software development methodology around unit testing, performance tuning ,integration testing, etc. Experience in real-time data processing Name...

6 + years of overall IT experience in Telecom OSS especially in Assurance domain Solution, design, and Implementation - Strong Knowledge of Telecom OSS domain, with excellent experience Service Now for Assuance - Knowledge and experience on Big Data,Data lake solution, KAFKA , Hadoop/Hive. - Experience on Python (pyspark) is essential. - Implementation experience in continuous integration and delivery philosophies and practices specifically on Docker, Git, JenKins - Self driven and highly motivated candidate for a client facing role in a challenging environment

Hands On with advanced SQL, Python etc. Hands On in data profiling Hands On in working on Cloud like Azure and Cloud DW like Databricks Hands On experience on Scheduling tools like Airflow, Control M etc. Knowledgeable on Big Data tools like Spark (python/scala), Hive, Impala, Hue and storage (e.g. HDFS, HBase) Knowledgeable in CICD processes Bitbucket/GitHub, Jenkins, Nexus etc. Knowledgeable managing structured and unstructured data types

Skills: Cloudera, Big Data, Hadoop, SPARK, Kafka, Hive, CDH Clusters Design and implement Cloudera-based data platforms, including cluster sizing, configuration, and optimization. Install, configure, and administer Cloudera Manager and CDP clusters, managing all aspects of the cluster lifecycle. Monitor and troubleshoot platform performance, identifying and resolving issues promptly. Review the maintain the data ingestion and processing pipelines on the Cloudera platform. Collaborate with data engineers and data scientists to design and optimize data models, ensuring efficient data storage and retrieval. Implement and enforce security measures for the Cloudera platform, including authenticat...

Our Purpose Title and Summary Consultant, Advisors & Consulting Services, Performance Analytics Consultant Performance Analytics Advisors & Consulting Services Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk, enhancing cybersecurity, and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and execution. Our Advisors & Consulting Services team combines traditional management consulting with Mastercards rich data assets, proprietary platforms, and technologies to provide clients with powerful strategic insights and recommendations. Our teams work with a div...