612 Oozie Jobs - Page 4

where youll be supported and inspired by a collaborative community of colleagues around the world, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Your Role Experience working with Fact and Dimension tables, SCD. Proven analytical skills and Problem-solving attitude. Any other GCP services or databases like Datastore, Bigtable, Spanner, Cloud Run, Cloud Functions etc. Should have worked on handling big data. experience in Agile methodologies ETL, ELT skills, Da...

where youll be supported and inspired by a collaborative community of colleagues around the world, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Your Role As a senior software engineer with Capgemini, you will have 3 + years of experience in Scala with strong project track record. Hands-on expertise in Scala and Spark, strong SQL skills on DB2, and proficiency in handling diverse file formats including JSON, Parquet, AVRO, ORC, and XML. Proven experience in H...

Overview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL

Overview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL

Overview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL

As a Sr. Engineering Manager at Target, you will lead an engineering team to build solutions for the AdTech platform in an agile environment. Your success in this role will depend on your strong problem-solving skills, innovative approach, technical leadership, and effective communication. You will collaborate with cross-functional teams to deliver AdTech capabilities such as DSP, SSP, and Ad Servers for self-service advertising needs. Your responsibilities will include: - Managing the overall software development cycle, ensuring high-quality code for common assets and framework components - Building and leading a team of high-caliber software development engineers - Architecting and develop...

Location: Manyata Tech Park. Experience: 5-8 years in Data science. JD - Skill Set Required: ? Familiar with forecasting algorithms, such as Time Series (Arima, Prophet), ML (GLM, GBDT, XgBoost), Hierarchical model (Top Down, Bottom Up), DL (Seq2Seq, Transformer), and Ensemble methods. ? Hand-on experience (real-time) in building end-to-end ML models and pipelines. ? SQL, Python, Spark, PySpark. ? Big Data systems - Hadoop Ecosystem (HDFS, Hive, MapReduce) or Cloud ? MLflow, Kubeflow, GCP Vertex AI, Databricks or equivalents. ? Analytics database like Druid, Data visualization/exploration tools like Superset. ? CI\CD ? GIT Secondary Skills (desired): ? Apache Airflow, Apache Oozie, Nifi ? GC...

? Mentor and guide engineering teams in all aspects of the SDLC. ? Lead technical design sessions and translate ideas into robust technical architecture. ? Develop and maintain scalable, high-performance data pipelines and streaming systems. ? Use Python, SQL, Scala, NodeJS, and work with relational databases, NoSQL stores, and Kafka. ? Refactor and optimize legacy codebases for improved performance and scalability. ? Collaborate with product and engineering teams to deliver innovative solutions in an agile environment. ? Support technical support teams with ad-hoc data queries and operational troubleshooting. ? Ensure data pipelines and APIs meet enterprise-grade performance and usability s...

? Design, develop, and maintain scalable data pipelines and streaming systems. ? Work with Python, SQL, Scala, NodeJS, and various data stores (relational, NoSQL, Kafka). ? Analyze healthcare and marketing datasets using SQL. ? Refactor and optimize existing codebases for performance improvements. ? Collaborate closely within an agile team to deliver creative technical solutions. ? Support ad-hoc data requests and assist technical support teams as needed. ? Ensure high performance of data ingestion, transformation, and API consumption layers. ? Follow best practices for coding, testing, CI/CD, and cloud deployments

Technology Stack Data engineer with experience in working with Big data technologies e.g. spark/hadoop Design and implement scalable cloud infrastructure solutions using Google Cloud Platform services such Cloud Storage, BigQuery , Cloud Data flow, Cloud run etc Strong scripting and programming skills on python

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Job Role Very good Understanding of current work and the tools and technologies being used. Comprehensive knowledge and clarity on Bigquery, ETL, GCS, Airflow/Composer, SQL, Python. Experience working with Fact and Dimension tables, SCD. Minimum 3 years" experience in GCP Data Engineering. Java/ Pytho...

Location: Manyata Tech Park. Experience: 5-8 years in Data science. JD - Skill Set Required: ? Familiar with forecasting algorithms, such as Time Series (Arima, Prophet), ML (GLM, GBDT, XgBoost), Hierarchical model (Top Down, Bottom Up), DL (Seq2Seq, Transformer), and Ensemble methods. ? Hand-on experience (real-time) in building end-to-end ML models and pipelines. ? SQL, Python, Spark, PySpark. ? Big Data systems - Hadoop Ecosystem (HDFS, Hive, MapReduce) or Cloud ? MLflow, Kubeflow, GCP Vertex AI, Databricks or equivalents. ? Analytics database like Druid, Data visualization/exploration tools like Superset. ? CI\CD ? GIT Secondary Skills (desired): ? Apache Airflow, Apache Oozie, Nifi ? GC...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities Team Management: Lead and manage a team of technical professionals Data Engineer and Application Developers, ensuring effective collaboration and productivity. Client Interaction: Serve as the primary point of contact for clients, understanding their needs and ensuring successful project delivery. Status Reporting: Prepare and present detailed status reports on ongoing projects to stakeholders, highlighting progress, risks, and mitigation plans. Issue Resolution: Proactively identify and resolve any technical challenges or roadblocks faced by the team, ensuring smooth project execution. Proje...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time educationBTech or MTech or MCA with IT or CSE or EEE or ECE Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creatin...

As a Big Data Engineer at the company, your role will involve managing the core analytics support for the assigned account. You will be responsible for leading the analysis and publication of reports. Key Responsibilities: - Importing, cleaning, transforming, validating, or modeling data to understand and make conclusions for business decisions. - Evaluating CVM campaign offerings for impact, profitability, ROI, and targets. - Utilizing segment identification and base management to enhance MOU, ARPU, Customer Retention & Loyalty. - Conducting regular data mining to identify trends such as Recharge pattern, MoU trend, Grace & churn, Unique recharge, Power STV penetration, Incremental ARPU, ze...

TCS is looking for Big Data and Hadoop Ecosystems Experience: 8 - 15 years Only Education: Minimum 15 years of full time education (10th, 12th and Graduation) Location: Bangalore Notice Period: 0 to 30 Days Role & responsibilities 1 Develop Spark and SCALA code as per requirement. 2 Build efficient and optimized ETLs for data ingestion/transformations. 3 Should be able to customize and update the Quantexa UI as per business requirement. 4 Documentation of the developed code. 5 Code version management through GIT & JIRA. 6 Analyzing the business requirement. 7 Support production incident/issues/failures when required. Preferred candidate profile 1. Experience in writing ETL scripts in Scala a...

Data Engineer Life Sciences R&D (Senior Level) Experience8+ Years Role Overview As a senior Data Engineer, you will be responsible for building robust, scalable, and compliant data pipelines from raw scientific sources to integrated and consumption-ready data products in the R&D landscape. You will partner with architects, domain SMEs, and analysts to develop re-usable components supporting early discovery, development, and regulatory needs. Key Responsibilities Design and implement pipelines across L1L3 layers using Databricks and Spark. Develop modular, parameterized ETL processes for large-scale scientific data integration. Implement and maintain STTM mappings and transformation logic wit...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS Data and Analytics (D&A) Manager - Palantir Job Overview Big Data Developer/Senior Data Engineer with 8 to 11 years of experience who would display strong analytical, problem-solving, programming, Business KPIs understanding and communication skills. They should be self-learner, detail-oriented team members who can consistently meet dead...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Position Name Data Engineer Position Level Senior Position Details EYs GDS Assurance Digital teams mission is to develop, implement and integrate technology solutions that better serve our audit clients and engagement teams. As a member of EYs core Assurance practice, youll develop a deep Audit related technical knowledge and outstanding databa...

Description: Overall 10+ years of experience in Python and Shell Knowledge of distributed systems like Hadoop and Spark as well as cloud computing platforms such as Azure and AWS Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :B Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remote work possibility :No Global Role Family :To be defined Local Role Name :To be defined Local Skills :Ruby;automation;Python Languages Required::ENGLISH Role Rarity :To Be Defined

Description: About The Role :: Minimum 5 years of experience in a data-driven information environment, designing and implementing analytic/data systems, ideally in a IOT context Detail-oriented and comfortable working with requirements that are open-ended Experience and familiarity with big data tools and services, such as Kafka, AWS, S3, Flink, Spark, Lambda, Experience working in a cloud-based environment, ideally familiar with the AWS toolset Expertise in one or more programming languages (Java mandatory, Scala and Python beneficial) Comfort with software development methodology around unit testing, performance tuning ,integration testing, etc. Experience in real-time data processing Name...

6 + years of overall IT experience in Telecom OSS especially in Assurance domain Solution, design, and Implementation - Strong Knowledge of Telecom OSS domain, with excellent experience Service Now for Assuance - Knowledge and experience on Big Data,Data lake solution, KAFKA , Hadoop/Hive. - Experience on Python (pyspark) is essential. - Implementation experience in continuous integration and delivery philosophies and practices specifically on Docker, Git, JenKins - Self driven and highly motivated candidate for a client facing role in a challenging environment

Hands On with advanced SQL, Python etc. Hands On in data profiling Hands On in working on Cloud like Azure and Cloud DW like Databricks Hands On experience on Scheduling tools like Airflow, Control M etc. Knowledgeable on Big Data tools like Spark (python/scala), Hive, Impala, Hue and storage (e.g. HDFS, HBase) Knowledgeable in CICD processes Bitbucket/GitHub, Jenkins, Nexus etc. Knowledgeable managing structured and unstructured data types

JD -7+ years of hands on experience in Python especially dealing with Pandas and Numpy Good hands-on experience in Spark PySpark and Spark SQL Hands on experience in Databricks Unity Catalog Delta Lake Lake house Platform Medallion Architecture Azure Data Factory ADLS Experience in dealing with Parquet and JSON file format Knowledge in Snowflake.