Job
Description
Job Responsibilities: To work on Data Analytics to solve various business use cases. Design and implement data pipelines to extract data from various sources (databases, flat files, APIs, streaming data, etc.) Develop efficient ETL processes using tools like Apache Spark, Apache Sqoop, Python/SQL, Pyspark, Good to have expertise/ knowledge in Apache Iceberg, Apace Ni-fi/ Apache Flink and Apache Kafka. Basic Understanding of Data Pipeline design using PL/SQL jobs. Provide seamless data Availability for data analysts, data scientists, and other stakeholders. Develop various Business Requirements leveraging SQL and Python. Stay updated with the latest industry trends and advancements in data analytics and AI, Data Lake, Delta Lake concepts. Required Experience: Over all 6 -12 years of experience in Data Engineering & Data Analytics. Hands-on experience in coding with Python and SQL. Experience in building ETL, ELT Pipelines using Python. Strong expertise in Hadoop Ecosystem (Hive, Impala, Cloudera), Spark, Sqoop, Delta Lake, Data warehouse Concepts, RDBMS System, No SQL Databases, Apache Tools like Ni-fi, Kafka etc. Experience in Cloudera data platform is preferred. Required Qualification: Bachelor's or Masterâs degree in Computer Science, IT or any Engineering field. Show more Show less
