Job
Description
P3 5.5 8 Years Data Engineer SQL, Python, Pyspark, Data Engineer, Databricks, ETL 23 LPA fixed Immediate Joiners preferred P4 8 – 10 Years Sr. Data Engineer SQL, Python, ETL, Pyspark, Data Engineer, Databricks 28 LPA fixed Minimum 8 years of experience in data analytics field Experience with Azure/AWS Databricks Experience in building and optimizing data pipelines, architectures and data sets Excellent experience in Scala or Python, PySpark and SQL Ability to troubleshoot and optimize complex queries on the Spark platform Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS Hands on experience in performance tuning and optimizing code running in Databricks environment Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment Technical / Professional Skills Please provide at least 3 Azure/AWS Databricks Python / Scala / Spark / PySpark HIVE / HBase / Impala / Parquet Sqoop, Kafka, Flume SQL and RDBMS Airflow Good to have Relevant accredited certifications for Azure, AWS, Cloud Engineering and/or Databricks Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, Azure Jenkins / Bamboo Github / Bitbucket Nexus
