Databricks AWS DE Consultant

Role Overview: You will be responsible for designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools to process large datasets and extract actionable business insights. Your role will involve building metrics deck and dashboards for KPIs, including the underlying data models. Additionally, you will be required to design, implement, and maintain a platform providing secured access to large datasets. Key Responsibilities: - Hold a Bachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline - Possess 5+ years of relevant experience in data engineering roles - Demonstrate detailed knowledge of data warehouse technical architectures, data modeling, infrastructure components, ETL/ ELT, and reporting/analytic tools and environments - Exhibit proficiency in programming languages, especially Python - Utilize Databricks for designing, developing, and maintaining data pipelines and solutions - Work with Apache Spark and related tools like Unity Catalog, Workflow, Autoloader, delta sharing - Utilize AWS services such as Redshift, S3, EC2, Lambda, Athena, EMR, AWS Glue, Datapipeline Qualifications Required: - Bachelor's degree in a technical discipline - 5+ years of experience in data engineering - Knowledge of data warehouse architectures, ETL/ELT, and reporting tools - Proficiency in Python - Experience with Databricks and Apache Spark - Familiarity with AWS services like Redshift, S3, EC2, Lambda, Athena, EMR, AWS Glue, Datapipeline,