Senior Consultant - Databricks

You are a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. Your focus will be on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions. - Design, develop, and operationalize scalable data pipelines on Databricks following medallion architecture principles. - Migrate and transform large data volumes from traditional on-prem systems (Oracle, Hadoop, Exadata) into cloud data platforms. - Develop efficient Spark (PySpark/Scala) jobs for ingestion, transformation, aggregation, and publishing of data. - Implement data quality checks, error handling, retries, and data validation frameworks. - Build automation scripts and CI/CD pipelines for Databricks workflows and deployment. - Tune Spark jobs and optimize cost and performance in cloud environments. - Collaborate with data architects, product owners, and analytics teams. - 6+ years of hands-on data engineering experience, with 2+ years specifically working on Databricks in Azure or AWS. - Proficiency in building and optimizing Spark pipelines (batch and streaming). - Strong experience implementing bronze/silver/gold data models. - Working knowledge of cloud storage systems (ADLS, S3) and compute services. - Experience migrating data from RDBMS (Oracle, SQL Server) or Hadoop ecosystems. - Familiarity with Airflow, Azure Data Factory, or AWS Glue for orchestration. - Good scripting skills (Python, Scala, SQL) and version control (Git). Oracle, as a world leader in cloud solutions, partners with industry-leaders in almost every sector and continues to thrive after 40+ years of change by operating with integrity. Oracle believes that true innovation starts when everyone is empowered to contribute. They are committed to growing an inclusive workforce that promotes opportunities for all. Oracle offers competitive benefits based on parity and consistency, supports employees with flexible medical, life insurance, and retirement options, and encourages giving back to communities through volunteer programs. Oracle is also committed to including people with disabilities at all stages of the employment process. If accessibility assistance or accommodation for a disability is required, individuals can reach out by emailing accommodation-request_mb@oracle.com or by calling +1 888 404 2494 in the United States.,