Engineer 3

As a Data Engineer with 3-5 years of experience, your role will involve implementing scalable and sustainable data engineering solutions using tools like Databricks, Snowflake, Teradata, Apache Spark, and Python. You will be responsible for creating, maintaining, and optimizing data pipelines as workloads transition from development to production for specific use cases. Your ownership will extend to end-to-end development tasks, including coding, testing, debugging, and deployment. Your key responsibilities will include: - Driving automation through the use of modern tools and techniques to automate repeatable data preparation and integration tasks, thereby enhancing productivity. - Mapping data across source systems, data warehouses, and data marts. - Training counterparts in data pipelining and preparation techniques to facilitate easier integration and consumption of required data. - Collaborating with other technology teams to extract, transform, and load data from diverse sources. - Promoting data and analytics capabilities to business unit leaders and guiding them on leveraging these capabilities to achieve their business objectives. - Writing SQL queries transformed into Python code running on a distributed system. - Developing reusable code libraries. - Demonstrating eagerness to learn new technologies in a dynamic environment. - Possessing excellent communication skills. Good to have qualifications: - Experience with data pipeline and workflow management tools like Rundeck, Airflow, etc. - Proficiency in AWS cloud services such as EC2, EMR, RDS, and Redshift. - Familiarity with stream-processing systems like Spark-Streaming. If there are any additional details about the company in the job description, please provide them separately.,