12 Elt Frameworks Jobs

As a Data Warehouse Administrator at our company, you will play a critical role in managing, monitoring, and optimizing our enterprise data warehousing environment with a strong focus on Snowflake. Your responsibilities will include: - **Snowflake Administration**: - Manage Snowflake accounts, warehouses, databases, roles, and users. - Monitor performance, resource usage, and optimize warehouse configurations. - Handle data replication, failover, and disaster recovery setup. - **Data Management & Security**: - Implement security best practices such as RBAC, masking, and encryption. - Support data governance and compliance requirements like GDPR and HIPAA. - **ETL/ELT & Data Integration Suppo...

As a dynamic Data Engineer with strong hands-on experience in Databricks Lakehouse Platform, your role will involve building and optimizing scalable data solutions on AWS or Azure. You should have a solid foundation in data engineering and distributed data processing, specifically Spark/PySpark, along with a deep understanding of Delta Lake, Medallion Architecture, and Databricks-native tools. Your contributions will be crucial in designing modern ELT pipelines, ensuring data quality, performance, and governance, and collaborating across teams to deliver high-impact analytics and AI-ready datasets. Key Responsibilities: - Design and implement end-to-end data pipelines in Databricks using Spa...

We are seeking a dynamic Data Engineer with strong hands-on experience in Databricks Lakehouse Platform to build and optimize scalable data solutions on AWS or Azure. The ideal candidate will have a solid foundation in data engineering and distributed data processing (Spark / PySpark), with a deep understanding of Delta Lake, Medallion Architecture, and Databricks-native tools. You will play a key role in designing modern ELT pipelines, ensuring data quality, performance, and governance, and collaborating across teams to deliver high-impact analytics and AI-ready datasets. Key Responsibilities Design and implement end-to-end data pipelines in Databricks leveraging Spark (PySpark), SQL, and D...

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We're looking for people who are determined to make life better for people around the world. About the Tech@Lilly Organization: Tech@Lilly builds and maintains capabilities using cutting edge technologies like most prominent tech companies. Wh...

As a Senior BI Engineer specializing in PowerBI, your role involves designing, developing, and deploying business intelligence solutions to facilitate data-driven decision-making for clients. You will collaborate with business users and stakeholders to understand processes and requirements, providing high-level design and estimates for data transformation and integration. Your responsibilities also include developing database queries, creating visualizations and reports, and identifying opportunities for process improvement through technology solutions. Key Responsibilities: - Design, develop, and deploy business intelligence solutions - Collaborate with business users and stakeholders - Pro...

As an experienced Snowflake Engineer, your role will involve designing and delivering scalable, cloud-native data solutions to support analytics and decision-making in a multi-ERP enterprise landscape. You will be responsible for a combination of architecture, hands-on engineering, and solution delivery using technologies such as Snowflake, Power BI, Azure, Matillion, and dbt. Your contributions will help establish the foundation for real-time insights, cross-system integrations, and AI/ML use cases that drive business impact. **Key Responsibilities:** - Design and implement high-performance, cloud-native data pipelines for large-scale data ingestion, transformation, and delivery. - Develop ...

Job Title: Databricks SQL Engineer with Commercial Pharma Location: Remote Type: Contract About the Role: We are looking for a Databricks SQL Engineer to design, develop, and optimize data solutions using Databricks SQL. The ideal candidate will have expertise in SQL, performance tuning, data modeling, and cloud-based data platforms such as AWS, Azure, or GCP. Key Responsibilities: Develop and optimize SQL queries and notebooks in Databricks for data transformation, aggregation, and analysis. Optimize Databricks SQL workloads for performance, cost, and scalability. Monitor, debug, and troubleshoot Databricks SQL queries and jobs. Required Qualifications: 4+ years of experience with SQL devel...

As a Data Warehouse Administrator, you will play a crucial role in managing, monitoring, and optimizing the enterprise data warehousing environment with a focus on Snowflake. Your responsibilities will include: - **Snowflake Administration**: - Manage Snowflake accounts, warehouses, databases, roles, and users. - Monitor performance, resource usage, and optimize warehouse configurations. - Handle data replication, failover, and disaster recovery setup. - **Data Management & Security**: - Implement security best practices such as RBAC, masking, and encryption. - Support data governance and compliance requirements like GDPR and HIPAA. - **ETL/ELT & Data Integration Support**: - Collaborate wit...

About the Tech@Lilly Organization: Tech@Lilly builds and maintains capabilities using cutting edge technologies like most prominent tech companies. What differentiates Tech@Lilly is that we create new possibilities through tech to advance our purpose u2013 creating medicines that make life better for people around the world, like data driven drug discovery and connected clinical trials. We hire the best technology professionals from a variety of backgrounds, so they can bring an assortment of knowledge, skills, and diverse thinking to deliver innovative solutions in every area of the enterprise. About the Business Function: Tech@Lilly Business Units is a global organization strategically pos...

You are a Senior BI Engineer with 3-8 years of experience, specializing in PowerBI. Your role involves designing, developing, and deploying business intelligence solutions to empower clients in making data-driven decisions. You will collaborate with business users and stakeholders to comprehend business processes and requirements. Providing research, high-level design, and estimates for data transformation and integration are also key responsibilities. Your expertise includes developing and executing database queries, creating visualizations and reports, and working on Data Gateways for data refreshing. You will be involved in creating Custom Visuals, managing Embed Codes, and identifying op...

Key Responsibilities Design, develop, and deploy SIEM workflows that automate and streamline the detection, analysis, and response to security events Customize workflows to meet specific SIEM requirements and improve operational efficiency Develop and maintain SIEM connectors to integrate various data sources, including network devices, servers, applications, and cloud environments Ensure reliable data ingestion and normalization across diverse sources to provide comprehensive security monitoring Work with ELT (Extract, Load, Transform) frameworks to integrate and process security data from multiple sources Leverage technologies such as Kafka, AWS Data Catalog, AWS Glue, and Athena to manage...

Job Qualifications Technical Expertise Strong experience with SIEM platforms and best practices in security operations, threat detection, and incident response Proficiency in scripting languages (Python, Bash, JavaScript, PowerShell) for automation and custom development Experience with data management tools such as ELT frameworks, Kafka, AWS Data Catalog, AWS Glue, and Athena Solid understanding of cloud services, particularly AWS, and experience automating tasks with Boto3 Experience in building FedRAMP-compliant systems is a plus Strategic and Analytical Skills Ability to think strategically and recommend system design improvements to enhance security operations Strong analytical skills t...