Job
Description
About The Role
Skill required: Data Management - Microsoft Azure Databricks
Designation: Data Eng, Mgmt & Governance Assoc Mgr
Qualifications:BE/BTech
Years of Experience:10 to 14 years
What would you do? Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song all powered by the worlds largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 countries. We embrace the power of change to create value and shared success for our clients, people, shareholders, partners and communities. Visit us at www.accenture.com.We are looking for a Senior Data Engineer with 9+ years of experience in Databricks for complex queries on transformation, aggregation, business logic implementation aggregation, business logic implementation.sFor this role candidate must be able to understand the current data platform landscape & tools and work closely with data modeller.An interactive workspace that combines data gathering to model creation, use Databricks Notebooks to unify the process and instantly deploy to production. Integrates with a wide variety of data stores and services such as Azure SQL Data Warehouse, Azure Cosmos DB, Azure Data Lake Store, Azure Blob storage, Azure Event Hubs, Azure IoT Hub, and Azure Data Factory.
What are we looking for? Databricks for complex queries on transformation, aggregation, business logic implementation aggregation, business logic implementation AWS Redshift and Redshift spectrum, for complex queries on transformation, aggregation, business logic implementation DWH Concept on star schema, Materialize view concept Strong SQL and data manipulation/transformation skills Ability to perform under pressure Problem-solving skills Prioritization of workload Strong analytical skills Ability to manage multiple stakeholders Experience of ETL/Data warehousing/Data integration/Data Lake Data engineering end to end experience e.g., Data ingestion, cleansing, harmonization/integration, quality, security, etc Experience in working Databricks, Python/PySpark scripts and understanding of Spark Maintain the code repos, and version control of codes, terraform knowledge Experience working in a geographically disparate team
Roles and Responsibilities: Identifying data sources, both internal and external, and ingest the data to the platform in automated way with all standard ways-of-working Coordinating and collaborating with data-modeller, stakeholders, and vendors for the smooth functioning of the enterprise data warehouse EDW Managing end-to-end data flow, from ingestion, data engineering in data vault, maintain code repos, and developing the application to finally testing and implementing the proposed solution Ensuring that all testing requirements as well as all test data are well-prepared and documented
Qualification BE,BTech