15 Etl Frameworks Jobs

About Tarento Tarento is a fast-growing technology consulting company headquartered in Stockholm, with a strong presence in India and clients across the globe. We specialize in digital transformation, product engineering, and enterprise solutions, working across diverse industries including retail, manufacturing, and healthcare. Our teams combine Nordic values with Indian expertise to deliver innovative, scalable, and high-impact solutions. We&aposre proud to be recognized as a Great Place to Work , a testament to our inclusive culture, strong leadership, and commitment to employee well-being and growth. At Tarento, youll be part of a collaborative environment where ideas are valued, learning is continuous, and careers are built on passion and purpose. Must-Have Skills 1015 years of experience in data engineering/architecture with leadership roles Expertise in PySpark, AWS Glue, and designing scalable cloud-native systems Proven experience architecting large-scale batch and real-time data platforms Advanced design proficiency in S3-based data lakes and related optimization techniques Practical knowledge of AWS services: Lambda, Athena, IAM, CloudWatch, Step Functions, IoT FleetWise, IoT Core, MSF, MSK Strong technical leadership and ability to mentor teams Demonstrated domain experience in connected vehicles, IoT/telemetry, or streaming platforms Good-to-Have Skills Familiarity with OpenSearch or Elasticsearch Experience with Snowflake and real-time data technologies (Kafka, Flink, Kinesis) Understanding of distributed system designs Key Responsibilities Lead strategy and design for data platforms in connected vehicle and digital mobility products Translate business requirements into detailed technical architecture, including integration, security, and data flow Design and manage robust ETL frameworks using cloud-native tools Architect systems to handle high-throughput telemetryover 1 billion records per minute Develop decisions regarding data formats, partitioning, metadata, schema evolution, and monitoring Knowledge of CI/CD, Infrastructure as Code (IaC), and optimal cloud provisioning Facilitate cross-team alignment for seamless cloud-to-device telemetry Partner with executives and R&D to influence long-term data solutions Who You Are Visionary architect focused on future-proof, scalable data systems Strategic thinker with strong communication skills for both technical and executive audiences Change agent comfortable in fast-evolving environments Eligibility Education: BTech/MTech in Computer Science, Data Engineering, or related field Experience: Minimum 10 years in architecture, data engineering, or cloud platform leadership Why Join Lead innovation in next-gen mobility for millions globally Work with advanced technologies in high-volume data environments Flourish in a growth-focused, flexible, and learning-driven culture Show more Show less

About Sigmoid: Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the worlds leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data modernization, predictive analytics, generative AI, and DataOps, supported by 10+ delivery centers and innovation hubs, including a major global presence in Bengaluru and operations across the USA, Canada, UK, Netherlands, Poland, Singapore, and India. Recognized as a leader in the data and analytics space, Sigmoid is backed by Peak XV Partners and has consistently received accolades for innovation and rapid growth. Highlights include being named a Leader in ISGs Specialty Analytics Services for Supply Chain (2024), a two-time India Future Unicorn by Hurun India, and a four-time honoree on both the Inc. 500 and Deloitte Technology Fast 500 lists. Director - Data Analytics: This role will be a leadership position in the data science group at Sigmoid. An ideal person will come from a services industry background with a good mix of experience in solving complex business intelligence and data analytics problems, team management, delivery management and customer handling. This position will give you an immense opportunity to work on challenging business problems faced by fortune 500 companies across the globe. The role is part of the leadership team and includes accountability for a part of her/his team and customers. The person is expected to be someone who can contribute in developing the practice with relevant experience in the domain, nurturing the talent in the team and working with customers to grow accounts. Responsibilities Include Build trust with senior stakeholders through strategic insight and delivery credibility. Ability to translate ambiguous client business problems into BI solutions and ability to implement them. Oversight of multi-client BI and analytics programs with competing priorities and timelines, while collaborating with Data Engineering and other functions on a common goal. Ensure scalable, high-quality deliverables aligned with business impact. Help recruiting and onboarding team members; directly manage 15 - 20 team members. You would be required to own customer deliverables and ensure, along with project managers, that the project schedules are in line with the expectations set to the customers. Experience and Qualifications 15+ years of overall experience with a minimum of 10+ years in data analytics execution. Strong organizational and multitasking skills with the ability to balance multiple priorities. Highly analytical with the ability to collate, analyze and present data and drive clear insights to lead decisions that improve KPIs. Ability to effectively communicate and manage relationships with senior management, other departments and partners. Mastery of BI tools (Power BI, Tableau, Qlik), backend systems (SQL, ETL frameworks) and data modeling. Experience with cloud-native platforms (Snowflake, Databricks, Azure, AWS), data lakes. Expertise in managing compliance, access controls, and data quality frameworks is a plus. Experience working in CPG, Supply Chain, Manufacturing and Marketing domains are a plus. Strong problem-solving skills and ability to prioritize conflicting requirements. Excellent written and verbal communication skills and ability to succinctly summarize the key findings. Show more Show less

The ideal candidate for the Big Data Engineer role should have 3-6 years of experience and be located in Hyderabad. You should possess strong skills in Spark, Python/Scala, AWS/Azure, Snowflake, Databricks, SQL Server/NoSQL. As a Big Data Engineer, your main responsibilities will include designing and implementing data pipelines for both batch and real-time data processing. You will need to optimize data storage solutions for efficiency and scalability, collaborate with analysts and business teams to meet data requirements, monitor data pipeline performance, and troubleshoot any issues that arise. It is crucial to ensure compliance with data security and privacy policies. The required skills for this role include proficiency in Python, SQL, and ETL frameworks, experience with big data tools such as Spark and Hadoop, a strong knowledge of cloud services and databases, as well as familiarity with data modeling and warehousing concepts.,

You will be working as a Jr. SQL Developer with 1 to 3 years of experience at our office in Pune. Your responsibilities will include working as a Data Analyst or Business Data Analyst, possessing technical expertise in data models, database design development, data mining, and segmentation techniques. You should have a strong knowledge of databases such as SQL, ETL frameworks, Excel, SSIS, etc. Strong analytical skills are required for collecting, organizing, analyzing, and presenting information with attention to detail and accuracy. You should be adept at queries, report writing, and presenting findings effectively. In addition to the job role, you will have the opportunity to be part of one of the top 30 preferred workplaces in India. Professional development opportunities will be provided to pursue career aspirations beyond the current role. The company promotes work-life balance, offers freedom in the workplace, diversified industry domain experience, exposure to technology and product innovations, and joyful employee engagement activities. As part of the screening process, you will be asked about your work experience with SQL Developer, your comfort with commuting to the job location in Pune, and your availability to start immediately. If you are enthusiastic about working in a dynamic environment, contributing to business intelligence, and enhancing your technical skills, this role at AutoFlowTech could be the perfect fit for you.,

As a Senior Google Cloud Architect in Pune (Hybrid) with over 10 years of experience, including 3+ years specifically on GCP, you will play a crucial role in leading the design and delivery of comprehensive cloud solutions on Google Cloud Platform. Your responsibilities will involve collaborating with data engineering, DevOps, and architecture teams to create scalable, secure, and cost-effective cloud platforms. Your key responsibilities will include designing scalable data and application architectures utilizing tools such as BigQuery, Dataflow, Composer, Cloud Run, Pub/Sub, and other related GCP services. You will be leading cloud migration, modernization, and CI/CD automation through the use of technologies like Terraform, Jenkins, GitHub, and Cloud Build. Additionally, you will be responsible for implementing real-time and batch data pipelines, chatbot applications using LLMs (Gemini, Claude), and automating reconciliation and monitoring processes. Your role will also involve collaborating closely with stakeholders to ensure technical solutions align with business objectives. The ideal candidate for this role should have a minimum of 3 years of experience working with GCP and possess a strong proficiency in key tools such as BigQuery, Dataflow, Cloud Run, Airflow, GKE, and Cloud Functions. Hands-on experience with Terraform, Kubernetes, Jenkins, GitHub, and cloud-native CI/CD is essential. In addition, you should have a solid understanding of DevSecOps practices, networking, and data architecture concepts like Data Lake, Lakehouse, and Mesh. Proficiency in Python, SQL, and ETL frameworks such as Ab Initio is also required. Preferred qualifications for this role include GCP Certifications (Cloud Architect, DevOps, ML Engineer), experience with Azure or hybrid environments, and domain expertise in sectors like Banking, Telecom, or Retail.,

You will be responsible for building the most personalized and intelligent news experiences for India's next 750 million digital users. As Our Principal Data Engineer, your main tasks will include designing and maintaining data infrastructure to power personalization systems and analytics platforms. This involves ensuring seamless data flow from source to consumption, architecting scalable data pipelines to process massive volumes of user interaction and content data, and developing robust ETL processes for large-scale transformations and analytical processing. You will also be involved in creating and maintaining data lakes/warehouses that consolidate data from multiple sources, optimized for ML model consumption and business intelligence. Additionally, you will implement data governance practices and collaborate with the ML team to ensure the right data availability for recommendation systems. To excel in this role, you should have a Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field, along with 8-12 years of data engineering experience, including at least 3 years in a senior role. You must possess expert-level SQL skills and have strong experience in the Apache Spark ecosystem (Spark SQL, Streaming, SparkML), as well as proficiency in Python/Scala. Experience with the AWS data ecosystem (RedShift, S3, Glue, EMR, Kinesis, Lambda, Athena) and ETL frameworks (Glue, Airflow) is essential. A proven track record of building large-scale data pipelines in production environments, particularly in high-traffic digital media, will be advantageous. Excellent communication skills are also required, as you will need to collaborate effectively across teams in a fast-paced environment that demands engineering agility.,

You should have 3-5 years of experience as a Data Analyst and possess expertise in data-driven problem solving. Your skills should include proficiency in Data Modelling, Data Mining, and Data Segmentation Methods. You must excel in analytical thinking, business modelling, and problem-solving. Advanced Microsoft Excel skills are a must, along with experience working with MS SQL. Knowledge of R Programming is essential, as well as experience with XML, ETL frameworks, and JavaScript. You should be adept at creating queries and reports and having experience with QlikView/Tableau will be advantageous. A good understanding of Microsoft Office and excellent communication skills, both verbal and written, are required. As a Data Analyst, your responsibilities will include applying Data Modelling, Data Mining, and Data Segmentation techniques to the available data. You will be expected to identify and analyze trends or patterns in complex data sets using statistical methods and interpret the data based on the analyzed trends and patterns. Collaboration with management to prioritize business requirements and identifying improvement opportunities in business processes will also be part of your role. This is a Full-Time position located in Vadodara. The educational requirements for this role include a BE (IT), BE (CS), MCA, MSC (IT), BSC in Statistics, or MSC in Statistics. Salary details will be discussed in person. Please send your resume to info@99plusitsolutions.com or 99plusit@gmail.com for consideration.,

Join us as an AWS Developer at Barclays, where you will play a crucial role in supporting the successful delivery of Location Strategy projects. Your responsibilities will include ensuring that projects are completed within the planned budget, meeting quality standards, and adhering to governance protocols. You will be at the forefront of transforming our digital landscape, driving innovation, and striving for excellence to enhance our digital offerings and provide customers with exceptional experiences. As an AWS Developer, your key experience should encompass: - Proficiency in AWS cloud services like S3, Glue, Athena, Lake Formation, and CloudFormation. - Advanced skills in Python for data engineering and automation. - Familiarity with ETL frameworks, data transformation, and data quality tools. Additionally, highly valued skills may involve: - AWS Data Engineer certification. - Previous experience in the banking or financial services sector. - Knowledge of IAM and Permissions management in AWS cloud. - Experience with Databricks, Snowflake, Starburst, and Iceberg. Your performance will be evaluated based on essential skills crucial for success in this role, including risk and controls management, change and transformation capabilities, strategic thinking, and proficiency in digital and technology. You will also be assessed on job-specific technical skills relevant to the position. This position is located in Pune and aims to: - Develop and maintain systems for collecting, storing, processing, and analyzing data to ensure accuracy, accessibility, and security. - Build and manage data architectures pipelines for transferring and processing data effectively. - Design data warehouses and data lakes that handle data volumes, velocity, and security requirements. - Develop algorithms for processing and analyzing data of varying complexity and volumes. - Collaborate with data scientists to construct and deploy machine learning models. As an Assistant Vice President, you are expected to provide guidance, influence decision-making processes, contribute to policy development, and ensure operational efficiency. You will lead a team in executing complex tasks, set objectives, coach employees, evaluate performance, and determine reward outcomes. If you have leadership responsibilities, you must exhibit leadership behaviors such as listening, inspiring, aligning, and developing others. For individual contributors, the role involves leading collaborative assignments, guiding team members, identifying the need for specialized input, proposing new directions for projects, and consulting on complex issues. You will also be responsible for risk management, policy development, and ensuring compliance with governance standards. All colleagues are required to embody the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, as well as demonstrate the Barclays Mindset of Empower, Challenge, and Drive, guiding our behavior and decisions.,

As the Head of Data Analyst, you will lead the data analytics team to leverage data effectively for driving strategic business decisions and enhancing operational efficiency. Your primary responsibilities will include overseeing the development and execution of data analytics strategies in alignment with organizational goals. This role demands a blend of technical proficiency, leadership capabilities, and business acumen to foster innovation and extract maximum value from data assets. You will be responsible for leading complex projects from start to finish, showcasing expertise in business and functional domains. Serving as a subject matter expert, you will offer guidance to cross-functional teams and stakeholders on best practices and innovative solutions. Additionally, you will take charge of owning Business Success Metrics for all clients, focusing on continuous improvement through detailed analysis of customer data sets. Your role will involve mentoring the team of Data Analysts to enable them to autonomously achieve target Success Metrics for their respective clients. Furthermore, you will drive initiatives for continuous improvement to streamline processes and workflows. Collaboration with senior leadership will be essential in designing and executing strategic objectives that align with organizational aspirations. Research and analysis will be crucial aspects of your role to identify emerging industry trends and opportunities. Timely delivery of high-quality work within specified timelines, while ensuring adherence to company standards and policies, will be a key accountability. Building and nurturing strong relationships with clients, partners, and vendors to foster collaboration and achieve mutually beneficial outcomes will be paramount. Staying updated on industry advancements and engaging in professional development activities to uphold your expertise will also be expected. **Requirements:** - Bachelor's/Master's Degree in Computer Science/Information Technology - 8-12 years of proven work experience in Data and Business Analysis - Proficiency in data models, database design development, data mining, and segmentation techniques - Hands-on experience with SQL, reporting packages (e.g., Business Objects), and programming languages (e.g., XML, Javascript, ETL frameworks) - Strong numerical aptitude with experience working on large datasets - Proficiency in statistics and using statistical packages for data analysis (e.g., Excel, SPSS, SAS) - Excellent analytical skills with the ability to collect, organize, analyze, and present information with precision and attention to detail - Proficient in queries, report writing, and presenting findings - Exceptional written and verbal communication skills This role as the Head of Data Analyst offers a challenging yet rewarding opportunity to lead a dynamic team in leveraging data insights for driving organizational success and innovation.,

The opportunity available at EY is for a Bigdata Engineer based in Pune, requiring a minimum of 4 years of experience. As a key member of the technical team, you will collaborate with Engineers, Data Scientists, and Data Users in an Agile environment. Your responsibilities will include software design, Scala & Spark development, automated testing, promoting development standards, production support, troubleshooting, and liaising with BAs to ensure correct interpretation and implementation of requirements. You will be involved in implementing tools and processes, handling performance, scale, availability, accuracy, and monitoring. Additionally, you will participate in regular planning and status meetings, provide input in Sprint reviews and retrospectives, and contribute to system architecture and design. Peer code reviews will also be a part of your responsibilities. Key technical skills required for this role include Scala or Java development and design, experience with technologies such as Apache Hadoop, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, and ETL frameworks. Hands-on experience in building data pipelines using Hadoop components and familiarity with version control tools, automated deployment tools, and requirement management is essential. Knowledge of big data modelling techniques and debugging code issues are also necessary. Desired qualifications include experience with Elastic search, scheduling tools like Airflow and Control-M, understanding of Cloud design patterns, exposure to DevOps & Agile Project methodology, and Hive QL development. The ideal candidate will possess strong communication skills, the ability to collaborate effectively, mentor developers, and lead technical initiatives. A Bachelors or Masters degree in Computer Science, Engineering, or a related field is required. EY is looking for individuals who can work collaboratively across teams, solve complex problems, and deliver practical solutions while adhering to commercial and legal requirements. The organization values agility, curiosity, mindfulness, positive energy, adaptability, and creativity in its employees. EY offers a personalized Career Journey, ample learning opportunities, and resources to help individuals understand their roles and opportunities better. EY is committed to being an inclusive employer that focuses on achieving a balance between delivering excellent client service and supporting the career growth and wellbeing of its employees. As a global leader in assurance, tax, transaction, and advisory services, EY believes in providing training, opportunities, and creative freedom to its employees to help build a better working world. The organization encourages personal and professional growth, offering motivating and fulfilling experiences to help individuals reach their full potential.,

About VOIS In 2009, VOIS started operating in India and now has established global delivery centers in Pune, Bangalore and Ahmedabad. With more than 14,500 employees, VOIS India supports global markets and group functions of Vodafone and delivers best-in-class customer experience through multi-functional services in the areas of Information Technology, Networks, Business Intelligence and Analytics, Digital Business Solutions (Robotics & AI), Commercial Operations (Consumer & Business), Intelligent Operations, Finance Operations, Supply Chain Operations and HR Operations and more. About VOIS India VOIS (Vodafone Intelligent Solutions) is a strategic arm of Vodafone Group Plc, creating value and enhancing quality and efficiency across 28 countries, and operating from 7 locations: Albania, Egypt, Hungary, India, Romania, Spain and the UK. Over 29,000 highly skilled individuals are dedicated to being Vodafone Group's partner of choice for talent, technology, and transformation. We deliver the best services across IT, Business Intelligence Services, Customer Operations, Business Operations, HR, Finance, Supply Chain, HR Operations, and many more. Established in 2006, VOIS has evolved into a global, multi-functional organization, a Centre of Excellence for Intelligent Solutions focused on adding value and delivering business outcomes for Vodafone Job Description Role Purpose The 2nd Line Assurance function will be responsible for monitoring and mitigating key technology risks, driving a risk awareness culture and promoting a risk-sensitive approach to processes, architectures, applications and platforms within Technology. The key technology risks currently in scope for Assurance are Cyber Security, Technology Resilience, IT Transformation, Shadow IT and Lifecycle Management. We monitor risk by working closely with local markets and Group functions testing key controls established in our policies. We mitigate risk by identifying corrective actions and reporting to key stakeholders, including the Technology leadership team and various board committees Core competencies, knowledge and experience: A technical degree :-preferred -BE/Btech Knowledge of relevant Frameworks (e.g. SOX, ISO 27001/27002, COBIT, etc) Detailed knowledge of some of the following platforms: Databases (SQL, Oracle, MySQL etc.) Reporting packages (Power BI, Qlik View, Business Objects etc.) Programming (XML, Javascript, or ETL frameworks) Applications (CRM, HR) Operating Systems (LINUX, Windows) IT Networks, Firewalls, VPNs GSM Network Infrastructure Telecommunications experience VOIS Equal Opportunity Employer Commitment India: VOIS is proud to be an Equal Employment Opportunity Employer. We celebrate differences and we welcome and value diverse people and insights. We believe that being authentically human and inclusive powers our employees growth and enables them to create a positive impact on themselves and society. We do not discriminate based on age, colour, gender (including pregnancy, childbirth, or related medical conditions), gender identity, gender expression, national origin, race, religion, sexual orientation, status as an individual with a disability, or other applicable legally protected characteristics. As a result of living and breathing our commitment, our employees have helped us get certified as a Great Place to Work in India for four years running. We have been also highlighted among the Top 5 Best Workplaces for Diversity, Equity, and Inclusion, Top 10 Best Workplaces for Women, Top 25 Best Workplaces in IT & IT-BPM and 10th Overall Best Workplaces in India by the Great Place to Work Institute in 2023. These achievements position us among a select group of trustworthy and high-performing companies which put their employees at the heart of everything they do. By joining us, you are part of our commitment. We look forward to welcoming you into our family which represents a variety of cultures, backgrounds, perspectives, and skills! Apply now, and we'll be in touch!

Exp in leveraging Graph data science concepts to solve business use cases a must. Exp with any graph tools/packages like Neo4J, MemGraph, NetworkX, GraphFrame, iGraph SQL, Python, Scala, ETL frameworks, data warehousing) Required Candidate profile Immediate Joiners

A candidate with distributed computer understanding and experience with SQL, Spark, ETL. Experience using databases like MySQL DB, Postegre, SQL, OracleAWS or Datafactory based ETL on Azure is required.

Databricks developer with deep SQL expertise to support the development of scalable data pipelines and analytics workflows, will work closely with data engineers BIanalysts to prepare clean, query-optimized datasets for reporting and modeling.

About the Role: Grade Level (for internal use): 09 The Team: Join our high-impact data analysis and reporting team within the Automotive Mastermind product organization! We are the engine that drives data-informed decision making across the company, providing critical insights and actionable intelligence to shape our products and strategy. If you thrive in a fast-paced environment and are passionate about leveraging data to solve complex problems, this is the team for you. Department overview AutomotiveMastermind provides U.S. automotive dealers with AI/behavior prediction analytics software and marketing solutions that improve the vehicle purchase process and results. The companys cloud-based technology helps dealers precisely predict automobile-buying behavior and automates the creation of microtargeted customer communications, leading to proven higher sales and more consistent customer retention. Responsibilities and Impact: Writing, communication, and refinement of requirements that explicitly convey business needs from a product and technical perspective Management of the backlog for a reporting engineering Scrum team working in the Agile framework Clear articulation and evaluation of engineering work product relative to acceptance criteria and the definition of done Development of business rules to enable effective monitoring of data inputs, identifying good data from bad data Application of deep, creative and rigorous thinking to solve broad, platform-wide technical and/or business problems What Were Looking For: Basic Required Qualifications: Bachelor's degree in Mathematics, Economics, Computer Science, Information Management or Statistics Total Experience: 4 to 6 years Minimum 3 years working experience as a Product Owner or in a similar analytical + technical role Technical experience with one or more of the following: data models, database design, data mining and segmentation techniques Strong knowledge of and experience with dimensional databases (SQL) Experience working as a member of a Scrum team using the Agile framework Additional Preferred Qualifications: Experience with visualization software packages (Data Studio, Tableau, PowerBI) Strong knowledge of and experience with reporting packages, databases (SQL), programming (XML, JavaScript, or ETL frameworks) Grade: 9 Location: Gurgaon Hybrid Mode: twice a week work from office Shift Time: 12 pm to 9 pm IST