Senior Data Engineer

About Delta Air Lines About the Company Delta Air Lines NYSE DAL is the U S global airline leader in safety innovation reliability and customer experience Powered by our employees around the world Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service With our mission of connecting the people and cultures of the globe Delta strives to foster understanding across a diverse world and serve as a force for social good In 2024 Delta was recognized by Fortune with a No 11 placement on Fortune s Top 50 Most Admired Companies list The company s strong management and commitment to providing elevated experiences and premium products also secured a No 1 ranking out of the eight airlines on the list Delta landed on TIME s inaugural list of the World s Best Companies coming in at No 12 - the only U S airline in the top 155 TIME s award is based on three criteria employee satisfaction revenue growth and sustainability Delta s people-first culture continues to be recognized earning the airline a spot on Fortune s 100 Best Companies to Work For list for the fifth year Delta is the only airline included on the 2024 list Additionally Delta earned a coveted spot on Fast Company s list of the Most Innovative Companies climbing from its No 8 spot in 2023 to No 2 in the travel category The airline was recognized for its Wi-Fi revolution that is working to ensure the future of travel is connected About the Delta Technology Hub DTH Bangalore Delta has fast emerged as a customer-focused innovation-led technology-enabled business The Delta Technology Hub will contribute directly to these objectives Primary Functions Data Pipeline Development Design build and maintain scalable ETL ELT pipelines for ingesting processing and transforming social media data from various sources Real-Time Data Streaming Set up and manage real-time data processing pipelines using tools such as Apache Kafka or Spark Streaming Data Quality Assurance Implement rigorous validation processes to ensure social data accuracy consistency and integrity across all datasets Collaboration Work closely with data scientists analysts marketers and software engineers to provide clean structured datasets for analysis and reporting Monitoring Optimization Monitor pipeline performance troubleshoot issues and optimize data workflows for efficiency and scalability Lead and mentor other junior members within the team What you need to succeed minimum qualifications Bachelor of Science in Computer Science Engineering Information Systems or equivalent experience At least 3 years of post-degree professional experience as a Senior data engineer developing and maintaining ETL data pipelines Hands-on experience with databases and cloud platforms Teradata and AWS and Data Modeling Ability to create clean well-designed code and systems Proven ability to work with large and complex datasets Proficiency in Python and Spark and SQL Strong analytical and programming skills with the ability to solve data-related challenges efficiently Demonstrated ability to use data to solve marketing-related business problems Experience in collaborating with non-technical stakeholders to deliver data-driven solutions that align with business goals Strong attention to detail and a commitment to data accuracy Proven ability to learn new data models quickly and apply them effectively in a fast-paced environment Excellent communication skills with the ability to present complex data findings to both technical and non-technical audiences What will give you a competitive edge preferred qualifications Experience working in marketing operations and the airline industry Experience migrating data pipelines and systems to modern cloud-based solutions Familiarity working with Deltas internal data ecosystem ex RPAD Proficiency in Shell scripting to support automated processes data transfers and system integrations Familiarity in SFMC Automation Studio to build and manage automated workflows including data extracts file imports and API integrations ID DELBB03