Lead Data Engineer

TransUnion's Job Applicant Privacy Notice

What We'll Bring:

Data Pipeline Engineer at Orion project are embedded within our engineering teams and support the development and operation.

What You'll Bring:

Lead Data Engineer

What We Offer

We are looking for an individual to be part of an autonomous, cross-functional agile/scrum team where everyone shares responsibility for all aspects of the work.

The ideal candidate will have a strong interest to join our growing Data Engineering and Analytics track of GFS Core services who will drive building next generation suite of products and platform by designing, coding, building and deploying highly scalable and robust solutions. We are looking for enthusiastic professionals who are excited to learn, love a good challenge, and are always looking for opportunities to contribute. Finally yet importantly, we look for dedicated team players who enjoy collaboration and can work effectively with others to achieve common goals. 

TransUnion is currently seeking a Lead Data Engineer with 7+ years' experience to work in our Chennai office, India. You will be working with some of the latest tools and a great team of cross-functional engineers. We work with multiple technologies. This will be an opportunity to work on core services of an industrial strength Identity and Risk solution by streamlining design and collaborating with the team to build orchestration platform in cloud.

Who We Are

At TransUnion, we are dedicated to finding ways information can be used to help people make better and smarter decisions. As a trusted provider of global information solutions, our mission is to help people around the world access the opportunities that lead to a higher quality of life, by helping organizations optimize their risk-based decisions and enabling consumers to understand and manage their personal information. Because when people have access to more complete and multidimensional information, they can make decisions that are more informed and achieve great things. Every day TransUnion offers our employees the tools and resources they need to find ways information can be used in diverse ways.

What you'll bring:

• Bachelor's Degree in a quantitative field, plus 7+ years of work experience or equivalent practical experience.

• 5+ years of experience in Big Data technologies

• Experience designing and implementing data pipelines

• Experience with SQL, PostgreSQL and/or Redshift, or other data management, reporting and query tools.

• Big Data Technologies – Hadoop HDFS, Hive, Spark, Kafka, Sqoop

• Designing Logical Data Model and Physical Data Models including data warehouse and data mart designs.

• Expertise in writing complex, highly optimized queries across large data sets to write data pipelines and data processing layers.

• Cloud System experience on AWS, Azure, GCP –Preferably GCP

• Coach / Mentor / Lead a team of Data Engineers

• Design, build, test and deploy cutting edge Big Data solutions at scale

• Extract, Clean, transform, and analyze vast amounts of raw data from various Data Sources

• Build data pipelines and API integrations with various internal systems

• Proactively monitor, identify, and escalate issues or root causes of systemic issues

• Evaluate and communicate technical risks effectively and ensure assignments delivery in scheduled time with desired quality

• Work across Data Engineering, Data Architecture, Data Visualization functions

What we'll bring:

• At TransUnion, we have a welcoming and energetic environment that encourages collaboration and innovation we're – consistently exploring new technologies and tools to be agile. This environment gives our people the opportunity to hone current skills and build new capabilities, while discovering their genius.

• Come be a part of our team – you will work with great people, pioneering products and cutting-edge technology.

• This role is for a Lead Data Engineer that will operate as a lead for Data Pipeline track and responsible for development of the global fraud solutions of TransUnion.

• We pride ourselves in working in a collaborative cross-functional manner where all engineers are expected to contribute to design, build, deployment and operation of our cloud platform.

Technical Leadership:
Design/build scalable data pipelines using Java, Spark, PySpark, BigQuery, and AWS (S3, , EMR).
Implement real-time data solutions with Kafka and Nifi.
Optimize distributed systems (Spark/Kubernetes) for performance and cost.
Team Management:
Mentor junior engineers, conduct code reviews, and unblock technical challenges.
Drive agile processes (sprint planning, task grooming).
Data Solutions:
Architect relational and NoSQL databases for transactional/analytical workloads.
Develop reporting tools for big data (e.g., Tableau, Metabase).
Troubleshoot data quality/performance issues end-to-end.
Innovation:
Research new technologies (e.g., Delta Lake, Flink) for feature development.

Location:   Chennai

Job Type: Full-time day job

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability status, veteran status, marital status, citizenship status, sexual orientation, gender identity or any other characteristic protected by law.

Impact You'll Make:

N/A

This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.

TransUnion Job Title

Lead Developer, Software Development

---