Principal Data Engineer

2 weeks ago

Chennai, Tamil Nadu, India DTCC Full time

About this role

At DTCC, we're at the forefront of innovation in the financial markets. We're seeking a skilled Lead Software Engineer to join our team and contribute to our mission of helping our employees grow and succeed.

Key responsibilities

  • Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
  • Gather requirements and business process knowledge to transform the data in a way that's geared towards the needs of end users.
  • Creates logical and physical data flow models for ETL applications.
  • Ensure that the data architecture is scalable and maintainable.
  • Work with data modelers and business analysts to understand project requirements and convert them technical document and Jira stories.
  • Analyze data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions.
  • Document procedures for ETL pipelines and work with stakeholders for engagement and approval.
  • Automate data processes for event-driven and time-based scheduling using orchestration and workflow tools.

Requirements

  • Bachelor's degree required with a Master's or equivalent experience preferred.
  • Minimum of 6 years of related experience.
  • Minimum of 8-9 years of experience in software development leveraging Snowflake & Python.
  • Expertise in Snowflake DB and its various architecture principles, capabilities.
  • Strong hands-on Python developer with knowledge of integrating systems with Snowflake.
  • Experience with data warehousing, data architecture, ETL data pipeline, and/or data engineering environments at enterprise scale that are built on Python & Snowflake.
  • Ability to create Python/SQL procedures in Snowflake, build a data pipeline efficiently in a cost-optimizing and performance-efficient way.
  • Proficient understanding of code versioning tools - Git, Mercurial, SVN.
  • Knowledge of Python API frameworks such as Django/Flask/Fast.
  • Understanding of fundamental design principles behind a scalable application.
  • Ability to create database schemas that represent and support business processes.
  • Strong unit test and debugging skills.
  • Ability to build proof-of-concept projects.
  • Knowledge of SDLC, Testing & CI/CD aspects such as Jenkins, BB, JIRA.

What we offer

  • Competitive compensation, including base pay and annual incentive.
  • Comprehensive health and life insurance and well-being benefits, based on location.
  • Pension/Retirement benefits.
  • Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
  • DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays, and a third day unique to each team or employee).

Why you'd love this job

The Development family is responsible for creating, designing, deploying, and supporting applications, programs, and software solutions. May include research, new development, prototyping, modification, reuse, re-engineering, maintenance, or any other activities related to software products used internally or externally on product platforms supported by the firm. The software development process requires in-depth subject matter expertise in existing and emerging development methodologies, tools, and programming languages. Software Developers work closely with business partners and/or external clients in defining requirements and implementing solutions.

  • Principal Digital Engineering Architect

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Summary Principal Digital Engineering ArchitectNTT DATA is seeking a Principal Digital Engineering Architect to lead the design and development of cutting-edge digital solutions. The ideal candidate will have a strong background in machine learning and software engineering, with experience in designing and implementing scalable data-driven systems.Key...

  • Principal Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India 12542 Citicorp Services India Private Limited Full time

    We are seeking a highly skilled Principal Data Engineer to join our team at 12542 Citicorp Services India Private Limited. As a Principal Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that meet the needs of our business.Key Responsibilities:Design and implement data pipelines using cloud-native...

  • Digital Engineering Principal

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Roles and Responsibilities:-Develop AI and Machine Learning Solutions that deliver strategic business impact.Lead the design and development of AI and ML systems to drive business growth and innovation.Select and implement appropriate data sets and data representation methods to ensure high-quality data and accurate model performance.Identify and mitigate...

  • Principal Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Gen Full time

    Gen is a leading global company that powers Digital Freedom through consumer brands including Norton, Avast, LifeLock, Avira, AVG, Reputation Defender, and CCleaner. Our organization is responsible for providing safety for the first digital generations. We bring innovative technology solutions in cybersecurity, privacy, and identity protection to over 500...

  • Principal Data Analyst

    6 hours ago

    Chennai, Tamil Nadu, India T D Newton Full time

    At T D Newton, we are seeking a highly skilled and motivated Principal Data Analyst to join our team.Job Overview:The Principal Data Analyst will play a key role in driving business growth by leveraging advanced data analysis and machine learning techniques. The ideal candidate will have a strong background in data science, excellent communication skills,...

  • Principal Data Analyst

    3 weeks ago

    Chennai, Tamil Nadu, India Lloyds Register Full time

    Job OverviewWe are seeking a highly skilled Principal Data Analyst to join our team at Lloyd's Register. As a Principal Data Analyst, you will be responsible for reviewing simple deliverables issued by LR Surveyors, checking for accuracy against ship data, rules, codes, standards, and LR procedures.Key ResponsibilitiesReview simple deliverables issued by LR...

  • Principal Systems Design Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India 3110 K-T India Full time

    Job OverviewAt 3110 K-T India, we are seeking a highly skilled Principal Systems Design Engineer to join our team. As a Principal Systems Design Engineer, you will be responsible for engineering activities on existing products, including the development and release of new options, features, or cost reduction improvements that provide more value to our...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...

  • Digital Engineering Principal

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Roles and Responsibilities:Data Science and Engineering: Design and develop ML systems that meet client requirements.Algorithm Research: Research and implement ML algorithms and tools to improve model performance.Data Preparation: Select and prepare appropriate data sets, ensuring quality and accuracy.Model Optimization: Identify and address differences in...

  • Principal Piping Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India McDermott International Full time

    Job Overview: The Principal Piping Engineer is a highly skilled professional responsible for developing and implementing piping solutions to address complex business issues. They will work independently to analyze problems and recommend best practices, leveraging their expertise in piping to drive business results.

  • Digital Engineering Principal

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Roles and Responsibilities:Designing and Developing Machine Learning SystemsResearching and Implementing Advanced Machine Learning Algorithms and ToolsSelecting and Preparing High-Quality Data SetsIdentifying and Addressing Data Distribution Issues Affecting Model PerformanceTransforming and Deploying Data Science PrototypesPerforming Statistical Analysis...

  • Senior Principal Piping Engineer

    1 month ago

    Chennai, Tamil Nadu, India McDermott International Full time

    Job Overview:The Senior Principal Piping Engineer is a key figure in McDermott International, responsible for tackling complex problems that have a significant impact on the business. They must identify and solve these problems proactively, ensuring the smooth management and direction of the company. With a deep understanding of piping engineering, this...

  • Principal Software Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India HEPL - A Cavinkare Group Company Full time

    Job Title: Principal Software EngineerJob Summary:HEPL, a Cavinkare Group Company, is seeking a highly skilled Principal Software Engineer to lead the development of complex Java-based web applications. The ideal candidate will have a strong background in Java programming and experience with modern frameworks and technologies.Key Responsibilities:Design,...

  • Senior Data Engineering Lead

    3 weeks ago

    Chennai, Tamil Nadu, India 12542 Citicorp Services India Private Limited Full time

    Job SummaryCiticorp Services India Private Limited is seeking a highly skilled Principal Data Engineer to join our team. As a Principal Data Engineer, you will be responsible for leading the design, development, and implementation of high-quality software products.About the RoleThe successful candidate will have a deep understanding of software development...

  • Principal Software Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India UPS India Full time

    At UPS India, we're looking for a talented Principal Software Engineer to join our team. As a key member of our Applications Development team, you'll play a critical role in designing, developing, and implementing complex software systems.About the Role:This position involves performing systems analysis and design, designing and developing moderate to highly...

  • Principal Design Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Mahindra Rise Full time

    Company:Mahindra & Mahindra LtdJob Summary:Seeking a highly skilled Principal Design Engineer to lead the design of complex seat systems.Responsibilities:Design and develop seat systems using CAD 3D modeling and 2D drafting.Collaborate with cross-functional teams to ensure design meets project requirements.Develop and maintain design documentation and...

  • Principal Software Engineer

    1 month ago

    Chennai, Tamil Nadu, India Intelsat Full time

    Job Title: Principal Software EngineerAt Intelsat, we're seeking a highly skilled Principal Software Engineer to join our innovative full-stack development team. As a foundational member of this team, you'll play a crucial role in building and supporting monitoring solutions for our growing satellite fleet.Key Responsibilities:Develop solutions to integrate...

  • Principal Engineer

    1 month ago

    Chennai, Tamil Nadu, India Technip Energies Full time

    About Technip EnergiesWe are a global and leading engineering and technology company, accelerating the energy transition. Our team of talented women and men design and deliver added value energy solutions.About the RoleWe are seeking a highly skilled Principal Engineer - Instrumentation to join our team in Chennai, India. The ideal candidate will have a...

  • Principal Mechanical Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Mahindra Rise Full time

    Job Title: Principal Mechanical Engineer - Engine Cooling SystemsAbout the Role:We are seeking a highly skilled Principal Mechanical Engineer to join our team at Mahindra Rise. As a key member of our engineering team, you will be responsible for designing and developing engine cooling systems for our LCV and pickup vehicles.Key Responsibilities:• Design...

  • Chief Data Science Engineer

    7 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...