Data Engineering Lead

2 weeks ago

Bengaluru, Karnataka, India Tiger Analytics Full time
Job Title: Senior Data Engineer

About Us

Tiger Analytics is a global leader in AI and analytics, helping Fortune companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. Our mission is to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively.

We are a global team of over 100 technologists and consultants based in the US, Canada, the UK, India, Singapore, and Australia, working closely with clients across CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare. Many of our team leaders rank in Top 10 and 40 Under 40 lists, exemplifying our dedication to innovation and excellence.

We are a Great Place to Work-CertifiedTM (-24), recognized by analyst firms such as Forrester, Gartner, HFS, Everest, ISG, and others. We have been ranked among the 'Best' and 'Fastest Growing' analytics firms lists by Inc., Financial Times, Economic Times, and Analytics India Magazine.


About the Role

As a Senior Data Engineer, you will operate autonomously with minimal supervision, leveraging your exceptional organizational and problem-solving abilities. On a typical day, you might:

  • Independently conduct stakeholder discussions to gather project requirements for non-complex data platforms, meticulously documenting technical and business requirements and obtaining sign-off.
  • Design the entire technical solution for the project, encompassing ingestion, ETL/ELT, data models, processing, governance, etc., with minimal support from subject matter experts.
  • Write clean, elegant, maintainable, and efficient code.
  • Assume full ownership of end-to-end data pipeline implementation, undertaking advanced tasks such as performance tuning, optimized coding, providing technical advisory, creating reusable code, offering technical assistance to team members, and conducting code reviews.
  • Troubleshoot and guide teams on various data modeling scenarios, independently resolving complex scenarios (e.g., nested/custom hierarchies) and handling all modeling techniques (e.g., ER, Dimensional, Data Vault, Canonical).
  • Independently develop end-to-end data integration services on the project's cloud platform, reviewing cloud-based integration tasks performed by the team.
  • Ensure quality control checks and adhere to acceptable coding/organizational practices, with the ability to reproduce results at any given time.
  • Demonstrate willingness and openness to learning new practices, platforms, and technologies.

Requirements

We expect:

  • Over 7 years of comprehensive experience in data warehousing systems, with a minimum of 1 year dedicated to building and implementing full-scale data warehouse solutions on cloud data warehouses.
  • Hands-on experience of 2+ years in designing and developing data integration solutions using DBT.
  • Strong proficiency with Apache Airflow development and Python scripting, with at least 2 years of practical experience.
  • Proficient in creating DBT Models, Materialization, Macros, Snapshots, Jinja templating, and YAML file manipulation.
  • Skilled in designing and constructing data pipelines for ingesting raw data into Cloud Data Warehouses (e.g., Snowflake, Redshift, BigQuery), cleansing and transforming data to meet required specifications using various ETL/ELT tools.
  • Successfully implemented at least one end-to-end project with multiple transformation layers.
  • Sound understanding of data architecture, data modeling, and physical database design and tuning.
  • Strong command over SQL, capable of crafting structured and efficient queries for large datasets.
  • Experience in migration projects, with familiarity in utilizing frameworks considered an added advantage.
  • Proficient in writing test cases for data profiling and validation purposes.
  • Familiarity with DBT Cloud job creation and management.
  • Good grasp of coding standards, with the ability to define standards and testing strategies for projects.
  • Competent in building Airflow-Dbt connections and creating Dags for scheduling dbt cloud jobs.
  • Experienced in integrating GitHub or other version control tools with dbt and Airflow.
  • Proficient in Shell/PowerShell scripting.
  • Enthusiastic about working in Agile methodology and possessing a comprehensive understanding of the DevOps process.
  • Enjoy guiding and mentoring junior members of the team.

Career Opportunities

Every individual comes with a different set of skills and qualities, so even if you don't tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow.

We are an equal-opportunity employer. Our diverse and inclusive culture and values guide us to listen, trust, respect, and encourage people to grow the way they desire.

Note: The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry.

  • Data Engineer Lead

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...

  • Lead Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description:We are seeking a skilled Lead Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Responsibilities:Design and implement high-level...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...

  • Software Engineering Lead

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewReq ID: 296759NTT DATA is seeking a talented Software Engineering Lead to join our team in India. As a Java Developer - Digital Engineering Lead Engineer, you will be responsible for leading the development of enterprise cloud solutions using Azure, AWS, and GCP.Key Responsibilities:Lead the development of enterprise cloud solutions using Java,...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 301470NTT DATA is seeking a skilled Data Engineer to partner with stakeholders across business units to develop analyses and documentation in a collaborative way.The ideal candidate will have three or more years of experience with Python, SQL, and data visualization/exploration tools, as well as familiarity with the AWS ecosystem.About...

  • Data Visualization Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Visualization EngineerJob Summary:Data Visualization Engineer - NTT DATAData visualization engineers utilize expertise in information visualization and design to create and deploy new platforms and services for visualization initiatives. Visualization specialists build interactive and complex data visualizations and analysis tools. They are...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Altair Engineering Full time

    Transforming Business with Data-Driven InsightsAt Altair Engineering, we're looking for a talented Senior Data Engineer to join our team. As a key member of our data analytics group, you will be responsible for designing and implementing scalable data pipelines, ensuring the accuracy and reliability of our data.Key Responsibilities:Design and implement data...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services. As a Data Engineer, you will be responsible for designing and developing data pipelines utilizing Cloud technologies Azure/AWS/GCP.Key ResponsibilitiesDesign and develop data pipelines using Cloud technologies Azure/AWS/GCPLead a team of Data Engineers and act...

  • Digital Engineering Lead

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Digital Engineering Lead EngineerAbout the Role:We are seeking a highly skilled Digital Engineering Lead Engineer to join our team in Bengaluru, India. As a key member of our team, you will be responsible for designing and implementing data storage solutions, managing and developing data processing, and optimizing data solutions on Azure.Key...

  • Digital Engineering Lead Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 299336 NTT DATA is seeking a talented Digital Engineering Lead Engineer to join our team in Bangalore, Karnātaka, India. This role is part of our JavaScript and Web Platform engineering practice, where you will be surrounded by top-notch engineers and have plenty of interesting challenges.Key Responsibilities:Write code, create unit...

  • Senior Lead Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Lead EngineerJob Summary:We are seeking a Senior Lead Engineer to join our team in Remote, India. The ideal candidate will have 4+ years of experience developing custom business logic in APEX, writing test classes, creating Lightning Web Components, Visualforce Pages, and Triggers.Key Responsibilities:Develop custom business logic in...

  • Senior Lead Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Lead EngineerJob Summary:We are seeking a Senior Lead Engineer to join our team in Remote, India. The ideal candidate will have experience developing custom business logic in APEX, writing test classes, creating Lightning Web Components, Visualforce Pages, and Triggers.Key Responsibilities:Develop custom business logic in APEXWrite test...

  • Senior Data Engineer

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OpportunityReq ID: 286326 NTT DATA Services is a global leader in IT and business services, committed to helping clients succeed in a rapidly changing world. We are seeking a talented Sr Data Engineer to join our team in Bangalore, India.This role requires a strong background in AWS cloud services, including Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch,...

  • Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Data Labs - LANDMARK GROUP. The successful candidate will be responsible for leading our engineering team in building and deploying cutting-edge analytics products.Key Responsibilities:Lead the architecture, design, and...

  • Data Engineering Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Requirements:NTT DATA Services is seeking a skilled Data Engineer to join our team in Bangalore, India. In this role, you will work closely with the GenAI architect to design and implement automated data pipelines.Key Responsibilities:Analyze and understand source data, preparing and managing data sets for actionable insights.Collaborate with Data...

  • Digital Engineering Lead

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA Services is seeking a highly skilled Digital Engineering Lead to join our team in India. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining high-quality software applications.Key ResponsibilitiesMaintain high standards of software quality by establishing good practices and habits...

  • Data Engineering Cloud Specialist

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...

  • Data Engineering Senior Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India iKrux Engineering Full time

    iKrux Engineering: We are seeking a talented Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining Java-based backend applications, ensuring scalability, reliability, and performance.Responsibilities:Data Processing: Utilize Apache Spark to process and analyze large volumes of data...