Lead Data Engineer

3 months ago


Bengaluru, Karnataka, India Delta Air Lines Full time

Key Responsibilities:

  • Create, construct, and manage data pipelines with AWS services including S3, Glue, EMR, and Redshift.
  • Use Kinesis, Stream, and Firehose to implement batch and stream data loading.
  • For infrastructure as code, use AWS CDK to ensure scalability and dependability.
  • Improve the effectiveness and performance of SQL queries.
  • Write Python and other programming language code and maintain it.
  • Use Code Pipeline to implement CI/CD pipelines and GitLab to manage code repositories.
  • Create and put into practice data models for data warehousing systems.
  • For workflow management, make use of orchestration solutions such as Step Functions and Airflow.
  • Manage the CI-CD, code, performance testing, test coverage, and scanning aspects of the DevOps activity.

Minimum Qualifications:

  • Bachelors degree in Information Systems, Computer Scienceor related field
  • 7+ years of relevant overall experience
  • Practical knowledge of AWS data services, including S3, Glue, EMR, and Redshift.
  • Proficiency with AWS Kinesis Stream and Firehose for batch and data stream loading.
    Strong familiarity with AWS CDK.
  • Proficiency with various programming languages, including Python.
  • Expertise in query tweaking and SQL optimization
  • Expertise in working with JSON, SML, CSV , YAML files.
  • Familiarity with CI/CD workflows and GitLab.
  • Knowledge of scrum and agile techniques.
  • Hands-On experience with data warehousing and data modeling.
  • Familiarity with orchestration tools such as Step Functions and Airflow.
  • Practical knowledge of data visualization tools such as PowerBI and Tableau.

Preferred Qualifications:

  • Familiarity with big data technologies such as Spark, Hadoop, etc.

  • Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Mandatory Skills and...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Once You Are Here, You Will: Expertly write code, create unit tests, assist with testing, assist with debugging, and assist with documentation Participate in scrum ceremonies, and coordinate with your team Mentor senior developers. Lead establishment of team best practices Lead technical strategy Technical point of contact for the engineering team Client...

  • Senior Lead Engineer

    2 months ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Once You Are Here, You Will:•...

  • Sr data engineer

    2 months ago


    Bengaluru, Karnataka, India NTT Data Vertex Software Inc. Full time

    Apply for Sr Data Engineer, Career Progress Consultants in Bengaluru/ Bangalore for 4 - 7 Year of Experience on

  • Lead Engineer

    3 months ago


    Bengaluru, Karnataka, India Kenvue Full time

    The CPD Data Engineering Architect is responsible for analyzing and designing technology solutions to meet business needs.Key Responsibilities:Design and implement scalable and efficient data pipelines to support business needsCollaborate with cross-functional teams to identify and solve complex data-related problemsDevelop and maintain data architecture and...

  • Lead Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Vestas Full time

    Do you want to be part of building Vestas new Design Centre? Vestas Technology & Operations > Research & Development (R&D) > Plant Data Vestas Technology & Operations, a cornerstone of Vestas, is committed to innovation, product development, and continuous improvement. We aim to develop high products and technologies that build down the cost of energy,...


  • Bengaluru, Karnataka, India timesjobs Full time

    ## Position: Lead Data Scientist - Data Engineer Location: Bangalore, India Technology: Data Science Employment Type: Full Time Work Environment: Hybrid At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel, and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Description-Sr...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About NTT DATA NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established...

  • Lead Engineer

    3 months ago


    Bengaluru, Karnataka, India Kenvue Full time

    The Data Platform Administratoris responsible for leading software design, service architecture, and software development/solution engineering. You will manage junior engineers, lead design and code reviews within the service, and investigate emerging technologies to drive continuous improvement of the service:Key Responsibilities:Administer, configure, and...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About NTT DATA NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established...


  • Bengaluru, Karnataka, India timesjobs Full time

    # ### Senior/Lead Software Engineer - Data Engineering#### Location: Bangalore, India- Technology: Other- Employment Type: Full Time- Work Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will...

  • AIML Engineer

    1 month ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    About NTT DATANTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and...

  • Lead Data Scientist

    3 months ago


    Bengaluru, Karnataka, India Danaher Full time

    Beckman Coulter Life Sciences' mission is to empower those seeking answers to life's most important scientific and healthcare questions. With a legacy spanning 80+ years, we have long been a trusted partner to our customers, who are working to transform science and healthcare with the next groundbreaking discovery. As part of our team of more than 2,900...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Staff Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).DevelopmentAnalysis, design,...

  • Lead Data Scientist

    3 months ago


    Bengaluru, Karnataka, India Philips Full time

    Job TitleLead Data ScientistJob DescriptionJob Title: Lead Data Scientist Your Role:As a Lead Data Scientist, you will be responsible for designing, implementing, and maintaining data science systems to analyze and extract value from large datasets. You will work closely with stakeholders across the organization to understand business needs, formulate...

  • Data Engineer

    11 hours ago


    Bengaluru, Karnataka, India globalinsurance Full time

    Technology at Brit:Brit has a leadership position at Lloyds, the most well-known insurance market in the world. At Brit, we believe that the uncertainty of the future should never stand in the way of progress. Thats why we exist. To help people and businesses face the future and thrive.We are change-makers enabled by a global workforce who collaborate to...

  • Data Engineer

    2 months ago


    Bengaluru, Karnataka, India Swiss Re Full time

    About the RoleAre you an energetic data engineer who is truly customer-obsessed and loves working with teams to design and deliver exceptional data driven solutions? As a senior data engineer, you will be responsible for delivering best in class data engineering capabilities supporting the companies' ambition to become data driven. You will have strong...

  • Data Engineer

    2 months ago


    Bengaluru, Karnataka, India Talent500 Tech Full time

    We are Talent500:We help companies hire, build and manage global teams. We are trusted by the worlds leading companies - from Fortune 500s and larger enterprises (Walmart, Target, Nike, Pepsi etc) to industry leaders (Airbnb, Twitter, Uber) and some of the worlds fastest-growing start-ups from the portfolios of investors such as Accel, Sequoia and...

  • Staff Data Engineer

    2 months ago


    Bengaluru, Karnataka, India Leading-Biotechnology-Company Full time

    We are seeking a highly experienced Staff Data Engineer with 10+ years of experience to join our talented team in Bangalore. This position will lead our data engineering efforts in Bangalore. In this strategic role, you will be responsible for designing, implementing, and optimizing complex data solutions using Python, Spark, SQL, Snowflake, dbt, machine...