Lead Data Engineer

6 days ago

Bengaluru Chennai Pune, India Freelancer Vinita Singh Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Lead Data Engineer ( 6-9 years experience)

We are seeking a Lead AWS-Data Engineer with strong experience across Architecting and consulting around entire Cloud Data stack. The ideal candidate should have extensive experience in Architecting and consulting with data pipelines (ELT/ETL), data warehousing and dimensional modeling, and curation of data sets for Data Scientists and Business Intelligence users. Experience in Architecting Data Lake.

This candidate should also have excellent problem-solving ability dealing with large volumes of data and various data sources while able to work with client's team and consult them ensuring a highly efficient and scalable system.

Key Responsibilities:

  • Very good communication skills working with client and extending teams
  • Should be able architect, suggest and work with various stakeholders to build the right Data Stack on AWS
  • Design, Build and Operate the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, cloud migration tools, and 'big data' technologies.
  • Optimize various RDBMS engines in the cloud and solve customers' security, performance, and operation problems.
  • Design, Build, and Operate large, complex data lakes that meet functional / non-functional business requirements.
  • Optimize various data types of ingestion, storage, processing, and retrieval from near real-time events, and IoT, to unstructured data as images, audio, video, and documents, and in between.
  • Work with customers' and internal stakeholders including the Executive, Product, Data, Software Development, and Design teams to assist with data-related technical issues and support their data infrastructure and business needs.
  • Understand and Develop AI/ML models using AWS AI/ML services (e.g., Sage Maker, Rekognition, Comprehend) and collaborate with data scientists and engineers to implement machine learning solutions

Mandatory Qualifications:

  • 6+ years of experience in a Data Engineer role in a cloud-native eco-system.
  • Bachelor (Graduate preferred) degree in Computer Science, Mathematics, Informatics, Information Systems, or another quantitative field.
  • 3+ years working experience in AWS Glue ETL, Redshift, Step Function, Athena
  • Experience in implementing data pipelines for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Spark, Spark Experience in Lake Formation Orchestration, Maintain and enhance models for SDLC using CI/CD pipelines in AWS.
  • Experience in Relational and NoSQL databases, such as MySQL or Postgres and DynamoDB.
  • Functional and scripting languages: Python, Advanced SQL.
  • Experience building and optimizing 'big data' pipelines, architectures, and data sets.Role & responsibilities

Preferred candidate profile

  • Lead Data Engineer

    1 week ago

    Chennai, Bengaluru, Pune, India Mobile Programming LLC Full time

    Job DescriptionDescriptionWe are seeking a Lead Data Engineer to join our dynamic team in India. In this role, you will be responsible for designing and implementing robust data systems that support our analytics and business intelligence initiatives. You will lead a team of data engineers and work closely with cross-functional teams to deliver high-quality...

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Data Engineer

    11 hours ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Quantrail Data Full time US$ 60,000 - US$ 1,00,000 per year

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility:2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Data Engineer

    5 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Lead Data Scientist

    1 day ago

    Bengaluru, Karnataka, India Data Science Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to know the team GrabFin is an aggregate of FinTech businesses spread across 6 countries in S.E. Asia, in the Lending, Payments and Insurance domains. We are excited to provide innovative financial services to all participants of the Grab Ecosystem be it our Drivers, Consumers or Merchants. Our products are built on fundamental market insights combined...

  • Lead Data Scientist

    11 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Lead Data Scientist - Computer Vision & Generative AI to join our team in Bangalore, Karnātaka (IN-KA), India (IN). We are seeking...

  • Data Engineering Lead

    6 days ago

    Pune, Chennai, Bengaluru / Bangalore, India beBeeAgile Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title:Data Engineering Lead