Data Engineering Lead

1 day ago

Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Opportunity

We are seeking a highly skilled and experienced professional to fill the role of Data Engineering Lead. This position requires a strong background in designing and implementing large-scale data pipelines and solutions.

The ideal candidate will have excellent hands-on knowledge on Python, with proven experience in data engineering, machine learning operations, and cloud computing. They should be proficient in developing ETL pipelines and architecting big data solutions, as well as possessing expertise in one cloud platform and a proven record of working on at least one project end to end.

Main Responsibilities:

  • Design and Manage Data Pipelines: Develop and implement efficient ETL pipelines on cloud platforms, utilizing tools like Airflow to orchestrate tasks and Cloud Watch to manage notifications.
  • Collaborate with Cross-Functional Teams: Work closely with various teams to enhance data-driven decision making, ensuring alignment of machine learning projects with strategic business goals.
  • Develop Containerized Applications: Create customized Python solutions to improve data accuracy, accessibility, and reliability.
  • Pilot Next-Generation Technologies: Utilize Gen AI or other machine learning techniques to solve complex problems.

Supervisory/Managerial Responsibilities:

  • Strong Collaboration Skills: Possess the ability to work effectively across diverse teams.

Required Skills and Qualifications:

  • Excellent Hands-On Knowledge on Python: Proven experience in data engineering, machine learning operations, and cloud computing.
  • Proficiency in Developing ETL Pipelines: Expertise in architecting big data solutions.
  • Cloud Platform Experience: Strong understanding of one cloud platform and a proven record of working on at least one project end to end.
  • Passion for Innovation: A desire to push the boundaries of what's possible with technology in an ambiguous environment.

Requirements:

  • 10+ Years of Experience: In data engineering and machine learning operations.

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Devops Lead Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 304648NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a DevOps Lead Engineer to join our team in Chennai Tamil Nxc4x81du IN-TN India IN Once You Are Here You Will Be...

  • Eucloid - Senior/Lead Data Engineer - Python

    2 weeks ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description : Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • data engineering lead

    21 hours ago

    Chennai, Tamil Nadu, India Randstad Full time

    At least 5 years' experience as a Senior or Lead Data Engineer Proven and demonstratable experience of Python, AWS, and SQL/ Oracle Bachelor's honours degree preferably in computer science, or engineering field, or demonstrable technical experience in a related engineering discipline At least 3 years of ETL experience using flat files to transposed...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key Responsibilities:•  ...

  • Data Engineering Team Lead

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Engineering Team LeadAbout the CompanyWe are a leading data engineering consultancy that helps businesses create commercial value using data and artificial intelligence. Our team of experts works with clients across various industries to deliver high-quality solutions.Our Expertise: Data Science, Software Engineering, Commercial...

  • Lead Engineer | 6 to 12 years | Chennai

    4 weeks ago

    Chennai, Tamil Nadu, India Capgemini Engineering Full time

    Position :- Senior Software Development ConsultantExperience - 6 to 12 yearsJob SummaryCapgemini's Experience Engineering team is growing and we are looking for talented engineers. Our professional services team works across multiple platforms and industries, incorporating cutting edge technologies like XR, ML, robotics and IoT. We use the Unity engine to...

  • Data Analyst

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 324657 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Analyst to join our team in Chennai Tamil Nxc4x81du IN-TN India IN Key Responsibilities ...

  • Data Architect

    2 days ago

    Chennai, Tamil Nadu, India Capgemini Engineering Full time

    Data Architect / Data EngineerLocation: ChennaiExperience: 4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...

  • Data Engineering Lead

    1 day ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,20,00,000 - ₹ 2,80,00,000

    Expert Data ScientistAs a seasoned expert in data engineering, you will play a pivotal role in crafting and implementing robust data pipelines and systems to support critical business activities.Develop scalable, efficient ETL (Extract, Transform, Load) pipelines using cutting-edge tools to handle large datasets from diverse sources.Integrate data from...