Distributed Data Engineering Lead

5 days ago


Bengaluru, Karnataka, India Tech Recruitz Solutions Full time

**Job Description**

Tech Recruitz Solutions is a leading provider of recruitment solutions. We are seeking an experienced Distributed Data Engineering Lead to join our team. The successful candidate will be responsible for leading the development of our distributed data processing systems, ensuring they are scalable, available, and fault-tolerant.

The ideal candidate will have a strong background in big data technologies, including Apache Spark, HDFS, YARN, Map-Reduce, Hive, Kafka, and Airflow. Experience with NoSQL databases and cloud platforms such as AWS and GCP is also required.

We are looking for someone who can take ownership of our data pipelines, optimize data quality, and refine diverse datasets into simplified models. Strong communication skills and the ability to participate in architecture discussions are essential for this role.

Responsibilities:

  • Design and develop distributed data processing systems using Apache Spark and other big data technologies.
  • Lead the development of data pipelines, ensuring they are optimized for data quality and scalability.
  • Collaborate with cross-functional teams to ensure seamless integration with existing platforms.
  • Stay up-to-date with industry trends and advancements in big data technologies.


  • Bengaluru, Karnataka, India LinkedIn Full time

    We're on a mission to make LinkedIn the most effective tool for professionals to find new opportunities and grow their careers.We're looking for a skilled Lead Distributed Systems Engineer to lead the design and development of our next-generation information retrieval infrastructure and platforms.In this role, you'll have the opportunity to drive...


  • Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd. Full time

    Company OverviewSquareroot Consulting Pvt Ltd. is a pioneering technology company that fosters innovation through collaborative software development.Job SummaryWe are looking for an accomplished Senior Lead Engineer - Distributed Infrastructure to lead our Distributed Systems team in Bangalore, India.Design and implement scalable, fault-tolerant distributed...


  • Bengaluru, Karnataka, India TalentXO Full time

    Join TalentXO, a dynamic and innovative company that excels in data engineering solutions.Job DescriptionWe are looking for a skilled Data Engineer to lead our data engineering efforts. The successful candidate will have at least 5 years of experience in data transformation tools like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, and other...

  • Lead Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Target Full time

    About us: Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. Learn more about Target here . About the Role: As a Lead Data Engineer , you will serve as the technical anchor for the engineering team, responsible for designing and developing scalable, high-performance...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 313951 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and...

  • Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 313953 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bamgalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and...


  • Bengaluru, Karnataka, India EXL Service Full time

    Job Title: Senior ManagerAbout the RoleWe are seeking an experienced Senior Manager to lead our Data Engineering team at EXL Service. The ideal candidate will have a strong background in data warehousing, big data engineering, and distributed systems.Key ResponsibilitiesCollaborate with project stakeholders to identify product and technical...


  • Bengaluru, Karnataka, India Harness Full time

    At Harness, we are a high-growth company that is revolutionizing the software delivery landscape. Our mission is to empower the world's 30 million software developers to deliver code to their users reliably, efficiently, and securely.We offer a comprehensive platform for every stage of the software delivery lifecycle, from building and testing to securing...


  • Bengaluru, Karnataka, India Weekday AI Full time

    **About the Role**We are looking for a talented Staff Software Engineer (C++) to join our team at Weekday AI. This role offers an exciting opportunity to design, develop, and optimize high-performance, scalable software solutions.The ideal candidate will have extensive experience in C++, Java, distributed systems, and system design. You will work closely...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 313949 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and...


  • Bengaluru, Karnataka, India Spire Full time

    Distributed Systems EngineerWe are seeking an experienced Distributed Systems Engineer to join our team at Spire. The successful candidate will be responsible for designing and implementing distributed systems that meet the needs of our customers. You will work closely with cross-functional teams to develop scalable, secure, and reliable software...


  • Bengaluru, Karnataka, India Success Pact Consulting Pvt. Ltd. Full time

    About the RoleWe are looking for a talented Data Engineering Lead to join our team at Success Pact Consulting Pvt. Ltd. The successful candidate will be responsible for designing and implementing scalable solutions in a large-scale distributed environment.Main Responsibilities:Design and build reusable components, frameworks, and libraries at scale to...

  • Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: 313953 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bamgalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and implement tailored...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: 313952 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and implement tailored...

  • Lead Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Target Full time

    About us:Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. Learn more about Target here.About the Role:As aLead Data Engineer , you will serve as thetechnical anchorfor the engineering team, responsible for designing and developingscalable, high-performance data...

  • Data Science Lead

    7 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Company OverviewNTT DATA is a leading provider of digital and AI infrastructure, serving 75% of the Fortune Global 100. We have diverse experts in over 50 countries and a robust partner ecosystem.Job DescriptionWe are seeking a Sr. Data Science AIML GenAI Lead Engineer to join our team in India. Key responsibilities include developing traditional machine...

  • Lead Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Hexaware Technologies Full time

    Experience : 7-10 yrs Work location : Pune/chennai/hyderabad/bangaloreWork mode: HybridNotice period : Imm - 45 days Title: Lead Data EngineerThe data engineer role at our company presents an exciting opportunity to work on large-scale data infrastructure projects and contribute to the development and maintenance of our data platform. The ideal candidate...


  • Bengaluru, Karnataka, India SolarWinds Full time

    SolarWinds' mission is to enrich the lives of its employees, customers, and communities through the acceleration of business transformation with simple, powerful, and secure solutions.We're seeking a talented and motivated Software Engineer to join our Observability Platform team, where you'll contribute to developing scalable, resilient, and real-time...


  • Bengaluru, Karnataka, India Oracle Full time

    Oracle Cloud Infrastructure is seeking a Senior Distributed Systems Engineer to join our team. As a Principal member of technical staff, you will be responsible for leading the architecture and technical design of key areas of our product.We are looking for hands-on engineers with expertise in solving difficult problems in distributed systems, virtualized...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 310544 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Offshore Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Key...