Principal/Senior Data Engineer

4 weeks ago

Hyderabad, Telangana, India Connect2Talent Full time

Job Description : Principal/Senior Data Engineer Product Development

Location : Hyderabad / Mumbai (Onsite)

Experience : 48 Years

Employment Type : Full-Time, Payroll

Duration : the Role

We are seeking a highly skilled Principal/Senior Data Engineer to join our core Product Development team. You will play a critical role in designing and implementing high-performance, distributed data processing systems. The ideal candidate has deep expertise in building scalable ingestion pipelines, distributed systems, and event-driven architectures with strong proficiency in Golang, Java, and C++.


Key Responsibilities

- Understand and implement design specifications for core product development.

Build and optimize distributed data ingestion systems with parallel processing from diverse sources including:

- Cloud storage (Amazon S3, Azure Storage, Google Cloud Storage)

- Relational databases (Snowflake, BigQuery, PostgreSQL)

- File systems, Kafka, Data Lakehouse (Iceberg)

- Develop high-availability (HA) data loading pipelines with cross-region replication.

- Implement monitoring, error reporting, and recovery mechanisms for ingestion pipelines.

- Integrate with Spark connectors for advanced data processing.

- Manage and optimize third-party integrations (Kafka, Kafka Connect, etc.).

- Collaborate in Agile/Scrum environments and ensure robust delivery using CI/CD Strong expertise in distributed systems with applied parallel processing.

- Hands-on experience in one or more of the following:

- Kafka, Kafka Streams, Kafka Connect, Kafka Security, and customizations

- Zookeeper and stream processing frameworks

- Spark connectors and event-driven architectures

- Proficiency in Agile development practices and CI/CD Technical Skills :

- Java (All versions) 4+ Years (Advanced)

- C++ 3+ Years (Advanced)

- GoLang 3+ Years (Advanced)

- Apache Kafka 4+ Years (Advanced)

- Apache Spark 3+ Years (Intermediate)

- PostgreSQL 4+ Years (Advanced)

- Snowflake 3+ Years (Advanced)

- BigQuery 3+ Years (Intermediate)

- AWS S3 4+ Years (Advanced)

- Azure 4+ Years (Advanced)

- Google Cloud 4+ Years (Intermediate)

- Distributed Computing 2+ Years

- Agile Methodology 3+ Years (Intermediate)

- CI/CD 4+ Years to Have :

- gRPC protocol and multi-threading expertise

- Experience with Zookeeper / ETCD / Consul

- Familiarity with distributed consensus algorithms (Paxos, Raft)

- Docker, Kubernetes for containerization and Back-End Developer (Software and Web Development)

- Principal Engineer (Software and Web Development)

- Data Engineer (Software and Web Development)

- Software Engineer (Software and Web Development)

- Product Development Engineer (Engineering)

- Data Scientist (Software and Web Development)

(ref:hirist.tech)

  • Principal/Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India HyrEzy Talent Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title : Principal / Senior Data Engineer - Product Development - Location : Hyderabad (Work from Office only) - Experience : 4 - 7 Years - Notice Period : Maximum 15 daysAbout the Company : We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first...

  • Senior Consultant- Software Engineering

    4 weeks ago

    Hyderabad, Telangana, India Principal Financial Full time

    Responsibilities About the Role We are in search of a Senior Consultant - Software Engineering to become part of our top-tier engineering team in Pune Hyderabad This presents a meaningful role to lead solution architecture and innovation for our cloud platform initiatives You will be instrumental in propelling our cloud transformation programs forward ...

  • Senior Consultant- Software Engineering

    5 days ago

    Hyderabad, Telangana, India Principal Global Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    ResponsibilitiesAbout the RoleWe are in search of a Senior Consultant - Software Engineering to become part of our top-tier engineering team in Pune/Hyderabad. This presents a meaningful role to lead solution architecture and innovation for our cloud platform initiatives You will be instrumental in propelling our cloud transformation programs forward,...

  • Principal Data Engineer

    1 week ago

    Hyderabad, Telangana, India ixceed Full time ₹ 3,00,000 - ₹ 40,00,000 per year

    Role: Principal Data EngineerLocation: HyderabadMode: HybridType: ContractJob Description:We are seeking a Principal Data Engineer with strong enterprise-level data architecture and engineering experience, specifically within the logistics and manufacturing domains. This role is heavily focused on architecting and developing scalable data solutions using the...

  • Principal/Senior AI Engineer

    7 days ago

    Hyderabad, Telangana, India YO IT CONSULTING Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description :Title : Principal/ Senior AI Engineer- Graph Data ScienceExperience : 4 to 7 yearsLocation : HyderabadMust Haves :AI/Machine Learning/Neural NetworkRole And Responsibilities : We are seeking a highly skilled Principal/Senior AI Engineer Graph Data Science to join our advanced analytics and AI team. The ideal candidate will have strong...

  • Principal/Senior Software Engineer

    1 week ago

    Hyderabad, Telangana, India HyrEzy Talent Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role : Principal/Senior Software Engineer-Graph Database - Location : Hyderabad - Experience : 4 to 7 Years - Work model- WFO only - Notice period : Only 15 days or lessAbout company : We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first thinking...

  • Principal / Senior Data Engineer – Product Development

    1 week ago

    Hyderabad, Telangana, India Avant Garde Full time US$ 1,50,000 - US$ 2,00,000 per year

    Are you passionate about building large-scale, data-intensive distributed systemsWere looking for a Principal / Senior Data Engineer to work on cutting-edge data ingestion pipelines and distributed product engineering for one of the worlds leading graph data science companies. Roles & Responsibilities Understand design specifications and follow best...

  • Principal / Senior Cloud Engineer – Kubernetes

    6 days ago

    Hyderabad, Telangana, India Avant Garde Full time US$ 1,00,000 - US$ 1,50,000 per year

    Do you have a passion for Kubernetes, cloud-native platforms, and distributed systemsWere looking for a Principal / Senior Cloud Engineer to design, develop, and manage cloud container orchestration for one of the worlds leading graph data science product companies.Roles & ResponsibilitiesImplement cloud container management following best practices on...

  • Principal Data Platform Engineer

    7 days ago

    Hyderabad, Telangana, India NationsBenefits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title:Principal Data Platform EngineerLocation:Hyderabad, IndiaEmployment Type:Full-timeAbout NationsBenefits:AtNationsBenefits, we're committed to improving health outcomes and member satisfaction through innovative supplemental benefits and healthcare solutions. Behind the scenes, our global engineering teams build and maintain robust systems that...

  • Principal Data Engineer

    1 week ago

    Hyderabad, Telangana, India Anblicks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role / Job Title:Principal EngineerExperience required:10+ yearsLocation:Hyderabad / AhmedabadJob Type:Full-TimeJob OverviewAs a Principal Data Engineer at Anblicks, you will be at the forefront of driving our clients' data and analytics transformations. Your role involves designing and presenting cutting-edge data architectures, fostering client...