Principal/Senior Data Engineer

1 day ago

Hyderabad, Telangana, India Connect2Talent Full time

Job Description : Principal/Senior Data Engineer Product Development

Location : Hyderabad / Mumbai (Onsite)

Experience : 48 Years

Employment Type : Full-Time, Payroll

Duration : the Role

We are seeking a highly skilled Principal/Senior Data Engineer to join our core Product Development team. You will play a critical role in designing and implementing high-performance, distributed data processing systems. The ideal candidate has deep expertise in building scalable ingestion pipelines, distributed systems, and event-driven architectures with strong proficiency in Golang, Java, and C++.


Key Responsibilities

- Understand and implement design specifications for core product development.

Build and optimize distributed data ingestion systems with parallel processing from diverse sources including:

- Cloud storage (Amazon S3, Azure Storage, Google Cloud Storage)

- Relational databases (Snowflake, BigQuery, PostgreSQL)

- File systems, Kafka, Data Lakehouse (Iceberg)

- Develop high-availability (HA) data loading pipelines with cross-region replication.

- Implement monitoring, error reporting, and recovery mechanisms for ingestion pipelines.

- Integrate with Spark connectors for advanced data processing.

- Manage and optimize third-party integrations (Kafka, Kafka Connect, etc.).

- Collaborate in Agile/Scrum environments and ensure robust delivery using CI/CD Strong expertise in distributed systems with applied parallel processing.

- Hands-on experience in one or more of the following:

- Kafka, Kafka Streams, Kafka Connect, Kafka Security, and customizations

- Zookeeper and stream processing frameworks

- Spark connectors and event-driven architectures

- Proficiency in Agile development practices and CI/CD Technical Skills :

- Java (All versions) 4+ Years (Advanced)

- C++ 3+ Years (Advanced)

- GoLang 3+ Years (Advanced)

- Apache Kafka 4+ Years (Advanced)

- Apache Spark 3+ Years (Intermediate)

- PostgreSQL 4+ Years (Advanced)

- Snowflake 3+ Years (Advanced)

- BigQuery 3+ Years (Intermediate)

- AWS S3 4+ Years (Advanced)

- Azure 4+ Years (Advanced)

- Google Cloud 4+ Years (Intermediate)

- Distributed Computing 2+ Years

- Agile Methodology 3+ Years (Intermediate)

- CI/CD 4+ Years to Have :

- gRPC protocol and multi-threading expertise

- Experience with Zookeeper / ETCD / Consul

- Familiarity with distributed consensus algorithms (Paxos, Raft)

- Docker, Kubernetes for containerization and Back-End Developer (Software and Web Development)

- Principal Engineer (Software and Web Development)

- Data Engineer (Software and Web Development)

- Software Engineer (Software and Web Development)

- Product Development Engineer (Engineering)

- Data Scientist (Software and Web Development)

(ref:hirist.tech)

  • Principal/Senior Data Engineer

    7 days ago

    Hyderabad, Telangana, India One Click AI Full time

    Role : Principal/Senior Data Engineer Product DevelopmentAbout Us :Agivant Technologies is a new-age AI-first digital and cloud engineering services company, building innovative solutions for modern enterprises.Job Description :We are looking for a Principal/Senior Data Engineer to design, develop, and maintain high-performance distributed systems and data...

  • Principal/Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India HyrEzy Talent Solutions Full time

    Job Title : Principal / Senior Data Engineer - Product Development- Location : Hyderabad (Work from Office only)- Experience : 4 - 7 Years- Notice Period : Maximum 15 daysAbout the Company :We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first thinking and AI-native...

  • Senior Consultant- Software Engineering

    10 hours ago

    Hyderabad, Telangana, India Principal Financial Full time

    Responsibilities About the Role We are in search of a Senior Consultant - Software Engineering to become part of our top-tier engineering team in Pune Hyderabad This presents a meaningful role to lead solution architecture and innovation for our cloud platform initiatives You will be instrumental in propelling our cloud transformation programs forward ...

  • Principal Data Engineer

    6 days ago

    Hyderabad, Telangana, India ixceed Full time ₹ 3,00,000 - ₹ 40,00,000 per year

    Role: Principal Data EngineerLocation: HyderabadMode: HybridType: ContractJob Description:We are seeking a Principal Data Engineer with strong enterprise-level data architecture and engineering experience, specifically within the logistics and manufacturing domains. This role is heavily focused on architecting and developing scalable data solutions using the...

  • Senior Consultant- Software Engineering

    2 days ago

    Hyderabad, Telangana, India Principal Global Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    ResponsibilitiesAbout the RoleWe are in search of a Senior Consultant - Software Engineering to become part of our top-tier engineering team in Pune/Hyderabad. This presents a meaningful role to lead solution architecture and innovation for our cloud platform initiatives You will be instrumental in propelling our cloud transformation programs forward,...

  • Principal Software Engineer, Data

    2 days ago

    Hyderabad, Telangana, India Talent500 Full time

    We believe in opportunities favoring the bold and thus, we help the best tech and non-tech talent find their dream jobs at renowned companies that leads to a transformative experience career wise. Principal Engineer, Software - Accounting Tech The Principal Engineer within the Accounting & Finance Technology domain will play a pivotal role in shaping...

  • Principal Engineer

    1 week ago

    Hyderabad, Telangana, India Mulya Technologies Full time

    Principal Engineer – Analog Design We are a global company that makes industry-leading memory interface chips and Silicon IP to advance data center connectivity and solve the bottleneck between memory and processing We are a premier chip and silicon IP provider, is seeking to hire an exceptional Principal Engineer – Analog Design to join our memory...

  • Principal / Senior Cloud Engineer – Kubernetes

    3 days ago

    Hyderabad, Telangana, India Avant Garde Full time US$ 1,00,000 - US$ 1,50,000 per year

    Do you have a passion for Kubernetes, cloud-native platforms, and distributed systemsWere looking for a Principal / Senior Cloud Engineer to design, develop, and manage cloud container orchestration for one of the worlds leading graph data science product companies.Roles & ResponsibilitiesImplement cloud container management following best practices on...

  • Principal / Senior Data Engineer – Product Development

    6 days ago

    Hyderabad, Telangana, India Avant Garde Full time US$ 1,50,000 - US$ 2,00,000 per year

    Are you passionate about building large-scale, data-intensive distributed systemsWere looking for a Principal / Senior Data Engineer to work on cutting-edge data ingestion pipelines and distributed product engineering for one of the worlds leading graph data science companies. Roles & Responsibilities Understand design specifications and follow best...

  • Principal Data Engineer

    6 days ago

    Hyderabad, Telangana, India Anblicks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role / Job Title:Principal EngineerExperience required:10+ yearsLocation:Hyderabad / AhmedabadJob Type:Full-TimeJob OverviewAs a Principal Data Engineer at Anblicks, you will be at the forefront of driving our clients' data and analytics transformations. Your role involves designing and presenting cutting-edge data architectures, fostering client...