
Senior Data Engineer – Product Development
1 day ago
Job Title:
Principal / Senior Data Engineer – Product Development
- Location: Hyderabad (Work from Office only)
- Experience: 4 – 7 Years
- Notice Period: Maximum 15 days
- Compensation: 15 – 30 LPA
About The Company
We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first thinking and AI-native execution to help clients achieve more with speed, precision, and measurable impact. We operate at the intersection of automation, AI, and agile engineering to deliver scalable, high-performance solutions that enable businesses to move faster and operate smarter.
Role Overview
We are looking for a Principal/Senior Data Engineer to join our product development team. In this role, you will be responsible for building and optimizing large-scale distributed data systems, ensuring high performance, availability, and reliability. You will work on ingestion pipelines, parallel processing frameworks, and distributed storage, while contributing to core product development and best engineering practices.
Roles & Responsibilities
- Design, develop, and maintain scalable distributed data systems.
- Implement data ingestion pipelines from various sources such as Amazon S3, Azure Cloud Storage, Google Cloud Storage, Snowflake, BigQuery, PostgreSQL, Kafka, and data lakehouses (e.g., Iceberg).
- Enable high availability, fault tolerance, and cross-region replication for data systems.
- Build and optimize Spark connectors for efficient data processing.
- Manage and integrate third-party systems like Kafka and Kafka Connect.
- Implement monitoring, error reporting, and performance optimization for ingestion and processing workflows.
- Contribute to core product development, following engineering best practices and Agile methodologies.
- Collaborate with cross-functional teams to ensure seamless CI/CD integration and reliable deployments.
Requirements
- Strong knowledge of distributed systems for large-scale, data-intensive applications.
- Hands-on experience with parallel/distributed processing frameworks.
- Proficiency in event-driven architectures and stream processing.
- Good understanding of Agile development and CI/CD pipelines.
- Linux fundamentals and shell scripting skills.
Must Have Skills
- Proficiency in Java or Golang.
- Deep expertise in Kafka (Kafka Connect, Kafka Streams, Kafka Security).
- Strong experience with Apache Spark and Spark connector development.
- Strong foundation in Linux and scripting for automation.
Skills: java,golang,kafka,apache spark,linux and scripting,zookeeper,spark,stream processing
-
Lead/Senior Data Engineer
1 day ago
Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per yearWe are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...
-
Senior Data Engineer
1 day ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...
-
Senior Data Engineer
1 day ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...
-
Hyderabad, Telangana, India Avant Garde Full time US$ 1,50,000 - US$ 2,00,000 per yearAre you passionate about building large-scale, data-intensive distributed systemsWere looking for a Principal / Senior Data Engineer to work on cutting-edge data ingestion pipelines and distributed product engineering for one of the worlds leading graph data science companies. Roles & Responsibilities Understand design specifications and follow best...
-
Data Engineer Senior Consultant
4 days ago
Hyderabad, Telangana, India NTT Data Full timeJob DescriptionReq ID:330296NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Senior Consultant to join our team in Hyderabad, Telangana (IN-TG), India (IN).- Understand...
-
Senior Data Engineer
1 day ago
Hyderabad, Telangana, India Unify Technologies Full time US$ 1,50,000 - US$ 2,00,000 per yearCompany DescriptionUnify Technologies is a leading digital engineering company committed to helping global clients build high-quality software products quickly and affordably. With extensive experience in software product engineering practices, Unify Technologies delivers custom software solutions. We collaborate with industry leaders across multiple...
-
Senior Data Engineer
1 day ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per yearDesign, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights. Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. Ensure data...
-
Data Engineer
1 day ago
Hyderabad, Telangana, India ICE Data Services Full time US$ 1,25,000 - US$ 1,75,000 per yearJob PurposeAt Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk...
-
Senior Data Engineer
4 hours ago
Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 13,20,000Job Summary:We are seeking an experienced Senior Data Engineer to develop and implement our company's Big Data solutions. The ideal candidate will have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills.The successful Senior Data Engineer will be responsible for:Designing and implementing...
-
Senior Data Engineer
7 days ago
Hyderabad, Telangana, India iO Associates - UKEU Full timeSenior Data EngineerRemoteiO Associates is looking for a Senior Data Engineer for one of our leading clients to join the Innovation Technology team. In this role, you'll be a key player in designing and maintaining data pipelines on Azure using Databricks, ADF, and PySpark. They ensure data is secure, reliable, and optimised for analytics, while mentoring...