Senior Data Engineer

1 week ago

Hyderabad, Telangana, India Grid Dynamics Full time ₹ 12,00,000 - ₹ 36,00,000 per year
  • Proven experience leading data engineering teams, including distributed teams across multiple geographies and time zones.
  • Effective in managing cross-team collaboration with architects, product managers, and operations.
  • Scala and Python
  • Apache Spark (batch & streaming) – must
  • Deep knowledge of HDFS internals and migration strategies.
  • Experience with Apache Iceberg (or similar table formats like Delta Lake / Apache Hudi) for schema evolution, ACID transactions, and time travel.
  • Running Spark and/or Flink jobs on Kubernetes (e.g., Spark-on-K8s operator, Flink-on-K8s).
  • Experience with distributed blob storages like Ceph or AWS S3 and similar
  • Building ingestion, transformation, and enrichment pipelines for large-scale datasets.
  • Infrastructure-as-Code (Terraform, Helm) for provisioning data infrastructure.
  • Strong communication skills

Essential Functions

  • Lead and mentor a team of data engineers, providing technical direction and career guidance.
  • Define the target data platform architecture for migrating from on-prem HDFS/Hive to Cloud Object Storage (e.g., AWS S3, Azure Data Lake Storage, or GCP Cloud Storage).
  • Select and integrate cloud-based compute and query engines (e.g., Spark).
  • Lead the design of ingestion, transformation, and storage patterns optimized for scalability, cost-efficiency, and performance in the cloud.
  • Define security, encryption, and compliance controls for sensitive enterprise data in the cloud.
  • Develop and own the migration roadmap, including phased transition from on-prem to cloud while minimizing business disruption.
  • Oversee data migration strategies (bulk historical loads, incremental sync, and cutover).
  • Define and enforce coding standards, CI/CD pipelines, and automated testing for data pipelines.
  • Partner with Data Architects, Cloud Engineers, and Security teams to align platform design with enterprise standards.

Qualifications

  • Strong hands-on experience in Scala and Python.
  • Expertise in Apache Spark (batch and streaming).
  • Familiarity with Cloud - AWS
  • Solid understanding of HDFS internals and migration strategies.
  • Experience with Apache Iceberg, Delta Lake, or Apache Hudi.
  • Familiarity with distributed blob storage (e.g., S3, Ceph).
  • Proficiency in Infrastructure-as-Code tools like Terraform and Helm.

Would be a plus

  • Experience with Apache Flink
  • Apple experience preferred (to enable him/her to get up to speed on our tooling set quickly and more independently)

We offer

  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Benefits package - medical insurance, sports
  • Corporate social events
  • Professional development opportunities
  • Well-equipped office

About Us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions. Manage a...

  • Senior Data Engineer/Architect

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...

  • Azure Data Engineer

    2 hours ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India ShimentoX Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data EngineerLocation: Hyderabad and BangaloreJob SummaryWe are seeking a highly skilled and experienced Senior Data Engineer to join our growing data engineering team. This role will be instrumental in designing, building, and maintaining scalable data pipelines and architectures to support advanced analytics, data science, and business...

  • Digital Engineering Senior Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are currently seeking a Digital Engineering Senior Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Job Duties:Experience in developing at least 10+ Power Automate Desktop (PAD) flowsHave an experience in SQL data queries with/without PAD flowsKnowledge in any other programming languages (Java / .Net / Python / Angular JS/...

  • Senior Data Engineer

    3 hours ago

    Hyderabad, Telangana, India Avontix Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Senior Data EngineerHyderabad, Telangana ITDescriptionCompany Overview:Join a leading Revenue Cycle Management (RCM) company dedicated to transforming healthcare data into actionable insights. We leverage cutting-edge technology to streamline financial and operational processes, improving efficiency and patient outcomes. We are looking for a Senior Data...

  • Senior Data Engineer

    10 hours ago

    Hyderabad, Telangana, India BlueCloud Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience with DBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing solutions in a...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India RJITCS Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionAt RJITCS Consulting Services, we are dedicated to transforming businesses through technology-driven solutions and measurable results. With a presence in New Zealand and India, we bring global expertise and local insights to deliver solutions that are efficient, scalable, and tailored to unique business needs. Our strong focus on Oracle...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Qentelli Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title: Senior Data EngineerLocation: Hyderabad / HybridExperience Level: 58 yearsEmployment Type: Full-TimeJob Summary/About the Role:We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data engineering team. The ideal candidate should have a strong foundation in Python, hands-on experience with modern data warehouses...

  • Azure Data Engineer

    2 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...