Senior Data Engineer

2 weeks ago

Hyderabad, Telangana, India Sonata Software Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role & responsibilities

We are seeking a highly skilled Senior Data Engineer with strong expertise in data ingestion, transformation, and pipeline development. The ideal candidate will be an individual contributor responsible for designing, implementing, and maintaining robust data engineering solutions using modern tools and platforms.

Key Responsibilities:

  • Install, configure, and administer data platforms: StreamSets, Apache Spark, Informatica, Apache NiFi
  • Develop real-time and batch data pipelines using PySpark (Scala is a plus)
  • Administer StreamSets Data Collector and Control Hub for pipeline deployment and monitoring
  • Automate data flows using Apache NiFi, including processor configuration and cluster coordination
  • Upgrade and migrate data ingestion tools with minimal downtime
  • Write scalable and efficient Python code for data processing and automation
  • Perform complex SQL transformations and optimize database interactions

  • Work with diverse databases:

  • MPP: Teradata, Greenplum

  • OLTP: Oracle, SQL Server, PostgreSQL
  • In-memory: SAP HANA, MemSQL

  • Big Data: Hive, HBase, Kudu

  • Integrate automated testing using CI/CD tools (GitLab preferred, Jenkins acceptable)

  • Implement deployment pipelines and version control strategies
  • Ensure platform security, including TLS hardening
  • Monitor production environments and perform root cause analysis
  • Enforce coding standards and data governance practices
  • Schedule and orchestrate workflows with error handling and retry mechanisms

Mandatory Skills:

  • Data Ingestion & Transformation Tools
  • StreamSets, Spark (Python preferred), Informatica, Apache NiFi
  • Strong proficiency in Python and SQL

Secondary Skills:

  • CI/CD tools: GitLab, Jenkins
  • Database technologies: Teradata, Greenplum, Oracle, SQL Server, PostgreSQL, SAP HANA, MemSQL
  • Big Data platforms: Hive, HBase, Kudu
  • Knowledge of data governance, lineage tracking, and validation frameworks

  • Senior Data Engineer

    21 hours ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Data Engineer

    1 day ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions. Manage a...

  • Senior Data Analyst

    24 hours ago

    Hyderabad, Telangana, India Data Unveil Full time

    Description : About us : Data Unveil is the next generation provider of best-in-class data aggregation services. Our solutions and methodologies have been honed over the past 10 years by experienced practitioners who have collectively supported 100+ brands, 100+ data partners and 25+ new drug launches. Our integrated capabilities create a...

  • Azure Data Engineer

    4 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    23 hours ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset. As a Great...

  • Senior Data Engineer

    20 hours ago

    Hyderabad, Telangana, India Blurgs AI Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Job Title: Senior Data Engineer - Real-Time, batch Processing & Containerization (Pulsar, Flink, Kubernetes)Location: HyderabadAbout us:Blurgs AI is a deep-tech startup focused on maritime and defence data-intelligence solutions, specialising in multi-modal sensor fusion and data correlation. Our flagship product, Trident, provides advanced domain awareness...

  • Digital Engineering Senior Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are currently seeking a Digital Engineering Senior Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Job Duties:Experience in developing at least 10+ Power Automate Desktop (PAD) flowsHave an experience in SQL data queries with/without PAD flowsKnowledge in any other programming languages (Java / .Net / Python / Angular JS/...

  • Senior Data Engineer

    4 days ago

    Hyderabad, Telangana, India Avontix Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Senior Data EngineerHyderabad, Telangana ITDescriptionCompany Overview:Join a leading Revenue Cycle Management (RCM) company dedicated to transforming healthcare data into actionable insights. We leverage cutting-edge technology to streamline financial and operational processes, improving efficiency and patient outcomes. We are looking for a Senior Data...

  • Senior Data Engineer

    5 days ago

    Hyderabad, Telangana, India BlueCloud Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience with DBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing solutions in a...