Senior Data Engineer

1 week ago

Hyderabad, Telangana, India Sonata Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role & responsibilities

We are seeking a highly skilled Senior Data Engineer with strong expertise in data ingestion, transformation, and pipeline development. The ideal candidate will be an individual contributor responsible for designing, implementing, and maintaining robust data engineering solutions using modern tools and platforms.

Key Responsibilities:

  • Install, configure, and administer data platforms: StreamSets, Apache Spark, Informatica, Apache NiFi
  • Develop real-time and batch data pipelines using PySpark (Scala is a plus)
  • Administer StreamSets Data Collector and Control Hub for pipeline deployment and monitoring
  • Automate data flows using Apache NiFi, including processor configuration and cluster coordination
  • Upgrade and migrate data ingestion tools with minimal downtime
  • Write scalable and efficient Python code for data processing and automation
  • Perform complex SQL transformations and optimize database interactions

  • Work with diverse databases:

  • MPP: Teradata, Greenplum

  • OLTP: Oracle, SQL Server, PostgreSQL
  • In-memory: SAP HANA, MemSQL

  • Big Data: Hive, HBase, Kudu

  • Integrate automated testing using CI/CD tools (GitLab preferred, Jenkins acceptable)

  • Implement deployment pipelines and version control strategies
  • Ensure platform security, including TLS hardening
  • Monitor production environments and perform root cause analysis
  • Enforce coding standards and data governance practices
  • Schedule and orchestrate workflows with error handling and retry mechanisms

Mandatory Skills:

  • Data Ingestion & Transformation Tools
  • StreamSets, Spark (Python preferred), Informatica, Apache NiFi
  • Strong proficiency in Python and SQL

Secondary Skills:

  • CI/CD tools: GitLab, Jenkins
  • Database technologies: Teradata, Greenplum, Oracle, SQL Server, PostgreSQL, SAP HANA, MemSQL
  • Big Data platforms: Hive, HBase, Kudu
  • Knowledge of data governance, lineage tracking, and validation frameworks

  • Data Engineer Senior Consultant

    3 weeks ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionReq ID:330296NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Senior Consultant to join our team in Hyderabad, Telangana (IN-TG), India (IN).- Understand...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)- Translate business rules into technical specifications and implement scalable data solutions.- Manage...

  • Senior Data Engineer/Architect

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...

  • Azure Data Engineer

    10 hours ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 35,00,000 - ₹ 40,00,000

    Unlock Data Potential as a Senior Data EngineerAs a seasoned Senior Data Engineer, you will be responsible for crafting and implementing cutting-edge data solutions to drive business growth. Your expertise in designing and building data foundations, end-to-end solutions, and mentoring junior engineers will be invaluable to our organization.Key...

  • Digital Engineering Senior Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are currently seeking a Digital Engineering Senior Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Job Duties:Experience in developing at least 10+ Power Automate Desktop (PAD) flowsHave an experience in SQL data queries with/without PAD flowsKnowledge in any other programming languages (Java / .Net / Python / Angular JS/...

  • Azure Data Engineer With Snowflake

    13 hours ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Senior Data Engineer

    15 hours ago

    Hyderabad, Telangana, India BlueCloud Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience with DBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing solutions in a...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India iO Associates - UKEU Full time

    Senior Data EngineerRemoteiO Associates is looking for a Senior Data Engineer for one of our leading clients to join the Innovation Technology team. In this role, you'll be a key player in designing and maintaining data pipelines on Azure using Databricks, ADF, and PySpark. They ensure data is secure, reliable, and optimised for analytics, while mentoring...