Data Engineer

3 days ago

hyderabad district, India Straive Full time

Key Responsibilities: · Design, build and maintain scalable batch and (optionally) streaming data pipelines using Apache Spark 3.x, Scala, Python & SQL · Implement core ETL/ELT logic in Scala and Python; author efficient Spark DataFrame/Dataset jobs. · Write and optimize complex SQL for ingestion, transformation and consumption layers. · Tune Spark jobs for performance and cost : partitioning, join strategies, broadcast, memory/tuning, shuffle reduction. · Ensure code quality via unit tests, integration tests, CI/CD and code reviews. · Work with data modeling, schema evolution and data quality checks to ensure reliable outputs. · Collaborate with platform/DevOps teams to deploy and monitor pipelines (retries, logging, alerting). · Troubleshoot production issues and perform root-cause analysis. · Mentor and guide junior engineers, share best practices and drive improvements to the data platform. Qualifications: · 5–8 years industry experience as a Data Engineer. · Strong hands-on experience with Apache Spark 3.x (development, tuning, debugging). · Proficient in Scala programming for Spark ETL/ELT development (datasets, RDDs when required). · Experience with streaming frameworks like Spark Structured Streaming, Kafka . · Proficient in Python programming . · Advanced SQL skills (complex queries, window functions, CTEs, query optimization). · Experience building production-grade ETL/ELT workflows, testing and monitoring them. · Experience with orchestration tools like Apache Airflow · Strong software engineering fundamentals: version control (Git), modular code, code reviews, CI/CD pipelines. · Experience with cloud object storage and common data formats (Parquet/ORC/Avro). · Strong problem solving, communication and collaboration skills. · Experience with AWS Glue, EMR, Athena, Redshift, S3 will be a plus.

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Azure Data Engineer

    4 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Azure Data Engineer

    7 days ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Azure Data Engineer

    7 days ago

    hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Data Engineer

    3 days ago

    hyderabad district, India Egen Full time

    Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract,...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India The Modern Data Company Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job InformationDate Opened11/07/2025IndustrySoftware ProductJob TypeFull timeCityHyderabadState/ProvinceTelanganaCountryIndiaZip/Postal Code500081About UsThe Modern Data Company is redefining data management for the AI era, transforming data from a technical challenge into a company's most powerful business asset. Modern's DataOS platform is the world's...

  • Senior Data Engineer

    2 hours ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions.Manage a...

  • Data Engineer

    2 weeks ago

    hyderabad district, India People Prime Worldwide Full time

    About company: They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society....

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, , India The Modern Data Company Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    About the role: Role Overview: The Data Engineer is responsible for building and maintaining data infrastructure that enables organizations to store, process, and analyze large volumes of data. This role focuses on developing robust batch and streaming data pipelines to create data products, derive insights, and support analytics initiatives. The engineer...

  • Junior Data Engineer

    2 weeks ago

    hyderabad district, India Stier Solutions Inc Full time

    Job Title: Junior Data Engineer Location: Hyderabad, Telangana Employment Type: Full-time | On-site About the Role We are looking for a passionate and detail-oriented Junior Data Engineer to join our growing data team. In this role, you will help design, build, and maintain data pipelines and architectures that enable efficient data collection,...