Data Engineer

2 days ago

Hyderabad, India Soothsayer Analytics Full time

We seek a Data Engineer (Mid-level) with 4-6 years of hands-on experience in designing, building, and optimizing data pipelines. You will work closely with AI/ML teams to ensure data availability, quality, and performance for analytics and GenAI use cases.Key

Responsibilities
1. Data Pipeline Development
Build and maintain scalable ETL/ELT pipelines for structured and unstructured data.
Ingest data from diverse sources (APIs, streaming, batch systems).
2. Data Modeling & Warehousing
Design efficient data models to support analytics and AI workloads.
Develop and optimize data warehouses/lakes using Redshift, BigQuery, Snowflake, or Delta Lake.
3. Big Data & Streaming
Work with distributed systems like Apache Spark, Kafka, or Flink for real-time/large-scale data processing.
Manage feature stores for ML pipelines.
4. Collaboration & Best Practices
Work closely with Data Scientists and ML Engineers to ensure high-quality training data.
Implement data quality checks, observability, and governance frameworks.

o Programming: Python/Scala/Java (Python preferred).
o Big Data & Processing: Apache Spark, Kafka, Hadoop.
o Databases: SQL/NoSQL (Postgres, MongoDB, Cassandra).
o Data Warehousing: Snowflake, Redshift, BigQuery, or similar.
o Orchestration: Airflow, Luigi, or similar.
o Cloud Platforms: AWS, Azure, or GCP (data services).
o Version Control & CI/CD: Git, Jenkins, GitHub Actions.
o MLOps/GenAI pipelines (feature engineering, embeddings, vector DBs).

  • Azure Data Engineer

    2 days ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    2 days ago

    Hyderabad, India Enable Data Incorporated Full time

    Experience Required: 8+Years Mode of work: Remote Skills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025) Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Property Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India ICE Data Services Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Job PurposeThe Property Data Engineeris responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure,...

  • Property Data Engineer

    2 days ago

    Hyderabad, India ICE Data Services Full time

    Job Purpose The Property Data Engineeris responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure,...

  • Lead/Senior Data Engineer

    2 days ago

    Hyderabad, India Data Economy Full time

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)- Translate business rules into technical specifications and implement scalable data solutions.- Manage...

  • Aws Data Engineer

    2 days ago

    Hyderabad, India Data Economy Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions. Key...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions. Manage a...

  • Senior Data Engineer/Architect

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...

  • Lead Cloud Data Engineer

    2 days ago

    Hyderabad, India Data Economy Full time

    Key Responsibilities:Engage directly with clients to understand requirements, provide solution design, and drive successful project delivery.Lead cloud migration initiatives, specifically moving on-premise applications and databases to AWS cloud platforms.Design, develop, and maintain scalable, reliable, and secure data applications in a cloud...