Data Engineer

3 days ago

Hyderabad, Telangana, India Celerinn Technologies Private Limited Full time

We are seeking a skilled Data Engineer (minimum 4+ years experience) with a strong foundation in Python and modern data engineering practices. You will be responsible for building robust, scalable, and efficient data pipelines that power our analytics and product data needs. This role is central to ensuring data quality, reliability, and availability across the organization.

You will work closely with data scientists, analysts, and product engineers to support data-driven decision-making and product development.

Core Responsibilities
  • Design, develop, and maintain scalable ETL/ELT pipelines using Python
  • Build and optimize data workflows for batch and real-time processing
  • Integrate data from various internal and third-party systems
  • Implement data quality checks, validation, and monitoring mechanisms
  • Collaborate with cross-functional teams to understand data requirements
  • Maintain data warehouse models and schemas to support business intelligence tools
  • Ensure adherence to data governance and security standards
  • Support orchestration and scheduling of pipelines in production
Core Skillset & Technical Requirements Python (Primary Skill)
  • Strong experience writing production-grade Python code in a data engineering context
  • Familiarity with object-oriented design , code modularity, and clean architecture in Python
  • Solid understanding of performance optimization for data processing in Python
Key Python Libraries & Tools
  • Pandas, NumPy – for data manipulation
  • SQLAlchemy / PySpark – for interacting with databases or distributed computing
  • Requests / HTTPX – for working with APIs and third-party data sources
  • Pydantic / Marshmallow – for data validation
  • Typer / Click / argparse – for CLI applications and script automation
  • Airflow / Prefect / Dagster – for orchestration (Dagster experience is a plus )
  • Great Expectations – for data validation (optional but desirable)
Data Integration Tools
  • Experience with data ingestion and transformation pipelines
  • Familiarity with Airbyte (desirable)
Databases & Storage
  • Proficiency with SQL and experience with relational databases (e.g., PostgreSQL , MySQL)
  • Experience with cloud-native or columnar data stores like Amazon Redshift , S3 , or Parquet/Delta Lake
Cloud Platforms
  • Preferred: Experience with AWS ecosystem (S3, Lambda, Glue, Redshift, etc.)
  • Knowledge of cloud security best practices and IAM principles
Other Desirable Skills
  • Containerization using Docker
  • Experience with CI/CD workflows for data pipelines
  • Familiarity with version control (Git) and code review processes
  • Exposure to data modeling and schema design (e.g., dimensional modeling, star/snowflake schema)
Preferred Qualifications
  • 4+ years of experience in data engineering or related field
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline
  • Strong problem-solving and communication skills
  • Experience working in Agile or fast-paced startup environments

  • Senior Data Engineer

    10 hours ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Data Engineer

    10 hours ago

    Hyderabad, Telangana, India ICE Data Services Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job PurposeAt Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk...

  • Azure Data Engineer ll

    12 hours ago

    Hyderabad, Telangana, India Enable Data Full time US$ 90,000 - US$ 1,20,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    14 hours ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights. Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. Ensure data...

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    12 hours ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Lead/Senior Data Engineer

    11 hours ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Aws Data Engineer

    13 hours ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...

  • Lead/Sr. ETL Data Engineer

    11 hours ago

    Hyderabad, Telangana, India Data Economy Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking a skilled ETL Data Engineer to design, build, and maintain efficient and reliable ETL pipelines, ensuring seamless data integration, transformation, and delivery to support business intelligence and analytics. The ideal candidate should have hands-on experience with ETL tools like Talend, strong database knowledge, and familiarity with AWS...

  • Lead Cloud Data Engineer

    13 hours ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,20,000 - US$ 2,00,000 per year

    Key Responsibilities:Engage directly with clients to understand requirements, provide solution design, and drive successful project delivery.Lead cloud migration initiatives, specifically moving on-premise applications and databases to AWS cloud platforms.Design, develop, and maintain scalable, reliable, and secure data applications in a cloud...