Senior Data Engineer

3 days ago

Madurai, Tamil Nadu, India Incedo Inc. Full time

ole Overview

We are seeking a highly skilled AWS Data Engineer with strong expertise in Python development and cloud-based data solutions. The ideal candidate will have a solid background in data migration, API ecosystem development, and modern data warehousing practices. This role involves building, optimizing, and maintaining scalable data pipelines, ensuring smooth integration across platforms, and enabling advanced analytics and reporting.

Core Requirements

Must Have:

  1. Python OOP and Development Experience (7+ years) – Strong hands-on experience with object-oriented programming, reusable code design, and Python-based data workflows.
  2. AWS Data Migration and API Developer Ecosystem (4+ years) – Proven experience in cloud data migration, developing APIs, and working with AWS Big Data services (e.g., Glue, EMR, Athena, Redshift) and serverless offerings (e.g., Lambda, Step Functions).
  3. SQL Programming (3+ years) – Strong SQL skills for data querying, optimization, and transformation.
  4. Snowflake (2+ years) – Hands-on experience in Snowflake data warehousing, schema design, and performance tuning.
  5. DBT (1+ years) – Experience in data transformation and modeling using dbt.

Nice to Have:

6. CI/CD Pipelines – Familiarity with GitLab or equivalent tools for continuous integration and deployment.

7. BI Tooling and Data Analytics – Exposure to reporting and dashboarding tools (e.g., Tableau, Power BI, QuickSight).

8. Infrastructure as Code (IaC) – Experience with Terraform (preferred) or CloudFormation.

9. Linux and Networking Essentials – Strong command-line knowledge and understanding of networking fundamentals.

Key Responsibilities

  • Design, build, and maintain scalable and reliable data pipelines on AWS.
  • Lead end-to-end data migration projects ensuring data integrity, security, and performance.
  • Develop and maintain APIs for seamless data access and integration across systems.
  • Collaborate with data analysts, BI teams, and stakeholders to deliver optimized data models and analytics solutions.
  • Implement dbt models to support data transformation and standardization.
  • Ensure code quality, version control, and deployment practices using CI/CD pipelines.
  • Contribute to infrastructure automation and monitoring for data platforms.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • Strong problem-solving skills with attention to detail.
  • Excellent communication and collaboration skills to work across technical and business teams.

  • Senior Data Engineering Specialist

    1 week ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerWe are seeking an experienced Senior Data Engineer with expertise in Python, Pyspark, and SQL to join our team. This role requires a deep understanding of big data concepts, hands-on coding experience, and the ability to implement streaming analytics and data processing.Key Requirements:5+ years of experience as a Senior Data...

  • Leading Senior Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a seasoned Senior Big Data Engineer to lead our data engineering teams and drive innovation in data-driven solutions. Key Responsibilities:Lead distributed teams across multiple geographies and time zones.Collaborate with architects, product managers, and operations to deliver high-quality...

  • Senior Databricks Data Engineer

    1 week ago

    Madurai, Tamil Nadu, India CodeVyasa Full time

    Looking for Senior Databricks Data Engineer | Pan India to join a team of rockstar developers. The candidate should have a minimum of 10+ yrs. of experience.About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+...

  • Senior Data Engineer Leader

    2 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time US$ 1,95,000 - US$ 2,45,000

    **Job Overview**We are seeking a skilled professional to lead large-scale data engineering, integration, and warehousing projects. As a senior data architect, you will be responsible for building custom integrations between cloud-based systems using APIs and writing complex queries to transform raw data sources into easily accessible models.This role...

  • Senior Data Engineering Position

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleA senior data engineer with 5+ years of experience in designing, developing, and maintaining large-scale data systems is required.Expertise in Azure/AWS Databricks, Python/Scala/Spark/Pyspark, HIVE/HBase/Impala/Parquet, SQL, RDBMS, Github/Bitbucket, Jenkins/Bamboo, and Delta Live Tables (DLT) are expected.Excellent communication skills for direct...

  • Leading Data Engineer

    1 week ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a seasoned Data Engineering professional to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining large-scale data processing systems that drive business intelligence and analytics.Your primary focus will be on architecting and implementing scalable and robust data pipelines...

  • Senior Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Description:**Our organization is seeking a highly skilled AWS data engineer with expertise in Python development and cloud-based data solutions. The ideal candidate will have a solid background in data migration, API ecosystem development, and modern data warehousing practices.The successful candidate will be responsible for designing, building, and...

  • Expertise in Large-Scale Data Engineering

    6 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineer LeadJob Description:We are seeking an experienced Senior Data Engineer to take on a leadership role in our data engineering team. The ideal candidate will have around 6+ years of experience in data engineering or cloud computing data development.Design, develop and optimize ETL/ELT data pipelines using Apache Spark (PySpark or...

  • Senior Data Engineering Manager

    1 week ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Summary:About the Role:We are seeking a highly experienced and strategic leader with deep expertise in data engineering platforms, cloud computing, and software development. The ideal candidate will oversee a team of talented engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and...

  • Senior Data Engineer

    6 days ago

    Madurai, Tamil Nadu, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:The role of Data Architect is a critical position within our organization, responsible for designing and developing scalable data pipelines using Python and AWS.This individual will work closely with cross-functional teams to ensure seamless integration of data systems, leveraging expertise in ETL tools (Glue, Talend) and SQL to drive business...