Senior Data Engineer

3 weeks ago

Guntur, Andhra Pradesh, India Aptus Data Labs Full time

Job Title: Senior Data Engineer

Location: Remote

Experience: 4+

Employment Type: Full-Time

Notice- Looking for immediate joiners or who can join within 15-20 days.

About the Role

Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and scalable analytics.

This role reports to the Head – Data Platform and AI Lead, offering a unique opportunity to be part of a cross-functional team shaping the future of data-driven innovation.

Key Responsibilities

Data Engineering & Pipeline Development

  • Design and develop reliable, reusable ETL/ELT pipelines using AWS Glue, Python, and Spark.
  • Process structured and semi-structured data (e.g., JSON, Parquet, CSV) efficiently for analytics and AI workloads.
  • Build automation and orchestration workflows using Airflow or AWS Step Functions.

Data Lake Architecture & Integration

  • Implement AWS-native data lake/lakehouse architectures using S3, Redshift, Glue Catalog, and Lake Formation.
  • Consolidate data from APIs, on-prem systems, and third-party sources into a centralized platform.
  • Optimize data models and partitioning strategies for high-performance queries.

Security, IAM & Governance Support

  • Ensure secure data architecture practices across AWS components using encryption, access control, and policy enforcement.
  • Implement and manage AWS IAM roles and policies to control data access across services and users.
  • Collaborate with platform and security teams to maintain compliance and audit readiness (e.g., HIPAA, GxP).
  • Apply best practices in data security, privacy, and identity management in cloud environments.

DevOps & Observability

  • Automate deployment of data infrastructure using CI/CD pipelines (GitHub Actions, Jenkins, or AWS CodePipeline).
  • Create Docker-based containers and manage workloads using ECS or EKS.
  • Monitor pipeline health, failures, and performance using CloudWatch and custom logs.

Collaboration & Communication

  • Partner with the Data Platform Lead and AI Lead to align engineering efforts with AI product goals.
  • Engage with analysts, data scientists, and business teams to gather requirements and deliver data assets.
  • Contribute to documentation, code reviews, and architectural discussions with clarity and confidence.

Required Qualifications

  • Bachelor's degree in computer science, Engineering, or equivalent.
  • 4+ years of experience in data engineering, preferably in AWS cloud environments.
  • Proficient in Python, SQL, and AWS services: Glue, Redshift, S3, IAM, Lake Formation.
  • Experience managing IAM roles, security policies, and cloud-based data access controls.
  • Hands-on experience with orchestration tools like Airflow or AWS Step Functions.
  • Exposure to CI/CD practices and infrastructure automation.
  • Strong interpersonal and communication skills—able to convey technical ideas clearly.

Preferred Additional Skills

  • Proficiency in Databricks, Unity Catalog, and Spark-based distributed data processing.
  • Background in Pharma, Life Sciences, or other regulated environments (GxP, HIPAA).
  • Experience with EMR, Snowflake, or hybrid-cloud data platforms.
  • Experience with BI/reporting tools such as Power BI or QuickSight.
  • Knowledge of integration tools (Boomi, Kafka) or real-time streaming frameworks.

Ready to build data solutions that fuel AI innovation?

Join Aptus Data Labs and play a key role in transforming raw data into enterprise intelligence.

  • Senior Data Engineer Opportunity

    1 day ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer OpportunityWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.The ideal candidate will have advanced proficiency in SQL and ETL/ELT design, strong experience with dbt, Airflow, and Spark, as well as a deep understanding of data modeling techniques such as Star Schema, 3NF, and SCD2.Key...

  • Senior Data Systems Architect

    2 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Description:As a Senior Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using Python and Pyspark.The ideal candidate will have hands-on coding expertise in Python and Pyspark, as well as strong experience with Telemetry, Big Data, and backend engineering.Domain knowledge of IoT systems,...

  • Senior IT Data Engineer

    2 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Lead Data Extraction SpecialistThe ideal candidate will have a minimum of 4 years of hands-on experience in IT data extraction, with at least 2 years leading a team of 5+ developers.This role requires deep technical knowledge in advanced data extraction techniques, reverse engineering, automation, and leadership skills to drive the team towards...

  • Data Engineer

    1 day ago

    Guntur, Andhra Pradesh, India beBeeInformatica Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Informatica Developer - Data EngineeringWe are seeking a seasoned data engineer to lead the design and implementation of our ETL workflows using Informatica BDM/DEI.Responsibilities:Design and develop scalable ETL pipelines leveraging Informatica BDM/DEI, Hive, Spark, and big data technologies.Integrate structured and unstructured data from various...

  • Senior Data Engineering Professional

    2 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineer Role OverviewAbout the PositionWe are seeking a highly motivated and skilled data engineer to join our team as a Marketing Platform Specialist. The successful candidate will be responsible for extracting valuable data from marketing platforms, uncovering hidden API endpoints, and crafting high-quality datasets in Snowflake that fuel advanced...

  • Senior Cloud Data Specialist

    9 hours ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    About Data Engineering Roles:As a seasoned Senior Python Engineer, you will design, implement and optimize data pipelines using cloud-based technologies.Key Responsibilities:Design, develop and maintain scalable and efficient data pipelines using Python and cloud-based technologies.Implement Extract, Transform, Load (ETL) processes to move data from diverse...

  • Senior Data Scientist

    12 hours ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer The ideal candidate for this role is a skilled and experienced data engineer with expertise in designing, developing, and maintaining large-scale data pipelines using PySpark. Key Responsibilities:• Design and develop scalable data pipelines using PySpark, focusing on efficiency, reliability, and maintainability.• Implement...

  • Senior Data Architect

    24 hours ago

    Guntur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Job OverviewAs a senior data engineer, you will lead the development of large-scale data processing systems. Your expertise in designing and implementing scalable architectures will drive business growth and innovation.Key Responsibilities:Develop and implement data pipelines to extract insights from diverse data sources.Collaborate with cross-functional...

  • Senior Cloud Data Specialist

    4 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 22,00,000 - ₹ 26,00,000

    Job Title: Senior Data Engineer & Infrastructure ExpertWe are looking for a seasoned professional to lead full lifecycle implementations, from secure platform setup and cloud integration to high-performance data pipeline development.This role is ideal for individuals who thrive at the intersection of data engineering, infrastructure, and DevOps, and want to...

  • Data Engineer

    2 days ago

    Guntur, Andhra Pradesh, India ValueLabs Full time

    we are hiring for Data EngineerExp: 6 to 10 yearsLocation : HyderabadJob Description: Design, develop, and maintain **ETL/ELT data pipelines** to ingest data from various sources, including databases and flat files, into our data warehouse. Utilize AWS services such as **AWS Lambda**, **AWS DMS**, and **AWS Glue** for data ingestion and transformation...