Data Engineer

14 hours ago

Guntur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,50,00,000

Job Title: Data Engineering Manager

We are seeking skilled professionals to design, build, and manage robust data pipelines that power cloud-native solutions on AWS.

Key Responsibilities:
  • Design, develop, and maintain ETL/ELT pipelines to process structured, unstructured, and streaming data in AWS environments.
  • Leverage AWS services such as S3, Glue, EMR, Lambda, Kinesis, Step Functions, Redshift, Athena, DynamoDB, RDS, and Lake Formation for scalable data ingestion, transformation, storage, and querying.
  • Ensure robust data governance, security, and quality controls throughout the data lifecycle, supporting regulatory compliance.
  • Enable both real-time and batch data processing pipelines to power AI-driven workflows and applications.
  • Collaborate closely with AI/ML teams to prepare clean, high-quality datasets optimized for model training, inference, and fine-tuning.
  • Optimize data infrastructure to achieve high performance, scalability, reliability, and cost efficiency.
  • Implement CI/CD pipelines and data engineering best practices in a cloud-native architecture for automated deployments.
  • Monitor, debug, and resolve issues in data pipelines to ensure high availability, reliability, and minimal latency.
  • Maintain thorough documentation of data pipelines, architecture, and processes to facilitate reproducibility and knowledge transfer.
Required Skills & Qualifications:
  • Strong programming skills in Python, SQL, and/or Scala/Java.
  • Expertise in AWS cloud services, including S3, Glue, EMR, Redshift, Athena, Kinesis, Lambda, Step Functions, DynamoDB, and RDS.
  • Experience with data pipeline orchestration tools such as Apache Airflow, AWS Step Functions, Dagster, or similar.
  • Proficiency in big data frameworks like Apache Spark, Hadoop, or Flink.
  • Solid understanding of data modeling, data warehousing concepts, and schema design principles.
  • In-depth knowledge of data governance, lineage, security policies (IAM roles, encryption, Lake Formation).
  • Hands-on experience in managing real-time streaming data using Kafka, Kinesis, or equivalent tools.
  • Familiarity with DevOps practices, including Infrastructure as Code (Terraform, CloudFormation), CI/CD automation, Git, and containerization (Docker).
Preferred Attributes:
  • Experience working in regulated industries (healthcare, Life Sciences) with a focus on compliance and data privacy.
  • Strong problem-solving skills and ability to work in a collaborative, cross-functional team environment.
  • Passion for designing scalable and efficient cloud-native data solutions.
  • Excellent documentation skills, ensuring clear communication of technical solutions and architecture.

  • Senior Data Engineer

    4 weeks ago

    Guntur, Andhra Pradesh, India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Data Engineer

    1 week ago

    Guntur, Andhra Pradesh, India ValueLabs Full time

    we are hiring for Data EngineerExp: 6 to 10 yearsLocation : HyderabadJob Description: Design, develop, and maintain **ETL/ELT data pipelines** to ingest data from various sources, including databases and flat files, into our data warehouse. Utilize AWS services such as **AWS Lambda**, **AWS DMS**, and **AWS Glue** for data ingestion and transformation...

  • Data Engineering Professional

    4 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ProfessionalWe are seeking a highly skilled Data Engineer to fill this critical role. The ideal candidate will have a strong background in data engineering, with experience in designing and implementing scalable data pipelines, distributed systems, and monitoring/alerting tools.Key Responsibilities:Design and implement scalable...

  • Distinguished Data Engineer

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Data Engineer Job DescriptionWe are seeking an experienced data engineer to design, build, and maintain robust data pipelines. The successful candidate will have a strong background in designing scalable data solutions.

  • AWS Data Engineer

    4 days ago

    Guntur, Andhra Pradesh, India 9NEXUS Full time

    We are seeking a skilled AWS Data Engineer to design, build, and maintain scalable data pipelines and ETL solutions in a cloud environment. The ideal candidate will have hands-on experience with AWS EMR, Glue, , PySpark, Airflow and Python and will work closely with data analysts, data scientists, and other engineering teams to support data-driven...

  • Effective Data Engineer

    7 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerAbout the RoleWe are seeking a seasoned professional to join our team as a Data Engineer. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing large-scale data pipelines using Azure Data Factory.You will work closely with cross-functional teams to deliver high-quality data...

  • Gcp Data Engineer

    1 day ago

    Guntur, Andhra Pradesh, India Tech T7 Innovations Full time

    Job Title: Google Cloud (GCP) Data EngineerLocation: RemoteJob Type: Full-TimeExperience Level: Minimum 5 years +Mandatory Skills: GCS + Google BigQuery + Airflow/Composer + PythonCompany Description:Tech T7 Innovations is a company that provides IT solutions to clients worldwide. The team consists of highly skilled and experienced professionals who are...

  • Data Engineering Opportunities

    7 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Responsibilities for a Data Engineer:The ideal candidate will play a vital role in developing scalable data pipelines to support the organization's growth. This involves designing and implementing data architectures that cater to increasing data complexity and volume.Data Pipeline Development: Develops and maintains efficient data pipelines, ensuring...

  • Expert Data Engineer

    6 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Position: Data ArchitectWe are seeking a seasoned data expert to lead our team in designing and implementing data engineering solutions.Responsibilities:Design and develop ETL pipelines using Azure Data Factory and Fabric toolbox.Develop high-quality datasets for analytics across business areas.Collaborate with cross-functional teams to integrate data...

  • Data Engineering Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time US$ 31,200

    Job OverviewWe are seeking an experienced data engineer to join our global team. The successful candidate will bring expertise in designing, developing, and maintaining large-scale data systems.The ideal candidate will have a strong background in Python, PySpark, SQL, and Palantir Foundry, with at least 5-8 years of experience as a data engineer.Key...