Building High-Quality Data Processing Systems

3 days ago

Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Data Engineer Job Description

The role of a Data Engineer involves designing, building, and maintaining large-scale data processing systems. These systems are crucial for the organization's ability to analyze and extract insights from data.

As a Data Engineer, you will be responsible for developing high-quality features and finishing tasks to a high standard. You will work independently and collaboratively with other teams to ensure the successful implementation of projects.

Key responsibilities include:

  • Designing and implementing data pipelines and architectures
  • Developing and maintaining large-scale data processing systems
  • Collaborating with cross-functional teams to ensure project success
  • Providing technical guidance and support to team members
Required Skills and Qualifications

To be successful in this role, you will need to have the following skills and qualifications:

  • 5+ years of experience in software development, with a focus on backend and data engineering
  • Proficiency in Python, JVM, and Shell Scripting
  • Experience with cloud native data intensive applications, Amazon Web Service experience is a must
  • Good understanding of data warehouse design and development
  • Experience with Databricks and dbt is required
  • Highly proficient in architecting and implementing workflow management systems, Airflow is a must
  • Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes)
  • Hands-on experience of building and maintaining Spark applications
  • Fundamental understanding of Parquet, Delta Lake and other OTFs file formats
  • Proficiency on an IaC tool such as Terraform, CDK or CloudFormation is a must
  • Experience with observability systems (such as Datadog or Prometheus/Grafana)
  • Strong experience on building CI/CD processes, experience with GitHub Actions, ArgoCD or Jenkins is good to have
  • Experience with unit testing and test automation frameworks
Benefits

We offer a competitive salary and benefits package, including:

  • Flexible working hours and remote work options
  • A comprehensive training program

  • Building Scalable Data Infrastructure

    12 hours ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,25,000

    Job DescriptionWe are seeking a skilled Data Engineer to join our compact team responsible for developing and operating scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for Large Language Model (LLM) research.You will work directly with researchers to accelerate experiments, develop new datasets, improve...

  • High Rise Building Sector Quality Assurance Specialist

    5 days ago

    Rajahmundry, Andhra Pradesh, India beBeeQualityControlEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview:">A high-rise building sector requires a Quality Assurance and Control Engineer to ensure compliance with industry standards, oversee continuous quality improvements, and maintain quality documentation.">We are looking for a skilled engineer who can manage and execute the quality assurance and control processes, conduct quality audits, and...

  • High-Quality Automation Specialist

    5 days ago

    Rajahmundry, Andhra Pradesh, India beBeeSoftware Full time ₹ 22,49,000 - ₹ 30,55,000

    About the RoleOur team is seeking a highly skilled professional to ensure high-quality releases of our platform. As a Software Development Engineer in Test, you will be responsible for designing and implementing robust automation frameworks to test complex workflows across hybrid and on-prem environments.We are looking for an engineer who can collaborate...

  • High-Performance System Administrator

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDatabase Full time ₹ 9,00,000 - ₹ 12,00,000

    System Administration OpportunityWe are seeking an experienced and skilled individual to assume responsibility for ensuring the smooth operation of our MySQL and Linux environments.Main Responsibilities:Database Management: Perform database administration tasks, including installation, configuration, upgrades, replication setup/monitoring, and user...

  • High-Impact Systems Engineer

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeBackend Full time ₹ 80,00,000 - ₹ 2,00,00,000

    We are currently seeking a skilled Backend Developer to join our team. This is an exciting opportunity for someone who wants to build high-impact systems and experience real ownership from day one.Key Responsibilities:Design and optimize asynchronous systems using Python and FastAPI.Develop batch APIs and cron jobs that scale with our business.Work closely...

  • Lead System Developer

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDeveloper Full time ₹ 16,00,000 - ₹ 26,00,000

    As a lead developer, you will be part of a team that creates and maintains large-scale systems serving millions of guests daily through both physical stores and digital platforms.Role Overview5-16 years of experience in system development for large-scale operations is required.High-availability systems handle complex supply chain operations, order...

  • Building Scalable Cloud Data Systems

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineer OpportunityWe are seeking a skilled Data Engineer to spearhead our large-scale data systems using Google Cloud Platform (GCP) technologies.

  • Data Systems Expert

    23 hours ago

    Rajahmundry, Andhra Pradesh, India beBeeDatabase Full time ₹ 80,00,000 - ₹ 1,20,00,000

    About usOur clients focus areas include building a robust digital public health delivery platform, improving data-driven governance and empowering healthcare workers.We are currently working on our most successful initiative - AMRIT (Accessible Medical Records via Integrated Technologies), a first-of-its-kind integrated health technology platform that...

  • High-Performance Systems Engineer

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeebackend Full time ₹ 12,03,743 - ₹ 20,94,925

    Backend ArchitectWe are seeking a highly skilled Backend Architect to join our team. As a key member of our engineering organization, you will be responsible for designing and building scalable, efficient, and secure backend systems.Your primary focus will be on architecting data flows across multiple storage solutions, including PostgreSQL, key-value...

  • Senior Data Engineering Specialist

    7 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Senior Data Engineering Specialist","Job Summary:We are seeking a highly skilled Senior Data Engineering Specialist to join our team. As a key member of the data engineering team, you will be responsible for designing, building and maintaining large-scale data systems.","Key Responsibilities:","Design and develop scalable data pipelines for...