Large-Scale Data Engineer – Expertise in Cloud Technologies

5 days ago

Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Job Description

We are seeking a Freelance Data Engineer to join our team. The successful candidate will be responsible for designing, building, and optimizing large-scale data pipelines using Python, SQL, AWS, and Databricks.

The ideal candidate will have 5+ years of experience in data engineering with a strong background in Python and SQL. Proven expertise in PySpark, AWS services, and Databricks is also required.

The job involves working closely with cross-functional teams to define and implement data requirements, ensuring thorough documentation and knowledge sharing across stakeholders.

Key Responsibilities:
  • Design and develop ETL/ELT pipelines using PySpark, AWS, and Databricks.
  • Perform data profiling, validation, and transformation using Python and SQL.
  • Optimize and monitor workflows for performance, scalability, and cost efficiency.
  • Build automation scripts using Linux and Bash for data pipeline orchestration.
  • Collaborate with analytics teams to surface trustworthy KPIs and metrics.
  • Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors.
Qualifications:
  • Bachelor's degree in Computer Science or related field.
  • 5+ years of data engineering experience with a strong background in Python and SQL.
  • Proven expertise in PySpark, AWS services, and Databricks.
  • Proficiency in Linux/Bash scripting for automation and data operations.
  • Hands-on experience with ETL/ELT pipelines and large-scale integrations.
  • Familiarity with Agile and CI/CD practices.
  • Strong problem-solving and communication skills, with experience in client-facing roles.
Benefits:
  • Opportunity to work on large-scale data projects.
  • Chance to collaborate with experienced professionals.
  • Flexibility to work remotely.

  • Cloud Data Engineer Position

    1 day ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Engineering Specialist\About the Role:\\Design, develop and maintain large-scale cloud-based data pipelines using GCP services such as BigQuery, Cloud Storage and Cloud Pub/Sub.\Collaborate with cross-functional teams to integrate data engineering capabilities into business applications.\Develop real-time analytics solutions using GCP...

  • Big Data Architect

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineer - Large Scale Data PlatformsWe are seeking a seasoned Senior Data Engineer to design and build robust data pipelines for ingestion, transformation, and analytics. The ideal candidate will have expertise in the GCP ecosystem and hands-on experience with Big Data tools such as Hadoop, Spark, and Kafka.The selected professional will be responsible...

  • Cloud Data Architect

    1 day ago

    Tirupati, Andhra Pradesh, India beBeeCloudDataArchitect Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Cloud Data ArchitectAbout the Role:We are seeking a skilled Cloud Data Architect to design and implement large-scale data processing systems using AWS technologies.The ideal candidate will have strong expertise in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions. They should be proficient in Lambda or...

  • Cloud Data Engineering Position

    1 day ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Specialist We are seeking an experienced data engineer to join our team. Key Responsibilities:Design and implement large-scale data pipelines using cloud-based services.Develop data solutions utilizing cloud platforms and possess proficiency in programming languages such as SQL and Python.Collaborate with cross-functional teams...

  • Cloud Data Engineer

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Cloud Data EngineerAbout the RoleWe are seeking a skilled Cloud Data Engineer to join our team.Job DescriptionThe successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems on cloud platforms.Key Responsibilities:Design and develop data pipelines using Apache Spark, AWS Glue, and Amazon...

  • Big Data Engineer Manager

    6 days ago

    Tirupati, Andhra Pradesh, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Engineer Manager - Cloud ArchitectureOverviewWe are seeking a highly experienced and strategic engineering manager to lead our team of data engineers. The ideal candidate will have deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The successful candidate will design and deliver scalable data pipelines and analytics...

  • Engineering Manager – Big Data, Azure

    6 days ago

    Tirupati, Andhra Pradesh, India DataE2E Technologies Full time

    Technical Manager – AzureLocation: 100% RemoteEmployment Type: Full-timeShift Timing : 3 pm – 11 pm ISTJob Summary:About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The ideal candidate will lead a team of talented data engineers to design and...

  • Senior Large Language Model Engineer

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeArtificial Full time ₹ 3,00,00,000 - ₹ 3,50,00,000

    Lead AI Architect PositionOverview of Job Role:We are seeking a highly skilled and experienced Lead AI Architect to oversee the development and implementation of large language models (LLMs). The successful candidate will have expertise in LLM architecture, design, and deployment.This is a remote opportunity that requires collaboration with cross-functional...

  • Cloud Data Engineering Position

    5 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

    Job Overview:Are you a skilled professional looking for a challenging role in cloud engineering? We have an exciting opportunity for a Data Engineer to join our team.Key Responsibilities:Design and implement data pipelines using GCP services.Collaborate with cross-functional teams to develop and maintain large-scale data systems.Ensure the scalability,...

  • Real-Time Data Architect

    7 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview">This is a full-time hybrid role for a Data Engineer professional at NovBliss.">The candidate will be responsible for building and maintaining large-scale data infrastructures, developing real-time data processing pipelines using technologies like Kafka, Flink, and Spark. The role includes data modeling, ETL processes, and ensuring data quality...