Expert Large Scale Data Pipeline Specialist

4 days ago


Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Title: Freelance Data Engineer – Python, SQL, AWS

About the Role

We are seeking an experienced Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using PySpark, AWS, and Databricks. The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.

Key Responsibilities:
  • Design and develop ETL/ELT pipelines using PySpark, AWS, and Databricks.
  • Perform data profiling, validation, and transformation using Python and SQL.
  • Optimize and monitor workflows for performance, scalability, and cost efficiency.
  • Build automation scripts using Linux and Bash for data pipeline orchestration.
  • Collaborate with analytics teams to surface trustworthy KPIs and metrics.
  • Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors.
  • Work closely with cross-functional teams (analysts, product managers, engineers) to define and implement data requirements.
  • Ensure thorough documentation and knowledge sharing across stakeholders.
Required Skills and Qualifications
  • 5+ years of data engineering experience with a strong background in Python and SQL.
  • Proven expertise in PySpark, AWS services, and Databricks.
  • Proficiency in Linux/Bash scripting for automation and data operations.
  • Hands-on experience with ETL/ELT pipelines and large-scale integrations.
  • Familiarity with Agile and CI/CD practices.
  • Strong problem-solving and communication skills, with experience in client-facing roles.


  • Erode, Tamil Nadu, India beBeeDatabase Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Senior Database AdministratorAs a senior database administrator, you will be responsible for managing and maintaining large-scale database systems.This involves planning, designing, and implementing databases to meet business requirements. You will analyze existing database systems and recommend improvements to enhance performance and efficiency.Key...


  • Erode, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data Systems EngineerAs a seasoned systems engineer, you will be responsible for designing and developing large-scale data systems. Your expertise in Trino (PrestoSQL) will enable you to craft high-performing queries that meet business needs.Key Skills:Strong hands-on experience with distributed computing frameworks.Proficiency in SQL performance tuning...


  • Erode, Tamil Nadu, India beBeeLookDevArtist Full time ₹ 10,00,000 - ₹ 15,00,000

    Visual Artist for Large-Scale EnvironmentsWe are seeking a highly skilled Visual Artist to join our team. This role requires a strong background in look development, shading, set building, and rendering workflows.In this position, you will play a key part in shaping the visual identity of large-scale projects. You'll be responsible for delivering top-quality...


  • Erode, Tamil Nadu, India beBeeDataMigration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Expert Data Migration SpecialistThis role requires a highly skilled individual to lead data migration activities for large-scale ERP projects. The ideal candidate will have extensive experience in data migration, strong leadership skills, and the ability to collaborate with cross-functional teams.Key Responsibilities:Develop and implement data migration...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Key Roles and ResponsibilitiesWe are seeking a highly skilled professional to join our data engineering team. As a key member of the team, you will play a vital role in designing and implementing efficient data pipelines using modern DevOps tools.Develop and manage continuous integration and delivery pipelines using GitHub Actions or equivalent...


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title: Data Engineering Specialist">We are looking for a highly skilled data engineering specialist to join our team. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts,...

  • Senior Data Expert

    7 days ago


    Erode, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    **Job Title:** Data SpecialistOverviewWe are seeking a highly skilled Data Specialist to join our team in a mission-critical banking project. This is an opportunity to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures—building scalable, high-performance solutions for a leading financial services environment.Key...


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Engineering SpecialistAttractive job opportunities exist for highly skilled Data Engineering Specialists to create and maintain large-scale data processing systems.Main Responsibilities:We are looking for a professional who can design and develop efficient data pipelines using Azure Data Factory and associated tools.The ideal candidate will have...


  • Erode, Tamil Nadu, India beBeeWorkforcePlanning Full time ₹ 12,00,000 - ₹ 13,00,000

    **Job Title: Workforce Planning Manager**We are seeking a highly skilled Workforce Planning Manager to join our team in Pune. This individual will be responsible for developing and implementing effective workforce management strategies, ensuring optimal staffing levels, and driving efficiency through data-driven insights.The ideal candidate will have 5+...


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a skilled Data Engineering expert to design, build and maintain high-performance data pipelines that process large volumes of data.This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.Key Responsibilities include:Designing and implementing scalable...