Current jobs related to Optimizing Data Pipelines through Scalable Engineering - Tiruchi, Tamil Nadu - beBeeDataEngineer


  • Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior AWS Data Engineer">We are seeking a highly skilled Senior AWS Data Engineer to join our data engineering team. The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.Key Responsibilities:">">Design, develop, and maintain robust...

  • Cloud Data Engineer

    1 week ago


    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer Job DescriptionLemongrass is a cloud-first company that delivers data solutions using cutting-edge technologies. We're looking for an experienced Cloud Data Engineer to join our team.This role involves designing, implementing, and maintaining robust data pipelines and building scalable data lakes. You'll be working with various data...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job SummaryWe're seeking a skilled Data Engineer to spearhead the development of scalable solutions.This role is ideal for someone who thrives on early-stage challenges and loves building data pipelines from scratch.Data Engineering Expertise: Develop automated systems to extract, process, and analyze large datasets.Scalable Data Systems: Create...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a skilled Data Engineering leader to spearhead the development of our data products and modernize existing platforms.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines and products using cloud-based services.Develop and optimize Extract, Load, Transform (ELT)/Extract, Transform, Load (ETL) processes utilizing Python for...


  • Tiruchi, Tamil Nadu, India beBeeCloud Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Cloud Data Solutions EngineerWe are seeking an experienced professional to design and implement scalable data pipelines and architectures on Google Cloud Platform.Design and develop highly reliable and secure data solutions on GCP using Google Cloud Storage, BigQuery, and Apache Airflow.Develop robust ETL/ELT processes using Python and integrate...


  • Tiruchi, Tamil Nadu, India beBeeBackend Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleWe are seeking a skilled Backend Developer with experience in Go or Rust to join our team. You will play a key role in transforming raw on-chain data into actionable insights by decoding smart contract events and implementing pricing logic from decentralized exchanges (DEXs).This role is ideal for someone who enjoys low-level protocol work,...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We're seeking a skilled Senior Data Engineer to help us design and implement large-scale data processing systems.Key Responsibilities:Develop scalable data pipelines using Python, Scala, Spark, and PysparkCollaborate with cross-functional teams to implement data warehousing solutions using HIVE, HBase, Impala, and ParquetMaintain robust SQL queries and RDBMS...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview:A leading data engineering expert is required to design and optimize modern data platforms.Develop cutting-edge Databricks architecture, development & operations strategies.Create and optimize ETL/ELT pipelines using Python (PySpark) for efficient data processing.Set up and maintain automated CI/CD pipelines with Git/DevOps tools for seamless...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Opportunity:We are seeking a skilled data engineer to join our team and contribute to the development of scalable data pipelines.Data Pipeline Development: Design, build, and maintain ETL/ELT pipelines using AWS Glue, Lambda, and DBT.Data Modeling: Develop and optimize data models in Snowflake for scalability and performance.SQL Query Optimization: Write...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data EngineerRole Description:We are seeking a skilled and experienced Data Architect to take on a key role in shaping our data infrastructure.Main Responsibilities:Design, develop, and maintain scalable data pipelines and systems.Work closely with data scientists and analysts to ensure data quality and availability.Implement data integration and...

Optimizing Data Pipelines through Scalable Engineering

2 weeks ago


Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title:

Data Engineer for Large-Scale Data Pipelines

Role Overview

We are seeking an experienced Data Engineer to design, build, and optimize large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.

Key Responsibilities
  • Design and develop ETL/ELT pipelines using PySpark, AWS, and Databricks.
  • Perform data profiling, validation, and transformation using Python and SQL.
  • Optimize and monitor workflows for performance, scalability, and cost efficiency.
  • Build automation scripts using Linux and Bash for data pipeline orchestration.
  • Collaborate with analytics teams to surface trustworthy KPIs and metrics.
  • Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors.
Requirements
  • 5+ years of data engineering experience with a strong background in Python and SQL.
  • Proven expertise in PySpark, AWS services, and Databricks.
  • Proficiency in Linux/Bash scripting for automation and data operations.
  • Hands-on experience with ETL/ELT pipelines and large-scale integrations.
  • Familiarity with Agile and CI/CD practices.
  • Strong problem-solving and communication skills, with experience in client-facing roles.