Crafting Scalable Data Pipelines Specialist

6 hours ago


Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

As a senior data engineer, you will play a pivotal role in crafting and implementing scalable data pipelines and transformation frameworks to drive analytics, reporting, and business intelligence across the enterprise.

You will collaborate closely with data architects, platform engineers, and DevOps teams to develop efficient data engineering solutions using cutting-edge tools and best practices.

  • Design and build ETL/ELT pipelines utilizing Azure Data Factory (ADF), Databricks (Spark), and Synapse Analytics.
  • Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  • Integrate data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
  • Implement data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.
Required Skills
  • 5+ years of experience in data engineering roles.
  • Hands-on experience with Azure Data Factory (ADF), Databricks (Spark), Synapse Analytics, and Apache Kafka.
  • Strong skills in SQL, Python, and Spark for data manipulation and transformation.
  • Exposure to CI/CD practices and understanding of data lake architecture.
Nice-to-Have Skills
  • Experience with Delta Lake, Event Hub, or Azure Stream Analytics.
  • Familiarity with infrastructure-as-code tools like Terraform or ARM templates.


  • Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineering PositionWe are seeking a skilled Data Engineer to craft world-class data solutions for global clients. This individual will play a critical role in shaping our data capabilities and driving product insights.Key Responsibilities:Data Pipeline Design and Development: Design, build, and maintain efficient data pipelines to move data from...


  • Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Data Architect SpecialistWe seek a seasoned professional to design and implement robust data pipelines, ensuring seamless data accessibility for analytics and operations.The ideal candidate will possess expertise in Python programming, Azure Data Factory, and Databricks for data integration and analytics. Experience with data modeling, ETL, and database...


  • Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

    Job Title: Data SpecialistJob Summary:We are seeking a highly skilled data engineer to design and implement scalable IoT data solutions. The ideal candidate will have extensive experience in AWS services, Python programming, and data transformation.The successful applicant will be responsible for designing, developing, and deploying efficient data pipelines...


  • Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    A fast, easy, and collaborative analytics platform is required for this role.Job OverviewWe seek an experienced data engineer to develop scalable data architectures.The ideal candidate will have a strong background in data engineering and expertise in designing large-scale data pipelines.Key Responsibilities:Design and develop large-scale data pipelines...


  • Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Azure Data EngineerThis is a challenging and rewarding role that requires expertise in designing, implementing, and maintaining large-scale data pipelines using Azure Databricks (PySpark/Scala).The ideal candidate will have strong experience with Apache Spark, proficiency in developing Azure Function Apps using C#, Python, or JavaScript, and solid...


  • Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Lead Big Data SpecialistJob Description:As a lead big data specialist, you will be responsible for designing and maintaining scalable pipelines using advanced tools such as Databricks, Azure Data Factory, and ETL.The ideal candidate will have expertise in optimizing workflows for efficient data ingestion, transformation, and delivery. You will...


  • Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 23,10,000

    Senior Data Engineer Job DescriptionWe are seeking a seasoned data engineer to design and optimize complex data pipelines. The ideal candidate will have a strong background in ETL, Cloud, Data Warehousing, and Big Data ecosystems.Key Responsibilities:Design and Optimize Data Pipelines: Build ETL/ELT workflows using AWS Glue, Airflow, Databricks, StreamSets,...


  • Tiruppur, Tamil Nadu, India beBeeDevelopment Full time ₹ 12,00,000 - ₹ 17,00,000

    Job Title: Software Crafting SpecialistWe are seeking an experienced Software Crafting Specialist to join our team.The ideal candidate will have a strong command over software development principles and practices, as well as experience in designing and implementing high-quality software solutions.Key Responsibilities:Design and Develop High-Quality Software...

  • Big Data Specialist

    1 week ago


    Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data SpecialistWe are seeking a highly skilled Big Data Specialist to join our team. In this role, you will be responsible for developing and maintaining scalable data pipelines to support continuing increases in data volume and complexity.Required Skills and Qualifications:Develops and maintains scalable data pipelinesCollaborates with...


  • Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Pipeline Integrity Specialist">We are seeking a skilled Data Pipeline Integrity Specialist to ensure the accuracy, completeness, and performance of our data pipelines. This role involves analyzing source data, identifying discrepancies, and collaborating with developers and data engineers for resolution.Key Responsibilities:Data Profiling:...