High-Performance Data Pipeline Specialist

6 days ago


Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

Our Big Data Engineer role involves creating high-performance data pipelines that process massive amounts of data. You will work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform.

Key Responsibilities
  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
Qualifications Required

To be successful in this role, you must have:

  • A Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)


  • Mount Abu, Rajasthan, India beBeeData Full time US$ 1,20,000 - US$ 1,40,000

    Lead Data ArchitectWe are seeking a highly skilled Lead Data Architect to design, build and maintain sophisticated ETL pipelines, high-performance database structures, and BI solutions to drive data-powered outcomes that enhance client value across telecom operations and IT asset management.Our ideal candidate has 7+ years of SQL database development...


  • Mount Abu, Rajasthan, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OpportunityThreatXIntel is a cyber security company dedicated to protecting businesses and organizations from cyber threats.We are looking for an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory for ETL and ELT...


  • Mount Abu, Rajasthan, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Databricks Data EngineerJob Description:We are seeking a highly skilled professional with expertise in designing, developing and maintaining scalable and high-performance data pipelines using Databricks and PySpark.The ideal candidate will be well-versed in implementing and managing data solutions on AWS, including services like S3, Glue, Lambda, EMR...


  • Mount Abu, Rajasthan, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:As a technical specialist, you will be responsible for leveraging your skills in data warehousing and Azure Synapse Analytics to design, implement, and manage data pipelines.You will work closely with clients to understand their data needs and requirements, providing support and training to users on data tools and solutions.


  • Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Job TitleA Data Engineering Leader is responsible for building and optimizing data pipelines, collaborating with cross-functional teams to ensure efficient data flow. This role requires a proactive leader with 6+ years of experience in data engineering, leading large-scale projects.We are seeking an expert in data warehouse architecture, dimensional...


  • Mount Abu, Rajasthan, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Integration SpecialistAbout the Role:We are seeking an experienced data integration specialist to join our team. The successful candidate will be responsible for designing, developing, and maintaining complex data pipelines using Informatica PowerCenter.Key Responsibilities:Develop, enhance, and maintain Informatica mappings, workflows, and...


  • Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 24,00,000

    About UsWe're looking for a seasoned data engineer to join our team. As a key player in our organization, you will be responsible for designing and implementing modern data warehouse solutions using Snowflake and ADF.In this role, you will provide forward-thinking solutions in the data engineering and analytics space. You will collaborate with DW/BI leads to...


  • Mount Abu, Rajasthan, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Unlock Your Career PotentialAs a skilled professional in data engineering, you will have the opportunity to make a meaningful impact in shaping the future of data and analytics.Job Overview: We are seeking a detail-oriented Data Engineer with expertise in Azure, SQL Server, and Databricks to design, build, and manage scalable data pipelines and enterprise...


  • Mount Abu, Rajasthan, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

    Job Opportunity: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team. The successful candidate will have a strong background in designing and implementing scalable data pipelines using Azure Databricks (PySpark/Scala) and developing and deploying Azure Function Apps for event-driven data processing and automation.The ideal...


  • Mount Abu, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Infrastructure SpecialistWe are seeking a skilled data infrastructure specialist to contribute to building our robust data platform, enabling insights and analytics for slot games.About the Role:This role involves designing, developing, and maintaining scalable data pipelines to ensure high-quality, reliable data for player behavior...