Data Engineer for High Performance Systems

22 hours ago

Amrāvati, Maharashtra, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,70,000

**Big Data Expert Wanted**

We're looking for a talented individual to join our team as a Big Data Engineer. The ideal candidate will have experience designing and implementing high-performance data pipelines that process massive amounts of data.

The role involves working with big data technologies such as Spark, Hadoop, and Clickhouse Database to optimize database performance, identify bottlenecks, and implement solutions that improve efficiency. We need someone who can translate business requirements into technical specifications and work effectively in a collaborative team environment.

Responsibilities:
  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
Requirements:
  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)

  • High Performance Testing Engineer

    3 days ago

    Amrāvati, Maharashtra, India beBeeQuality Full time US$ 1,00,000 - US$ 1,20,000

    Job OpportunityGoQuant is a leading provider of high-performance trading solutions for digital assets. We empower professional traders and institutions with a comprehensive suite of tools, including an advanced Order Execution and Management System (OEMS), high-quality Market Data services, and a robust Portfolio and Risk Management System (PMS/RMS). Our...

  • Data Engineering Specialist

    22 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,80,00,000

    About the RoleAs a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that cater to the organization's needs.The role requires cross-functional collaborations with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.You will work...

  • Architecting High-Performance Data Solutions

    4 days ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Engineer Role Summary:We are seeking a skilled Senior Data Engineer to join our team and contribute to the development of cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures.Key Responsibilities:Design and implement ETL pipelines for large-scale data ingestion and transformation.Build real-time streaming...

  • High-Rise Building MEP Systems Engineer

    22 hours ago

    Amrāvati, Maharashtra, India beBeeMEPEngineer Full time ₹ 15,00,000 - ₹ 19,90,000

    Job Description">As a seasoned MEP engineer, you will be responsible for designing and implementing mechanical, electrical, and plumbing systems in high-rise buildings. This role requires expertise in HVAC design, electrical circuit design, and plumbing system design, with a strong emphasis on efficiency, reliability, and compliance with building codes and...

  • High Performance Back End Developer

    2 days ago

    Amrāvati, Maharashtra, India beBeeBackEndDeveloper Full time US$ 1,20,000 - US$ 2,00,000

    Backend Developer RoleWe are seeking an experienced Backend Developer to play a pivotal role in shaping our eSIM services platform. Our platform simplifies connectivity with powerful APIs and robust interfaces, enabling global eSIM lifecycle management and seamless integrations.The successful candidate will be responsible for designing and developing...

  • Data Engineer

    4 weeks ago

    Amrāvati, Maharashtra, India Insight Global Full time

    Position: Data Engineer (contract position)Location: Remote Duration: 6 month contract with extensions Pay range: $15 USD per hour (40 hours per week)Insight Global is seeking a skilled Data Engineer to design, build, and maintain our data processing systems using Azure cloud technologies. The ideal candidate will leverage Databricks, Azure Data Factory...

  • High-Performing QA Lead

    3 days ago

    Amrāvati, Maharashtra, India beBeePerformance Full time ₹ 18,00,000 - ₹ 2,59,20,000

    Our company is seeking a seasoned Performance QA professional with extensive experience in JMeter and leadership skills to oversee performance testing efforts.About the Role:The successful candidate will manage high-performing QA teams and projects.They will design and optimize complex JMeter scripts for various applications and environments.Collaboration...

  • Highly Skilled Data Engineer Wanted

    22 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants.The ideal candidate will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other...

  • Data Engineer

    3 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Unlock Your Potential as a Data EngineerWe're seeking an experienced and innovative Data Engineer to join our team. As a key member of our data analytics platforms, you will be responsible for developing and deploying scalable data processing pipelines using Azure Data Factory, Azure Databricks, and other relevant technologies.Your primary focus will be on...

  • High-Performing Campaign Strategist

    1 day ago

    Amrāvati, Maharashtra, India beBeeCampaign Full time ₹ 40,00,000 - ₹ 80,00,000

    We are seeking seasoned advertising professionals to lead large-scale campaigns.Key Responsibilities:Create high-performing ad strategies for diverse markets.Maintain accurate budget management and invoicing processes.Conduct thorough market research and competitor analysis to maximize ROI.Develop and optimize campaigns across multiple platforms.Provide...