High-Performance Data Engineer

4 days ago

Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Description

Big Data Engineer Role

This is a high-performance data engineering role that involves the design, build, and maintenance of scalable data pipelines using Python and big data technologies.

Our ideal candidate will have strong analytical thinking and problem-solving skills, excellent attention to detail, and a commitment to data quality.

They will be able to work effectively in a collaborative team environment, communicate complex technical concepts clearly, and remain self-motivated while working independently.

The successful candidate will be passionate about performance optimization and efficiency, with experience in optimizing database performance, implementing scalable batch processing systems, and reducing latency metrics.

Key Responsibilities Include:

  • Designing and implementing efficient ETL pipelines that can handle large-scale data processing.
  • Optimizing database performance by focusing on slow-running queries and latency improvements.
  • Using Python profilers and performance monitoring tools to identify bottlenecks.
  • Collaborating with data scientists and product teams to understand data requirements.
  • Monitoring and troubleshooting data pipeline issues in production.
  • Implementing data quality checks and validation mechanisms.
  • Documenting data architecture and engineering processes.

Required Skills and Qualifications

Our ideal candidate should possess a Bachelor's degree in Computer Science, Engineering, or a related technical field.

They should also have 4+ years of experience in data engineering roles, with strong Python programming skills and a focus on data processing libraries.

Experience with big data technologies, such as Spark and Hadoop, is essential, along with proven experience in optimizing database performance and knowledge of data pipeline orchestration tools.

Additionally, they should have an understanding of performance optimization techniques and profiling tools, as well as experience with cloud platforms like AWS, GCP, or Azure.

Benefits

We offer a competitive salary package and opportunities for career growth and development.

Our team works collaboratively in a dynamic and fast-paced environment, with a passion for innovation and performance optimization.

As a Big Data Engineer at our company, you will be given the autonomy to work on challenging projects, collaborate with experienced professionals, and stay up-to-date with emerging technologies.

Others

Our company is committed to providing equal employment opportunities and fostering a diverse and inclusive work environment.

We value creativity, innovation, and teamwork, and we believe that our employees are our greatest asset.

If you are a motivated and talented individual who shares our values and passions, please consider joining our team.

  • Senior Data Engineer

    3 weeks ago

    Guntur, Andhra Pradesh, India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • High Performance Network Engineer

    3 days ago

    Guntur, Andhra Pradesh, India beBeeWlan Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Role Summary:We are seeking a WLAN Driver Developer to design, develop, and maintain high-performance WLAN Linux Device Drivers. Key Responsibilities:Driver Design and Development:Firmware Contribution:Performance Optimization:Cross-Functional Collaboration:Software Quality Assurance:Our ideal candidate will have strong expertise in Embedded C programming,...

  • High Performance Storage Firmware Developer

    3 days ago

    Guntur, Andhra Pradesh, India beBeeFirmware Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Firmware EngineerWe are seeking an experienced Firmware Engineer to design and optimize high-performance storage firmware for next-gen products.Key Responsibilities:Develop firmware for NAND Flash-based storage products (SATA/PCIe/NVMe)Implement Flash Translation Layer (FTL) and/or Flash Management modulesDesign multi-core platform firmwareDebug firmware and...

  • High-Performing Results Driven Performance Engineering Professional

    2 days ago

    Guntur, Andhra Pradesh, India beBeePerformance Full time ₹ 7,50,000 - ₹ 15,00,000

    Job Title: Performance Engineer">Key Responsibilities:Develop and execute performance test plans and scenarios.Monitor application performance to identify bottlenecks.Analyze test results to provide detailed performance reports.Collaborate with development teams to optimize system performance.Create performance benchmarks and assist in capacity...

  • High-Performance Digital Circuit Designer

    1 day ago

    Guntur, Andhra Pradesh, India beBeeEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    We are seeking an experienced IP/RTL Design Engineer to join our team in designing and developing intellectual property (IP) and Register Transfer Level (RTL) for Ethernet switches tailored for AI datacenter backend networks.The ideal candidate will have a strong background in digital design, ASIC/FPGA development, Ethernet protocols, and experience with...

  • High-Performance Backend Developer

    2 days ago

    Guntur, Andhra Pradesh, India beBeeSoftware Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Software Engineer - Backend">As a senior software engineer, you will design, develop, and maintain high-performance backend services using Go. This is an excellent opportunity to leverage your expertise in building scalable microservices and RESTful APIs.">Key Responsibilities:Design and implement high-quality, efficient code following best...

  • High-Touch Data Specialist

    4 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering PositionWe are seeking a highly skilled data professional to join our organization.Key Responsibilities:ETL Pipeline Development: Design, develop, and maintain efficient ETL pipelines using FiveTran, DBT Cloud, and custom frameworks to ensure seamless data processing and storage.Data Transformations: Implement client-specific data...

  • High-Performance AI Storage Solutions Tester

    5 days ago

    Guntur, Andhra Pradesh, India beBeeValidation Full time ₹ 15,00,000 - ₹ 25,00,000

    AI Data Storage Solutions Validation EngineerWe are seeking a highly skilled AI Data Storage Solutions Validation Engineer to join our team. This role will be responsible for designing, developing, and running automated and manual tests to validate high-performance storage solutions for HPC and AI markets.Main Responsibilities:Design and develop test cases...

  • High-Performance Computing Specialist

    1 day ago

    Guntur, Andhra Pradesh, India beBeegpu Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    GPU Programming EngineerWe are looking for an experienced GPU programmer to develop, optimize and deploy GPU-accelerated solutions for high-performance machine learning workloads.Key Responsibilities:Develop, optimize and maintain GPU-accelerated components for machine learning pipelines using frameworks such as CUDA, HIP or OpenCL.Improve GPU kernel...

  • Data Engineering Opportunities

    2 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Responsibilities for a Data Engineer:The ideal candidate will play a vital role in developing scalable data pipelines to support the organization's growth. This involves designing and implementing data architectures that cater to increasing data complexity and volume.Data Pipeline Development: Develops and maintains efficient data pipelines, ensuring...