Data Optimization Expert

3 days ago

Dindigul, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Big Data Engineer Role Overview

We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in designing and implementing high-performance data pipelines.

The role requires the ability to work effectively in a collaborative environment, with excellent communication skills to explain complex technical concepts.

Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies.
  • Optimize database performance, focusing on slow-running queries and latency improvements.
  • Use Python profilers and performance monitoring tools to identify bottlenecks.
  • Reduce P95 and P99 latency metrics across our data platform.
  • Build efficient ETL pipelines that can handle large-scale data processing.
  • Collaborate with data scientists and product teams to understand data requirements.
  • Monitor and troubleshoot data pipeline issues in production.
  • Implement data quality checks and validation mechanisms.
  • Document data architecture and engineering processes.
  • Stay current with emerging big data technologies and best practices.
Qualifications Required

● Bachelor's degree in Computer Science, Engineering, or related technical field.

● 4+ years of experience in data engineering roles.

● Strong Python programming skills with focus on data processing libraries.

● Experience with big data technologies (Spark, Hadoop, etc.).

● Proven experience optimizing database performance (SQL or NoSQL).

● Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).

● Understanding of performance optimization techniques and profiling tools.

● Experience with cloud platforms (AWS, GCP, or Azure).

● Ability to translate business requirements into technical specifications.

● Ability to work effectively in a collaborative team environment.

Benefits

The successful candidate will have the opportunity to work on challenging projects, collaborate with experienced professionals, and contribute to the growth and development of our company.

Skills and Abilities

● Strong analytical thinking and problem-solving skills.

● Excellent attention to detail and commitment to data quality.

● Good communication skills to explain complex technical concepts.

● Self-motivated with the ability to work independently.

● Passion for performance optimization and efficiency.

  • Data Migration Expert

    3 days ago

    Dindigul, Tamil Nadu, India beBeeMigrationspecialist Full time ₹ 15,00,000 - ₹ 20,00,000

    Job SummaryWe are seeking an experienced Data Migration Expert to join our team. As a key member, you will play a crucial role in streamlining and optimizing the migration of incoming clients from their legacy platforms.The ideal candidate will have extensive experience in data migrations, with a strong understanding of recruitment CRMs and data...

  • Data Expert

    21 hours ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data ExpertThe company is looking for a highly skilled Data Expert to join their team.Key Responsibilities:Work with large datasets using PySpark and HiveDesign and implement data ingestion pipelines from disparate sources onto Big Data platformsCollaborate with cross-functional teams to drive business outcomes through data-driven insightsRequired...

  • Data Insights Expert

    20 minutes ago

    Dindigul, Tamil Nadu, India beBeeDataInsights Full time ₹ 5,00,000 - ₹ 19,99,999

    Key Role: Data Insights ExpertAs a seasoned professional, you will play a pivotal role in driving business success through data-driven decision making. This position requires expertise in designing and implementing scalable data solutions.1. Data Architecture:Develop and implement robust data pipelines using Azure Data Factory to ensure seamless data...

  • Transformative Data Expert

    16 hours ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    About the JobWe are seeking a skilled Data Architect to join our team. The successful candidate will be responsible for designing and implementing data solutions that transform assessment data into actionable insights.Job Responsibilities:Understanding business needs and designing solutions that meet those needs.Designing and implementing warehouse and...

  • Monitoring and Performance Optimization Specialist

    17 hours ago

    Dindigul, Tamil Nadu, India beBeePerformance Full time ₹ 15,00,000 - ₹ 20,00,000

    Monitoring and Performance Optimization ExpertAs a Monitoring and Performance Optimization Expert, you will play a critical role in ensuring the health and performance of applications and infrastructure. With 5-8 years of experience in monitoring tools such as New Relic, Dynatrace, or similar platforms, you will be responsible for identifying and resolving...

  • Data Transformation Expert

    6 hours ago

    Dindigul, Tamil Nadu, India beBeeDataTransformation Full time ₹ 1,30,40,000 - ₹ 2,01,60,000

    About UsCvent is a leading technology provider of meeting and event solutions. With over 4,800 employees and ~22,000 customers worldwide, we have a strong presence in the industry. Our company has been growing rapidly since its founding in 1999.About The RoleKey Responsibilities:We are seeking an experienced data transformation expert to design, develop, and...

  • Oil and Gas Data Expert

    17 hours ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer - Oil and GasWe are seeking a skilled Data Engineer with expertise in the Oil and Gas industry to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering, and knowledge of Oil and Gas upstream, midstream, or downstream processes to support...

  • Data Migration Engineer

    21 hours ago

    Dindigul, Tamil Nadu, India beBeeSenior Full time ₹ 21,19,355 - ₹ 25,12,067

    Cloud Data Migration ExpertWe are seeking a highly skilled and experienced Cloud Data Migration Expert to join our team. This role requires a hands-on professional who can design, develop, and implement complex data pipelines, working independently and as a key contributor within a project team.The ideal candidate will have a minimum of 10 years of...

  • Senior Data Expert

    2 days ago

    Dindigul, Tamil Nadu, India beBeeDataExpert Full time ₹ 40,00,000 - ₹ 60,00,000

    As a seasoned data expert, you will lead the development of large-scale data processing systems utilizing Palantir Foundry/Workshop. This role involves designing and implementing efficient data pipelines using PySpark to ensure high-performance data processing.Key Skills:Demonstrated expertise in Palantir Foundry/WorkshopProficient in developing scalable...

  • AI and Data Visualization Expert

    25 minutes ago

    Dindigul, Tamil Nadu, India beBeeDataVisualization Full time ₹ 25,00,000 - ₹ 35,00,000

    Expert Data Visualization SpecialistWe are seeking an exceptional data visualization expert to design and develop high-quality visualizations using Python libraries.The ideal candidate will have a strong background in data science, with expertise in Python (pandas, matplotlib, plotly, bokeh, dash) and experience in data wrangling & preprocessing. They will...