Senior Data Technology Specialist

4 days ago

Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Big Data Engineer Job Description

As a Big Data Engineer, you will be responsible for designing and implementing scalable batch processing systems that process terabytes of data. Your expertise in big data technologies such as Spark and Hadoop will enable us to optimize our existing systems, identify and resolve performance bottlenecks, and implement solutions that improve the overall efficiency of our platform.

Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
  • Stay current with emerging big data technologies and best practices

Required Skills and Qualifications

To succeed in this role, you will need:

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications

Benefits

We offer a competitive compensation package, including a salary range of $120,000 - $180,000 per year, depending on experience. Additionally, we provide comprehensive benefits, including health insurance, retirement plan, and paid time off.

Others

Our team is passionate about delivering high-quality results and working collaboratively to achieve common goals. We believe in investing in our employees' growth and development through training, mentorship, and opportunities for advancement. If you are a motivated and talented individual who is passionate about data engineering, we encourage you to apply for this exciting opportunity.

  • Strategic Technology Partner

    2 days ago

    Kollam, Kerala, India beBeeSolution Full time ₹ 2,00,00,000 - ₹ 2,80,00,000

    Senior AI Solutions SpecialistWe are seeking a skilled Senior AI Solutions Specialist to join our team. As a key member of our pre-sales team, you will be responsible for working closely with account executives to deliver compelling solutions to our clients.Your primary objective will be to translate client needs into technically sound proposals, leveraging...

  • Senior Cloud Data Architect

    2 days ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Software Engineer/Technical SpecialistJob DescriptionWe are seeking a skilled software engineer to join our team. As a senior software engineer, you will be responsible for designing and implementing scalable data architectures using Azure Data Factory (ADF), Databricks, and Synapse Analytics.You will work with large datasets, developing...

  • Expert Data Integration Professional

    2 hours ago

    Kollam, Kerala, India beBeeDataIntegration Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Integration SpecialistWe are seeking an experienced data integration professional to join our team.Job Description:The successful candidate will design, implement and maintain complex data integration solutions using SAP Datasphere. This role requires a strong understanding of data flows, integration with various platforms and optimization...

  • Senior Business Intelligence Specialist

    3 days ago

    Kollam, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Business Intelligence SpecialistWe are seeking an experienced Senior Business Intelligence Specialist to join our team.Job Responsibilities:Develop and enforce data models and naming standards across all deliverables.Reverse engineer business legacy data models and enhance existing database architecture.Communicate technical data integration...

  • Data Strategist

    5 days ago

    Kollam, Kerala, India beBeeBusiness Full time ₹ 40,00,000 - ₹ 80,00,000

    Senior Business Intelligence SpecialistThe role of a Senior Business Intelligence Specialist involves collaborating with various stakeholders to create actionable business insights.Key Responsibilities:Data Collection & AnalysisAnalyze complex datasets and identify trends, patterns, and correlations.Develop predictive models using statistical...

  • Senior Animation Specialist

    2 days ago

    Kollam, Kerala, India beBeeAnimation Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Animation SpecialistWe are looking for a skilled Senior Animation Specialist to join our team. The ideal candidate will have extensive experience in creating engaging animations for various media platforms.About the Role:Create high-quality animations using 3D and 2D techniques.Develop motion graphics, character animations, and logo animations that...

  • Senior Data Manager

    1 day ago

    Kollam, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled Data Management and Recovery Specialist to join our team. As a key member of our operations team, you will be responsible for managing the service offering of Enterprise Recovery, aligning with stakeholder requirements.Key Responsibilities:Develop high-level and low-level designs (HLD, LLD) that meet business...

  • Senior Data Integration Specialist

    7 days ago

    Kollam, Kerala, India beBeeDataSpecialist Full time ₹ 30,00,000 - ₹ 50,00,000

    Job DescriptionWe are seeking an experienced Data Integration Specialist to develop and maintain scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake. This role will involve designing, building, and optimizing ETL processes for loading curated datasets into a cloud-based data warehouse.The ideal candidate will have hands-on experience with...

  • Information Technology Support Specialist

    2 days ago

    Kollam, Kerala, India Vasu Travel & Tourism LLC Full time

    Company Description Welcome to Vasu Travel & Tourism LLC, your go-to partner for comprehensive travel solutions. We specialize in both B2B and B2C services, offering competitive travel tickets, streamlined visa assistance, and reliable transfers. Our expert team ensures seamless travel experiences for both corporate needs and personal adventures. With...

  • Geospatial Data Specialist

    3 days ago

    Kollam, Kerala, India beBeeGeospatial Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title:Geospatial Data SpecialistDescription:We are seeking a highly skilled Geospatial Data Specialist to join our team. In this role, you will play a crucial part in the production and management of geospatial data across various projects. Your tasks will include digitization, geocoding, and conducting surveys when necessary.Responsibilities:Create and...