Large-Scale Data Processing Specialist

10 hours ago


Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
Job Title: Data Engineer

Design and implement large-scale data processing systems using Azure technologies.

  • Proficiency in SQL, expertise in Python programming.
  • Experience with Apache Spark for data processing.
  • Understanding of Delta files and Lakehouse architecture.
  • Data warehouse knowledge or experience.

Key Responsibilities:

  1. Set up pipelines, manage data ingestion with Dataflows Gen2.
  2. Create pipelines with Data Factory capabilities.
  3. Secure a Microsoft Fabric data warehouse and administer the platform effectively.

Benefits:

  • Hands-on skills in Microsoft Fabric.
  • Training in setting up end-to-end analytics solutions.

Requirements:

  • SQL proficiency.
  • Apache Spark experience.
  • Lakehouse architecture understanding.

Desirable Skills:

  • Python programming skills.
  • Microsoft Fabric training.


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:We are seeking a skilled Data Engineering Specialist to join our team. As a key member, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure technologies.You will design and develop scalable data pipelines, collaborate with cross-functional teams, and stay up-to-date with the latest...


  • Thiruvananthapuram, Kerala, India beBeeBigDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerOverview:We are seeking a highly skilled Senior Big Data Engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing large-scale data pipelines.Design and develop large-scale data pipelines and distributed data processing systems.Work extensively with Scala,...


  • Thiruvananthapuram, Kerala, India beBeeinfrastructure Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Infrastructure SpecialistWe are seeking an accomplished Lead Infrastructure Specialist to spearhead the design, implementation, and maintenance of large-scale infrastructure systems. The ideal candidate will possess extensive experience in driving technical innovation, leadership, and collaboration within a dynamic team environment.


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerAs a skilled Cloud Data Engineer, you will be responsible for designing and developing large-scale data pipelines using cloud technologies.The ideal candidate will have 5-7 years of experience in a data engineering role, with core Google Cloud Platform (GCP) experience of 3-4 years.Strong communication skills and the ability to work with...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,75,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to support large-scale data operations across ~200 servers. The role combines data analysis, architecture, and engineering responsibilities to improve data accessibility, performance, and retention.Key Responsibilities:Review and interpret data across ~200 servers, ensuring...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionAt our organization, we are seeking an accomplished Data Engineer to spearhead the design and implementation of large-scale data processing systems using Apache Ray.


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data Architect SpecialistWe are seeking a skilled Data Engineer to build and automate data pipelines, manage multi-environment deployments, and work with modern DevOps/configuration management tools.Responsibilities:Pipeline Development: Design, implement, and manage continuous integration/continuous deployment (CI/CD) pipelines using GitHub...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineering SpecialistOverview:We are seeking an experienced data engineering specialist to lead the design, development, and maintenance of large-scale data processing systems.Responsibilities:Work with big data technologies like HIVE, HBase, Impala, and Parquet.Develop strong SQL and RDBMS skills.Experience with version control systems like...


  • Thiruvananthapuram, Kerala, India beBeeDataIntegration Full time ₹ 8,00,000 - ₹ 14,50,000

    We are seeking an experienced Data Integration Specialist to join our data integration team. The ideal candidate will be responsible for developing and maintaining ETL processes, ensuring timely data loads and reconciliations across multiple business applications.The successful candidate will have hands-on experience integrating with SAP, Salesforce, Oracle,...

  • Big Data Specialist

    5 days ago


    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time US$ 5,00,000 - US$ 10,00,000

    As a Big Data Engineer, you will be responsible for designing and developing large-scale data processing systems. This role requires expertise in handling complex data pipelines and ensuring high-performance data analytics.Key Responsibilities: