Big Data Specialist

1 day ago


Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000
Big Data Specialist

We are seeking a highly skilled professional to design, develop and maintain data pipelines for large-scale data ingestion, transformation and storage.

About the Role

The successful candidate will be responsible for designing efficient data pipelines using Big Data ecosystems and working closely with cross-functional teams to deliver reliable solutions.

  • Develop data pipelines using Hadoop, Spark, Hive etc. for efficient data processing
  • Design and develop ETL processes to integrate data from multiple sources into data warehouses/lakes
  • Write and optimize SQL queries for data validation, transformation and analytics
  • Collaborate with cross-functional teams to deliver high-quality solutions
Requirements
  • Proven experience in Big Data technologies (Hadoop, Spark, Hive, HDFS, Kafka etc.)
  • Strong expertise in SQL (query optimization, stored procedures, complex joins)
  • Hands-on experience with ETL tools/processes (Informatica, Talend, Apache NiFi, Airflow or custom ETL)
  • Deep understanding of Data Warehousing concepts (star schema, snowflake schema, fact/dimension tables)

Preferred qualifications include experience with real-time data streaming, containerization and orchestration and DevOps practices for CI/CD in data engineering.

Key Skills

Data Engineering, Big Data Technologies, SQL Optimization, ETL Development, DevOps Practices.



  • Madurai, Tamil Nadu, India beBeeInfrastructure Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Big Data Infrastructure Specialist, you will be responsible for designing and optimizing large-scale data processing environments.Key Responsibilities:Designing and implementing high-performance data clustersMigrating data between different systems using efficient tools and techniquesPerforming performance tuning and optimization to ensure seamless data...


  • Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Job OpportunitySkill: Big Data Hadoop SpecialistYears of Experience: 6 - 12 yearsLocation: IndiaNotice Period: FlexibleJob Description:Key Responsibilities:Develop and implement big data solutions using Spark, Hive, and HBase.Design and deploy scalable data pipelines for efficient data ingestion from disparate sources onto the Big Data...

  • Big Data Engineer

    3 days ago


    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Solutions ArchitectWe are seeking a skilled professional to design and develop large-scale data processing systems using cutting-edge technologies.Key Responsibilities:Design and implement big data architectures using PySpark, Hive, and SparkDevelop and maintain efficient data processing pipelinesCollaborate with cross-functional teams to integrate big...


  • Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead Data ArchitectJob OverviewDevelop and maintain large-scale data architectures that handle structured and unstructured data.Design and implement ETL/ELT processes for data pipelines, ensuring reliability, scalability, and high availability.Collaborate with cross-functional teams to leverage AWS services and power business-critical data workflows.Work...


  • Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Expert WantedWe are seeking a skilled expert in big data to play a critical role in data extraction, integration, and advanced analysis by leveraging traditional programming and emerging technologies.Key Responsibilities:Design and develop complex SQL queries for data extraction, manipulation, and reporting.Builddata pipelines for seamless...


  • Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering SpecialistDesign, build, and maintain large-scale data pipelines using Spark and SQL. This role involves managing big data flows, collaborating with cross-functional teams, and driving business growth through data insights.About the Role:Create scalable data architectures using cloud-based platforms (AWS, Azure, GCP, Databricks).Analyze and...


  • Madurai, Tamil Nadu, India beBeeDataSpecialist Full time US$ 1,00,000 - US$ 1,20,000

    Senior Data SpecialistThe role of a Senior Data Specialist revolves around developing and implementing data-driven solutions to drive business growth. We are seeking an experienced professional to join our team and leverage their skills in data analysis, machine learning, and optimization methodologies.Key Responsibilities:Develop and maintain advanced data...


  • Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 50,00,000 - ₹ 1,00,00,000

    Job Summary">We are seeking an experienced Data Engineer to design and implement data solutions using cutting-edge technologies.The successful candidate will bring expertise in data engineering and work closely with cross-functional teams to deliver high-quality results.Main Responsibilities:Design and implement scalable data pipelines using Palantir Foundry...


  • Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer OpportunityWe are seeking a skilled Big Data Engineer to join our team. The ideal candidate will design, build, and maintain high-performance data pipelines that process large volumes of data.This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance...


  • Madurai, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Role: Financial Data Engineer SpecialistJob Description:Develop and manage data pipelines that handle high-volume financial data, including stocks, cryptocurrencies, and third-party sources.Design and implement end-to-end data workflows for stocks, crypto, and other financial datasets.Integrate third-party APIs and data feeds into internal systems,...