Senior Big Data Specialist

3 days ago


Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

Job Title: Senior Big Data Specialist

We are seeking an experienced professional to design, build, and maintain scalable data pipelines and ETL workflows using Spark and SQL.

Main Responsibilities:

  • Develop efficient data processing systems for large datasets.
  • Create real-time streaming applications with Spark Streaming/Kafka.
  • Collaborate with cross-functional teams to integrate AI/ML models into production.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP).

Required Skills and Qualifications:

  • Bachelor's/Master's degree in Computer Science, Engineering, or related field.
  • Minimum 4 years of experience as a Data Engineer.
  • Strong expertise in Python, Spark, and PySpark.
  • Familiarity with data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.

About the Role:

This position requires strong analytical, problem-solving, and communication skills. The ideal candidate will have hands-on experience with Spark, PySpark, and SQL, as well as knowledge of data ingestion tools and data formats.


  • Big Data Engineer

    2 days ago


    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionOur team is seeking a skilled professional to manage and maintain our big data platform. The ideal candidate will have hands-on experience with Apache Druid in production, as well as strong analytical skills.Key Responsibilities:Develop and implement efficient data models for real-time analytics using Apache Druid.Collaborate with...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Job Opportunity: Data EngineerWe are seeking an experienced Data Engineer to join our team. As a key member of the organization, you will be responsible for designing, implementing, and maintaining data pipelines using Python and AWS services. This role requires strong technical skills, excellent problem-solving abilities, and effective communication...


  • Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Engineer RoleWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Job DescriptionThe ideal candidate will have a strong background in computer science or a related field, with at least 3-6 years of experience...


  • Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Engineering LeadAt our organization, we are seeking an experienced Senior Data Engineering Lead to oversee the design, development, and maintenance of our data infrastructure. This is a challenging role that requires technical expertise in data modeling, databases, cloud platforms, and integration frameworks.Key Responsibilities:Develop and...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Opportunity    As a Data Engineer, you will play a pivotal role in designing, developing, and maintaining our data infrastructure.    The ideal candidate will possess a strong background in PySpark, with hands-on experience in building scalable data pipelines using this technology. They should also be proficient in utilizing Spark SQL, DataFrame,...


  • Dindigul, Tamil Nadu, India beBeeData Full time ₹ 6,00,000 - ₹ 12,00,000

    Senior Data Automation SpecialistWe are seeking a skilled data automation specialist to join our team. The ideal candidate will have experience in executing PDF automation scripts, ensuring seamless data transfer, and creating deduplication scripts.Key Responsibilities:


  • Dindigul, Tamil Nadu, India beBeeMessaging Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Big Data Messaging ArchitectWe are seeking a highly skilled Kafka Administrator to join our team.Responsibilities:Design, deploy, and manage large-scale Kafka clusters for high availability and fault tolerance.Automate the installation and configuration of Kafka clusters using tools such as Ansible, Chef, or Terraform.Troubleshoot critical...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Overview:We are seeking a seasoned professional to join our team as a Senior Data Engineer. This role requires hands-on coding expertise in Python and PySpark, along with strong skills in Telemetry, Big Data, and backend engineering.Key Responsibilities:Design, develop, and deploy large-scale data processing systems using Python and PySparkCollaborate...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are seeking a detail-oriented professional to lead the development of scalable data pipelines and infrastructure.This role involves collaborating with cross-functional teams to deliver reliable, high-quality data systems that power analytics and insights.The ideal candidate will have experience with big data technologies and enjoy...


  • Dindigul, Tamil Nadu, India beBeeInformatica Full time ₹ 20,00,000 - ₹ 25,00,000

    Expert ETL Developer WantedWe are seeking a seasoned developer to design and develop scalable data integration solutions using Informatica BDM/DEI. The ideal candidate will have a strong background in this technology and experience working with telecom clients.The successful applicant will be responsible for integrating data from structured and unstructured...