
Senior Big Data Specialist
3 days ago
Job Title: Senior Big Data Specialist
We are seeking an experienced professional to design, build, and maintain scalable data pipelines and ETL workflows using Spark and SQL.
Main Responsibilities:
- Develop efficient data processing systems for large datasets.
- Create real-time streaming applications with Spark Streaming/Kafka.
- Collaborate with cross-functional teams to integrate AI/ML models into production.
- Ensure data quality, scalability, and performance in all pipelines.
- Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP).
Required Skills and Qualifications:
- Bachelor's/Master's degree in Computer Science, Engineering, or related field.
- Minimum 4 years of experience as a Data Engineer.
- Strong expertise in Python, Spark, and PySpark.
- Familiarity with data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
- Proficiency in Airflow/Prefect for scheduling and orchestration.
- Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
About the Role:
This position requires strong analytical, problem-solving, and communication skills. The ideal candidate will have hands-on experience with Spark, PySpark, and SQL, as well as knowledge of data ingestion tools and data formats.
-
Big Data Engineer
2 days ago
Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000Job DescriptionOur team is seeking a skilled professional to manage and maintain our big data platform. The ideal candidate will have hands-on experience with Apache Druid in production, as well as strong analytical skills.Key Responsibilities:Develop and implement efficient data models for real-time analytics using Apache Druid.Collaborate with...
-
Senior Big Data Specialist
1 day ago
Dindigul, Tamil Nadu, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000Job Opportunity: Data EngineerWe are seeking an experienced Data Engineer to join our team. As a key member of the organization, you will be responsible for designing, implementing, and maintaining data pipelines using Python and AWS services. This role requires strong technical skills, excellent problem-solving abilities, and effective communication...
-
Principal Big Data Scientist
2 days ago
Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000Data Engineer RoleWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Job DescriptionThe ideal candidate will have a strong background in computer science or a related field, with at least 3-6 years of experience...
-
Data Infrastructure Specialist
2 days ago
Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Senior Data Engineering LeadAt our organization, we are seeking an experienced Senior Data Engineering Lead to oversee the design, development, and maintenance of our data infrastructure. This is a challenging role that requires technical expertise in data modeling, databases, cloud platforms, and integration frameworks.Key Responsibilities:Develop and...
-
Senior Big Data Specialist
1 day ago
Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000Job Opportunity As a Data Engineer, you will play a pivotal role in designing, developing, and maintaining our data infrastructure. The ideal candidate will possess a strong background in PySpark, with hands-on experience in building scalable data pipelines using this technology. They should also be proficient in utilizing Spark SQL, DataFrame,...
-
Data Automation Specialist
2 days ago
Dindigul, Tamil Nadu, India beBeeData Full time ₹ 6,00,000 - ₹ 12,00,000Senior Data Automation SpecialistWe are seeking a skilled data automation specialist to join our team. The ideal candidate will have experience in executing PDF automation scripts, ensuring seamless data transfer, and creating deduplication scripts.Key Responsibilities:
-
Big Data Messaging Architect
1 day ago
Dindigul, Tamil Nadu, India beBeeMessaging Full time ₹ 10,00,000 - ₹ 15,00,000Job Title: Big Data Messaging ArchitectWe are seeking a highly skilled Kafka Administrator to join our team.Responsibilities:Design, deploy, and manage large-scale Kafka clusters for high availability and fault tolerance.Automate the installation and configuration of Kafka clusters using tools such as Ansible, Chef, or Terraform.Troubleshoot critical...
-
Senior Data Engineering Specialist
3 days ago
Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,50,00,000Job Overview:We are seeking a seasoned professional to join our team as a Senior Data Engineer. This role requires hands-on coding expertise in Python and PySpark, along with strong skills in Telemetry, Big Data, and backend engineering.Key Responsibilities:Design, develop, and deploy large-scale data processing systems using Python and PySparkCollaborate...
-
Senior Data Infrastructure Specialist
13 hours ago
Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data EngineerWe are seeking a detail-oriented professional to lead the development of scalable data pipelines and infrastructure.This role involves collaborating with cross-functional teams to deliver reliable, high-quality data systems that power analytics and insights.The ideal candidate will have experience with big data technologies and enjoy...
-
Senior Data Integration Specialist
2 days ago
Dindigul, Tamil Nadu, India beBeeInformatica Full time ₹ 20,00,000 - ₹ 25,00,000Expert ETL Developer WantedWe are seeking a seasoned developer to design and develop scalable data integration solutions using Informatica BDM/DEI. The ideal candidate will have a strong background in this technology and experience working with telecom clients.The successful applicant will be responsible for integrating data from structured and unstructured...