Senior Big Data Specialist

2 weeks ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

Job Title: Senior Big Data Specialist

We are looking for a highly skilled individual to lead the development and maintenance of our data processing systems. The ideal candidate will have extensive experience in designing, building, and optimizing large-scale data architectures using Apache Spark and related technologies.

Main Responsibilities:

  • Design and implement data pipelines that integrate with cloud-based data platforms such as AWS and Azure.
  • Work closely with cross-functional teams to understand business requirements and develop scalable data solutions.
  • Collaborate with data scientists to integrate machine learning models into production-ready data pipelines.
  • Maintain high-quality code using Python, SQL, and other relevant programming languages.
  • Evaluate and improve data security, integrity, and compliance with industry standards and regulations.

Requirements:

  • 6-9 years of experience in data engineering with a focus on distributed systems and big data technologies.
  • Strong hands-on experience with Apache Spark (RDDs, DataFrames, Spark SQL, PySpark).
  • Proficiency in cloud ecosystem: Glue, S3, Lambda, Redshift, CloudWatch.
  • Solid expertise in Snowflake: Snowpipe, Streams & Tasks, Time Travel, and data sharing.
  • Strong programming skills in Python and SQL.
  • Experience with CI/CD tools and infrastructure-as-code (Terraform or CloudFormation).

Benefits:

This is an excellent opportunity for experienced professionals to take on new challenges and grow within a dynamic organization.

The successful candidate will be rewarded with competitive compensation and benefits package, including opportunities for career growth and professional development.

  • Big Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Big Data SpecialistExperience:2+ years of experience in big data development.The ideal candidate will have expertise in:Big Data DevelopmentAdvanced AnalyticsCloud ComputingProgramming Skills (Python, Java)As a big data specialist, you will be responsible for designing and developing large-scale data processing systems. Your focus will be on...

  • Big Data Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 18,00,000 - ₹ 28,00,000

    Senior Big Data SpecialistWe are seeking a highly skilled Senior Big Data Specialist to join our organization in Bengaluru, India. The successful candidate will be responsible for designing and implementing large-scale data systems using Apache Spark, Python, and Azure Databricks.The ideal candidate will have 5-12 years of experience in Big Data & Data...

  • Senior Cloud Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeCloud Full time ₹ 9,00,000 - ₹ 12,00,000

    **Job Title:** Senior Cloud Engineer - Big Data Specialist**Job Description:** We are seeking an experienced Senior Cloud Engineer to join our team. As a cloud expert, you will be responsible for designing and implementing scalable big data solutions using Google Cloud Platform (GCP).We need a candidate with extensive production experience in GCP and a...

  • Big Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data SpecialistWe are seeking a highly skilled professional to develop and maintain large-scale data systems.Key Responsibilities:Design, implement, and deploy data processing pipelines.Develop and maintain ETL processes for big data technologies.Collaborate with cross-functional teams to ensure data quality and integrity.Ensure data security and...

  • Big Data Operations Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeCloud Full time US$ 90,000 - US$ 1,20,000

    Job Title: Big Data Operations SpecialistKey Responsibilities:Design and implement large-scale data pipelines to process and analyze big data.Collaborate with cross-functional teams to develop and maintain data infrastructure, ensuring high availability and performance.Required Skills and Qualifications:Good experience in working with NoSQL systems, such as...

  • Big Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title: Big Data SpecialistOur organization seeks an experienced and skilled data engineer to develop, implement, and maintain scalable big data solutions utilizing cutting-edge technologies.Key Responsibilities:Design, create, and optimize data pipelines using cloud-based platforms and distributed computing systems.Collect, transform, and load large...

  • Big Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 2,02,50,000

    Job Opportunity: Big Data SpecialistAbout the Role:The ideal candidate will have experience working with large-scale data systems, designing and implementing efficient data pipelines, and ensuring seamless integration of data sources.Responsibilities:Design, develop, and maintain scalable big data processing systems using Python and PySparkCollaborate with...

  • Senior Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 12,50,000 - ₹ 25,00,000

    Senior Big Data DeveloperWe are looking for a seasoned Senior Big Data Developer who can lead our team in designing and implementing scalable big data solutions using Spark, Kafka, and Java.The ideal candidate should possess a minimum of 6 years of hands-on experience with these technologies, along with a track record of delivering successful projects.Key...

  • Cloud Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeBigdataengineer Full time US$ 90,000 - US$ 1,20,000

    Cloud Big Data Engineering SpecialistWe are seeking a Cloud Big Data Engineering Specialist to join our team.

  • Big Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,40,000 - US$ 1,60,000

    Senior Data EngineerA highly skilled Data Engineer is required to build and maintain large-scale data pipelines using Google Cloud Platform (GCP). The ideal candidate will have extensive experience in designing, developing, and deploying complex data systems.The successful candidate will be responsible for:Designing and implementing efficient data pipelines...