Big Data Specialist

2 days ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,40,000 - US$ 1,60,000
Senior Data Engineer

A highly skilled Data Engineer is required to build and maintain large-scale data pipelines using Google Cloud Platform (GCP). The ideal candidate will have extensive experience in designing, developing, and deploying complex data systems.

The successful candidate will be responsible for:

  • Designing and implementing efficient data pipelines using GCP services such as BigQuery, Cloud Storage, and Dataflow.
  • Developing and maintaining large datasets based on business requirements.
  • Constructing 'big data' pipeline architecture using various tools and technologies.
  • Collaborating with stakeholders to identify opportunities for data acquisition and translating business needs into technical requirements.
  • Utilizing a variety of tools in the Google Cloud Ecosystem such as Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage to integrate systems and data pipelines.
  • Ensuring the reliability and scalability of data pipelines using DevOps and CI/CD practices.
  • Partitioning, clustering, and retrieving content in Big Query while securing data using IAM roles & Policy Tags.

The ideal candidate will have:

  • 5-7 years of experience in a data engineering role with core GCP experience of 3-4 years.
  • Experience with batch and real-time processing using GCP services.
  • Strong understanding of data warehousing and big data concepts.
  • Excellent communication and collaboration skills.

The work environment will involve working in CST time zone until 2 am IST most days. There may be occasional requests to extend work hours by 1-2 hours on certain days of the month.

  • Big Data Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Big Data SpecialistExperience:2+ years of experience in big data development.The ideal candidate will have expertise in:Big Data DevelopmentAdvanced AnalyticsCloud ComputingProgramming Skills (Python, Java)As a big data specialist, you will be responsible for designing and developing large-scale data processing systems. Your focus will be on...

  • Big Data Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Big Data SpecialistGreetings from our team!We are seeking an experienced Big Data Specialist to join our team. As a key member, you will play a critical role in driving business growth through data-driven insights.This is an exceptional opportunity for a motivated and talented individual who thrives in a fast-paced environment. Our ideal candidate will have...

  • Big Data Infrastructure Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeInfrastructure Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title:Big Data Infrastructure SpecialistJob Overview:We are seeking a skilled Big Data Infrastructure Specialist to design and implement scalable data infrastructure solutions.Key Responsibilities:Deploy and manage Hadoop clusters on Apache and CDHConfigure and secure Hadoop environments using Yarn and HiveDesign and implement data pipelines using Spark,...

  • Big Data Specialist

    2 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 2,02,50,000

    Job Opportunity: Big Data SpecialistAbout the Role:The ideal candidate will have experience working with large-scale data systems, designing and implementing efficient data pipelines, and ensuring seamless integration of data sources.Responsibilities:Design, develop, and maintain scalable big data processing systems using Python and PySparkCollaborate with...

  • Big Data Engineer Position

    2 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data SpecialistWe are seeking a highly skilled big data specialist to design, develop, and maintain large-scale data systems. This individual will be responsible for architecting and implementing data pipelines using various distributed data processing frameworks.",

  • Big Data Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionJob Summary:We are seeking a skilled Big Data Specialist to join our team of experts. The ideal candidate will be responsible for designing, developing, and maintaining scalable data platforms and architectures to support our analytics and business intelligence needs.About Us:We believe in harnessing the power of technology to drive...

  • Big Basket

    4 days ago

    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Basket

    4 days ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Big Data Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Big Data SpecialistAbout the Role:We are seeking a skilled data professional to design and develop high-quality applications using Google BigQuery.Main Responsibilities:Independently perform tasks and become an SME in your area of expertise.Participate actively in team discussions and contribute solutions to work-related problems.Collaborate...

  • Big Data Technical Support Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeTechnical Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Support SpecialistJob Description:We are seeking a highly skilled Support Specialist to join our team. The successful candidate will have experience in big data environments and be proficient in Apache Spark, Druid, and Trino.Key Responsibilities:Monitor Spark jobs and supervise data ingestion pipelines in Druid.Provide Level 1 production support...