Big Data Specialist

11 hours ago

Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Opportunity

The Data & Analytics team collaborates with various stakeholders to resolve intricate business challenges that impact the company's progress.

We utilize cutting-edge technologies from the Cloud & Big Data ecosystem to enhance business outcomes and create prototypes, proof-of-concept projects, and application development.

We seek an experienced Data Platform Engineer with in-depth knowledge of data engineering, cloud infrastructure, and a strong background in DevOps, SRE, or system engineering.

Your Responsibilities
  • Create and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse or data lake environment.
  • Automate, manage, and scale the underlying infrastructure for our data platforms (e.g., Airflow, Spark clusters), applying SRE and DevOps best practices for performance, reliability, and observability.
  • Collaborate with stakeholders to gather requirements and translate business needs into robust technical and platform solutions.
  • Optimize and tune existing data pipelines and infrastructure for performance, cost, and scalability.
  • Implement and enforce data quality and governance processes to ensure data accuracy, consistency, and compliance with regulatory standards.
  • Work closely with the BI team to design and develop dashboards, reports, and analytical tools that provide actionable insights to stakeholders.
Required Skills and Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in data engineering, platform engineering, or a similar role, with a strong focus on building and maintaining data pipelines and the underlying infrastructure.
  • Proven experience in a DevOps, SRE, or System Engineering role, with hands-on expertise in infrastructure as code (e.g., Terraform, Ansible), CI/CD pipelines, and monitoring/observability tools.
  • Expertise in SQL programming and database management systems (e.g., BigQuery).
  • Hands-on experience with ETL tools and technologies (e.g., Apache Spark, Apache Airflow).
  • Experience with cloud platforms such as Google Cloud Platform (GCP), and experience with relevant services (e.g., GCP Dataflow, GCP DataProc, BigQuery, Cloud Composer, GKE).
  • Experience with Big Data tools like Spark, Kafka, etc.
About Our Organization

We're a high-tech cybersecurity company within Information Technology. We're connected by one mission but driven by the impact of that mission and what it means to protect our way of life in the digital age.

We're problem solvers that take risks and challenge cybersecurity's status quo. It's simple: we can't accomplish our mission without diverse teams innovating, together.

  • Big Data Specialist

    6 days ago

    Tiruchi, Tamil Nadu, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a seasoned Data Insights Analyst to join our team. The ideal candidate will possess exceptional analytical skills, with the ability to distill complex data into actionable insights.Job Description:The role involves working with large datasets to gain a deep understanding of business trends and patterns. This includes analyzing complex data...

  • Senior Big Data Developer

    6 days ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,20,00,000

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.The ideal candidate will have hands-on experience in building, scaling, and optimizing big data pipelines, distributed data systems, and cloud-based solutions. The engineer should be able to...

  • Big Data Innovation Specialist

    13 hours ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Big Data DeveloperDescriptionWe are seeking a highly skilled big data developer to drive innovation and growth. The ideal candidate will possess hands-on experience in Spark, Scala, and Pyspark, as well as a solid understanding of databases and proficiency in writing complex queries.Key Responsibilities:Developing and implementing data-driven...

  • Advanced Big Data Architect

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,30,000 - ₹ 20,15,000

    Big Data EngineerWe are seeking a skilled Big Data Engineer to design, build and maintain robust data pipelines for processing channel activity data from multiple sources. As a key member of our team, you will work on AWS cloud infrastructure leveraging Python for building automated data engineering solutions and data transformations.Key...

  • Expert in Big Data Solutions

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Solutions ExpertWe are looking for a seasoned professional to design, build and maintain large-scale data pipelines.The ideal candidate should have experience with GCP, Bigquery, SQL and Python dataflow skills.Responsibilities:Design and implement data solutions using GCP services.Develop and implement data transformations using Python and...

  • Big Data Cloud Architecture Specialist

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a skilled Big Data and Cloud Architect to join our team at Societe Generale Global Solution Centre in Bengaluru.

  • Data Architect Specialist

    5 days ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Architect SpecialistWe are seeking a highly skilled Data Architect Specialist to design, develop, and maintain scalable data pipelines and infrastructure that support real-time and batch data processing.You will collaborate with cross-functional teams to deliver reliable, high-quality data systems that power analytics, insights, and data-driven...

  • Data Engineering Specialist

    4 days ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job SummaryWe are seeking a skilled Data Engineering Specialist to join our product engineering team. As a key member, you will play a crucial role in designing, developing, and maintaining large-scale data pipelines.Design and Development: Collaborate with cross-functional teams to design, develop, and maintain efficient data pipelines for ingestion,...

  • Data Engineering Specialist

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Job Title: Data Engineering SpecialistWe are seeking a skilled Data Engineering Specialist to join our team. As a key member of our digital solutions group, you will play a critical role in designing and building robust data pipelines for processing channel activity data from multiple sources.The ideal candidate will possess strong knowledge of cloud...

  • Cloud Data Specialist

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We're seeking a skilled cloud data specialist to design, build and maintain scalable data pipelines and ETL solutions in the cloud.Key Responsibilities:Design and implement scalable data pipelines using PySpark and Python.Collaborate with data analysts, data scientists, and engineering teams to support data-driven initiatives.Work closely with...