Senior Data Pipeline Architect

1 week ago


Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Overview

We are seeking an experienced Data Engineer to join our team. As a key member of our organization, you will play a critical role in designing and implementing data pipeline architectures that meet the needs of our business.

Responsibilities:

  • Create and maintain optimal data pipeline architectures using big data technologies such as Spark and HDFS/S3.
  • Build and optimize 'big data' data pipelines, architectures and data sets.
  • Work with cross-functional teams to identify and implement internal process improvements.

Requirements:

  • 2+ years of experience in a Data Engineer role.
  • Proficiency in either Scala or Python, expertise in Spark, and experience with performance tuning and optimization.
  • Experience with big data tools: HDFS/S3, Spark/Flink, Hive, Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS/GCP cloud services.
  • Strong analytic skills related to working with structured/unstructured datasets.

Benefits:

  • A dynamic work environment with opportunities for growth and development.
  • A competitive salary and benefits package.
  • The chance to work on exciting projects and make a meaningful impact.

About Us

We are a leading organization in the field of big data engineering. Our team is passionate about delivering innovative solutions that meet the needs of our clients.



  • Gandhinagar, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Senior Data ArchitectDescription:We are seeking a highly skilled data architect with experience in designing, developing, and managing enterprise data solutions.Design end-to-end data solutions, aligning with business requirements.Implement data lakes, data warehouses, and data marts using cloud services like BigQuery, Cloud Storage, Dataflow,...


  • Gandhinagar, Gujarat, India beBeeData Full time ₹ 25,00,000 - ₹ 40,00,000

    Key to our success lies in leveraging the power of data. We are seeking a highly skilled and experienced Senior AWS Data Engineer to join our data engineering team.The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS...


  • Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Senior Data Solutions ArchitectWe are seeking a highly skilled Senior Data Solutions Architect with expertise in modern data platforms, big data processing, and SQL.The ideal candidate will have hands-on experience with unified data platforms such as Databricks and Snowflake, as well as exposure to Azure Fabric.This role will support the design,...


  • Gandhinagar, Gujarat, India beBeeAdministration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewAs a Kafka expert, you will be responsible for designing and implementing scalable data pipelines to optimize message processing efficiency.You will work on automating the installation and configuration of production-grade Kafka clusters using tools such as Ansible and Chef, and troubleshoot critical issues to ensure high availability and fault...


  • Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About This Role:We are seeking a highly skilled Senior Data Architect to lead our analytics team and drive strategic insights from data.This is a key leadership role that involves building scalable data pipelines, leading analytics strategy, and mentoring a team of analysts. As a seasoned data professional, you will play a critical part in driving business...


  • Gandhinagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerCraft robust data pipelines to inform business decisions, utilizing skills in ETL tools, SQL, data modeling, and cloud platforms. Work collaboratively with architects, analysts, and stakeholders to deliver impactful solutions.Develop and refine intricate ETL pipelines for processing high data volumes.Evaluate data precision, coherence,...


  • Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled Data Engineer with extensive experience in CI/CD practices, Databricks (Spark), Python, GitHub, and SQL. The ideal candidate should possess hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Design,...


  • Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Mid-Level Data EngineerAs a data engineer, you will design and build efficient data pipelines to move data from multiple sources into data stores or warehouses. This role is ideal for someone who has worked on end-to-end data engineering projects and wants to grow with a company that values ownership, innovation, and resourcefulness.">Design and build data...


  • Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,10,000

    Job Summary:We're seeking a highly skilled Senior Data Engineer to spearhead the development of our data infrastructure.Main Responsibilities:Data Pipeline Design:Design and optimize data pipelines using ETL/ELT workflows, cloud-based platforms, and big data ecosystems.Data Platform Architecture:Architect scalable data platforms using AWS services such as...


  • Gandhinagar, Gujarat, India beBeePipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a skilled Senior Data Pipeline Assurance Specialist to ensure the high-quality of our data pipelines. In this role, you will be responsible for developing and executing test cases to validate data integrity and accuracy.Key Responsibilities:Develop and execute test cases to validate data integrity and accuracyCollaborate with...