Senior Data Pipeline Architect

1 week ago

Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Overview

We are seeking an experienced Data Engineer to join our team. As a key member of our organization, you will play a critical role in designing and implementing data pipeline architectures that meet the needs of our business.

Responsibilities:

  • Create and maintain optimal data pipeline architectures using big data technologies such as Spark and HDFS/S3.
  • Build and optimize 'big data' data pipelines, architectures and data sets.
  • Work with cross-functional teams to identify and implement internal process improvements.

Requirements:

  • 2+ years of experience in a Data Engineer role.
  • Proficiency in either Scala or Python, expertise in Spark, and experience with performance tuning and optimization.
  • Experience with big data tools: HDFS/S3, Spark/Flink, Hive, Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS/GCP cloud services.
  • Strong analytic skills related to working with structured/unstructured datasets.

Benefits:

  • A dynamic work environment with opportunities for growth and development.
  • A competitive salary and benefits package.
  • The chance to work on exciting projects and make a meaningful impact.

About Us

We are a leading organization in the field of big data engineering. Our team is passionate about delivering innovative solutions that meet the needs of our clients.

  • Senior Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Senior Data ArchitectDescription:We are seeking a highly skilled data architect with experience in designing, developing, and managing enterprise data solutions.Design end-to-end data solutions, aligning with business requirements.Implement data lakes, data warehouses, and data marts using cloud services like BigQuery, Cloud Storage, Dataflow,...

  • AWS Data Pipeline Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 25,00,000 - ₹ 40,00,000

    Key to our success lies in leveraging the power of data. We are seeking a highly skilled and experienced Senior AWS Data Engineer to join our data engineering team.The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS...

  • Senior Data Solutions Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Senior Data Solutions ArchitectWe are seeking a highly skilled Senior Data Solutions Architect with expertise in modern data platforms, big data processing, and SQL.The ideal candidate will have hands-on experience with unified data platforms such as Databricks and Snowflake, as well as exposure to Azure Fabric.This role will support the design,...

  • Senior Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About This Role:We are seeking a highly skilled Senior Data Architect to lead our analytics team and drive strategic insights from data.This is a key leadership role that involves building scalable data pipelines, leading analytics strategy, and mentoring a team of analysts. As a seasoned data professional, you will play a critical part in driving business...

  • Transformative Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerCraft robust data pipelines to inform business decisions, utilizing skills in ETL tools, SQL, data modeling, and cloud platforms. Work collaboratively with architects, analysts, and stakeholders to deliver impactful solutions.Develop and refine intricate ETL pipelines for processing high data volumes.Evaluate data precision, coherence,...

  • Chief Data Pipeline Architect

    5 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled Data Engineer with extensive experience in CI/CD practices, Databricks (Spark), Python, GitHub, and SQL. The ideal candidate should possess hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Design,...

  • Expert Data Pipeline Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Mid-Level Data EngineerAs a data engineer, you will design and build efficient data pipelines to move data from multiple sources into data stores or warehouses. This role is ideal for someone who has worked on end-to-end data engineering projects and wants to grow with a company that values ownership, innovation, and resourcefulness.">Design and build data...

  • Chief Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,10,000

    Job Summary:We're seeking a highly skilled Senior Data Engineer to spearhead the development of our data infrastructure.Main Responsibilities:Data Pipeline Design:Design and optimize data pipelines using ETL/ELT workflows, cloud-based platforms, and big data ecosystems.Data Platform Architecture:Architect scalable data platforms using AWS services such as...

  • Senior Data Pipeline Assurance Specialist

    1 week ago

    Gandhinagar, Gujarat, India beBeePipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a skilled Senior Data Pipeline Assurance Specialist to ensure the high-quality of our data pipelines. In this role, you will be responsible for developing and executing test cases to validate data integrity and accuracy.Key Responsibilities:Develop and execute test cases to validate data integrity and accuracyCollaborate with...

  • Senior Data Solutions Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Senior Data Solutions ArchitectWe are looking for a highly skilled and experienced data solutions architect to join our team. As a key member of our organization, you will be responsible for designing and implementing scalable and reliable data systems that meet the evolving needs of our business.As a senior data solutions architect, you will...