Data Pipeline Architect

4 days ago


Vadodara, Gujarat, India beBeePipeline Full time ₹ 8,00,000 - ₹ 13,00,000

Job Title: Data Pipeline Architect

Are you an experienced data professional looking to take your career to the next level? We are seeking a skilled Data Pipeline Architect to join our team.

Key Responsibilities:
  • Design, develop, and optimize complex data pipelines for integrating multiple sources into Databricks.
  • Implement and maintain continuous integration/continuous deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
  • Proven experience in data pipeline development and optimization.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.
Benefits:

We offer competitive salaries, comprehensive benefits packages, and opportunities for growth and professional development. Our team is passionate about innovation and delivering exceptional results. If you're a motivated individual who is eager to make a difference, we encourage you to apply.



  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Key Engineering RoleA highly skilled data engineer is sought to design and build large-scale data pipelines using Google Cloud Platform.Develop, construct, test, and maintain data acquisition pipelines for structured and unstructured data using tools like Python, Data Flow, DataStream, CDC, and BigQuery.Build complex datasets based on business requirements...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior ETL Developer Job DescriptionWe are seeking an experienced professional to fill the role of Senior ETL Developer. The successful candidate will have a strong background in data engineering and 6+ years of experience in development and maintenance.Key Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into...


  • Vadodara, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerThe Role:We are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures.You will work closely with cross-functional teams to provide thought leadership and deliver robust, secure, and high-performance data solutions that...


  • Vadodara, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    About this RoleWe're seeking a seasoned ETL Test Engineer to lead the development of complex data pipelines. This is an exceptional opportunity to collaborate with cutting-edge technologies and contribute to the growth of our team.


  • Vadodara, Gujarat, India beBeeDataScientist Full time ₹ 18,00,000 - ₹ 25,00,000

    ETL Data ArchitectWe are seeking a seasoned ETL Developer to lead the design and implementation of scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake.Design, develop, and maintain efficient data flows leveraging best practices for schema design, partitioning, and transformation logic.Collaborate with cross-functional teams to ensure timely...


  • Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data ArchitectWe are seeking a talented data architect with expertise in crafting robust data pipelines to drive business growth.The ideal candidate will excel in designing and implementing intricate data solutions, ensuring data precision and coherence, and collaborating with technical teams to drive strategic initiatives.The role involves...


  • Vadodara, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineering ExpertJob Description:We are seeking a seasoned Big Data Engineer to join our team. This is a challenging opportunity for an experienced professional to leverage their technical expertise in designing and implementing scalable data engineering solutions.The ideal candidate will bring strong hands-on experience in architecting, building,...

  • Cloud Data Architect

    2 weeks ago


    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    We are seeking a skilled data engineer to design, build, and maintain scalable data pipelines and ETL solutions in cloud environments.Key Responsibilities:Design and develop efficient data pipelines using cloud-based services such as AWS.Maintain and optimize existing data infrastructure to ensure seamless performance.Collaborate with cross-functional teams...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 1,80,00,000

    Data Engineer RoleCodeVyasa is seeking a seasoned Data Engineer to join our team of rockstar developers. This role requires a minimum of 4+ years of experience in designing, developing, and maintaining data pipelines and ETL processes using AWS services.The ideal candidate will have hands-on experience with AWS cloud services (S3, Lambda, EC2, RDS, Glue,...


  • Vadodara, Gujarat, India beBeeInfrastructure Full time ₹ 1,80,00,000 - ₹ 2,02,00,000

    As a seasoned professional, you will design and implement cutting-edge data infrastructure to drive business outcomes in complex environments.The RoleWe are seeking an experienced Data Engineer to join our team. You will be responsible for building scalable data pipelines, creating high-performance database structures, and developing business intelligence...