Chief Data Pipeline Architect

1 day ago


Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title: Senior Data Engineer

We are seeking an exceptional Azure Data Engineer with 7+ years of experience to design, develop, and optimize data pipelines and integration solutions in a cloud environment.

Key Responsibilities:

  • Design and implement advanced ETL pipelines for batch data ingestion and egress.
  • Develop scalable data solutions using Azure Data Factory (ADF), Databricks, Spark (PySpark & Scala Spark), and other Azure services.
  • Identify and troubleshoot data job issues, implementing effective root cause solutions.
  • Collaborate with stakeholders to gather requirements and propose efficient solution designs.
  • Ensure data quality, reliability, and adherence to best practices in data engineering.
  • Maintain detailed documentation of problem definitions, solutions, and architecture.
  • Work independently to ensure project deadlines are met.

Required Skills & Qualifications:

  • Proficiency in SQL, Python, and Scala programming languages.
  • Strong knowledge of Azure Cloud services, ADF, and Databricks platforms.
  • Hands-on experience with Apache Spark (PySpark & Scala Spark).
  • Expertise in designing and implementing complex ETL pipelines for batch data.
  • Excellent verbal and written communication skills.
  • Ability to effectively gather requirements and propose solution designs.

Benefits:

  • Opportunity to work on cutting-edge projects.
  • Collaborative and dynamic work environment.
  • Professional growth and development opportunities.

Others:

  • Self-driven individual with the ability to work independently.
  • Strong documentation skills for drafting problem definitions and solutions.


  • Erode, Tamil Nadu, India beBeeDataArchitecture Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    We are seeking a skilled Chief Data Architect to join our team in Mumbai.Key Responsibilities:Design and implement data pipelines for automated ingestion, transformation, and augmentation of structured and unstructured real-time data.Develop strategies to automate manual processes, optimize data delivery, and redesign infrastructure for greater...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a Senior Data Engineer to design, build, and operate scalable data pipelines.This is a critical role where you will create scalable pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated information to machine learning systems for inference.Your ResponsibilitiesDesign and...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Key Roles and ResponsibilitiesWe are seeking a highly skilled professional to join our data engineering team. As a key member of the team, you will play a vital role in designing and implementing efficient data pipelines using modern DevOps tools.Develop and manage continuous integration and delivery pipelines using GitHub Actions or equivalent...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    About the RoleThis is a technical professional role that involves designing and building scalable data pipelines using Azure technologies.Key Responsibilities:We are looking for an experienced data engineer to collaborate with our analytics and business teams to improve data models and increase data accessibility.The successful candidate will be responsible...

  • Shopify Executive

    3 weeks ago


    Erode, Tamil Nadu, India Nap Chief Full time

    Join the Nap Chief Crew If Shopify is your playground and you love blending creativity with e-commerce, this is your chance We're on the hunt for a Shopify Executive who can make our online store as delightful as our kidswear. Location: Andheri East, Mumbai (On-site) Experience: 2–3 YearsAbout Nap ChiefNap Chief is a premium kidswear brand for the coolest...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    About this roleEmbark on a data-driven career and work with leading manufacturers to deliver exceptional product experiences through best-in-class Product Information Management (PIM) solutions.As a Data Engineer, you will be responsible for designing and developing scalable pipelines to efficiently process and transform large datasets using Spark, creating...


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Description:Seeking a data engineering professional to build scalable data pipelines and cloud-native data solutions on GCP. Ideal candidate will be proficient in Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a foundational understanding of AI/ML workflows using Vertex AI.Key Responsibilities:Design and develop robust data ingestion pipelines...


  • Erode, Tamil Nadu, India beBeeData Full time ₹ 40,00,000 - ₹ 60,00,000

    Strategic Data Architect RoleA leading IT organization seeks a highly experienced data architect to drive data architecture initiatives.Job SummaryThis role involves owning the end-to-end data architecture for a cross-product reporting solution. Key responsibilities include designing lakehouse/warehouse architectures, event-driven data pipelines, and...


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data EngineerDescription:We are seeking an experienced Data Engineer to take on the challenge of building and optimizing data pipelines. The successful candidate will ensure that data is clean, secure, and accessible for analytics and operations.Responsibilities:Design and optimize scalable data pipelines and architectures using cutting-edge...

  • Chief Data Architect

    17 hours ago


    Erode, Tamil Nadu, India beBeeDataArchitecture Full time US$ 1,50,000 - US$ 2,00,000

    Job OverviewCoffeeBeans Consulting is a tech consulting firm focused on making organizations AI-ready by structuring their data efficiently across various sources and enabling AI-driven solutions. We specialize in data architecture, pipelines, governance, MLOps, and Gen AI solutions, helping clients achieve faster go-to-market and cost efficiency.Key...