
Chief Data Pipeline Architect
1 day ago
We are seeking an exceptional Azure Data Engineer with 7+ years of experience to design, develop, and optimize data pipelines and integration solutions in a cloud environment.
Key Responsibilities:
- Design and implement advanced ETL pipelines for batch data ingestion and egress.
- Develop scalable data solutions using Azure Data Factory (ADF), Databricks, Spark (PySpark & Scala Spark), and other Azure services.
- Identify and troubleshoot data job issues, implementing effective root cause solutions.
- Collaborate with stakeholders to gather requirements and propose efficient solution designs.
- Ensure data quality, reliability, and adherence to best practices in data engineering.
- Maintain detailed documentation of problem definitions, solutions, and architecture.
- Work independently to ensure project deadlines are met.
Required Skills & Qualifications:
- Proficiency in SQL, Python, and Scala programming languages.
- Strong knowledge of Azure Cloud services, ADF, and Databricks platforms.
- Hands-on experience with Apache Spark (PySpark & Scala Spark).
- Expertise in designing and implementing complex ETL pipelines for batch data.
- Excellent verbal and written communication skills.
- Ability to effectively gather requirements and propose solution designs.
Benefits:
- Opportunity to work on cutting-edge projects.
- Collaborative and dynamic work environment.
- Professional growth and development opportunities.
Others:
- Self-driven individual with the ability to work independently.
- Strong documentation skills for drafting problem definitions and solutions.
-
Chief Data Architect
2 days ago
Erode, Tamil Nadu, India beBeeDataArchitecture Full time ₹ 1,20,00,000 - ₹ 2,00,00,000We are seeking a skilled Chief Data Architect to join our team in Mumbai.Key Responsibilities:Design and implement data pipelines for automated ingestion, transformation, and augmentation of structured and unstructured real-time data.Develop strategies to automate manual processes, optimize data delivery, and redesign infrastructure for greater...
-
Chief Data Pipeline Architect
3 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000About the RoleWe are seeking a Senior Data Engineer to design, build, and operate scalable data pipelines.This is a critical role where you will create scalable pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated information to machine learning systems for inference.Your ResponsibilitiesDesign and...
-
Chief Data Pipeline Architect
7 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000Key Roles and ResponsibilitiesWe are seeking a highly skilled professional to join our data engineering team. As a key member of the team, you will play a vital role in designing and implementing efficient data pipelines using modern DevOps tools.Develop and manage continuous integration and delivery pipelines using GitHub Actions or equivalent...
-
Chief Data Pipeline Architect
3 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000About the RoleThis is a technical professional role that involves designing and building scalable data pipelines using Azure technologies.Key Responsibilities:We are looking for an experienced data engineer to collaborate with our analytics and business teams to improve data models and increase data accessibility.The successful candidate will be responsible...
-
Shopify Executive
3 weeks ago
Erode, Tamil Nadu, India Nap Chief Full timeJoin the Nap Chief Crew If Shopify is your playground and you love blending creativity with e-commerce, this is your chance We're on the hunt for a Shopify Executive who can make our online store as delightful as our kidswear. Location: Andheri East, Mumbai (On-site) Experience: 2–3 YearsAbout Nap ChiefNap Chief is a premium kidswear brand for the coolest...
-
Chief Data Architect
2 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000About this roleEmbark on a data-driven career and work with leading manufacturers to deliver exceptional product experiences through best-in-class Product Information Management (PIM) solutions.As a Data Engineer, you will be responsible for designing and developing scalable pipelines to efficiently process and transform large datasets using Spark, creating...
-
Data Pipeline Specialist
19 hours ago
Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 20,00,000Job Description:Seeking a data engineering professional to build scalable data pipelines and cloud-native data solutions on GCP. Ideal candidate will be proficient in Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a foundational understanding of AI/ML workflows using Vertex AI.Key Responsibilities:Design and develop robust data ingestion pipelines...
-
Chief Insurance Data Architect
2 days ago
Erode, Tamil Nadu, India beBeeData Full time ₹ 40,00,000 - ₹ 60,00,000Strategic Data Architect RoleA leading IT organization seeks a highly experienced data architect to drive data architecture initiatives.Job SummaryThis role involves owning the end-to-end data architecture for a cross-product reporting solution. Key responsibilities include designing lakehouse/warehouse architectures, event-driven data pipelines, and...
-
Principal Data Pipeline Architect
7 days ago
Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 15,00,000Job Title: Data EngineerDescription:We are seeking an experienced Data Engineer to take on the challenge of building and optimizing data pipelines. The successful candidate will ensure that data is clean, secure, and accessible for analytics and operations.Responsibilities:Design and optimize scalable data pipelines and architectures using cutting-edge...
-
Chief Data Architect
17 hours ago
Erode, Tamil Nadu, India beBeeDataArchitecture Full time US$ 1,50,000 - US$ 2,00,000Job OverviewCoffeeBeans Consulting is a tech consulting firm focused on making organizations AI-ready by structuring their data efficiently across various sources and enabling AI-driven solutions. We specialize in data architecture, pipelines, governance, MLOps, and Gen AI solutions, helping clients achieve faster go-to-market and cost efficiency.Key...