Current jobs related to Lead Data Pipeline Architect - Jodhpur, Rajasthan - beBeeLeader
-
High-Performance Data Pipeline Architect
1 week ago
Jodhpur, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Job Overview:We are seeking a highly skilled Senior Data Engineer to lead the design and implementation of scalable, high-performance data pipelines using Snowflake and dbt.The ideal candidate will have 5-8 years of experience in data engineering roles, with 3+ years of hands-on experience working with Snowflake and dbt in production environments.Ambitious...
-
Data Architect
1 week ago
Jodhpur, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Expert Data ArchitectWe are seeking a highly skilled data architect to lead our company's data strategy. The ideal candidate will have expertise in crafting robust data pipelines and steering business growth through insightful data-driven decisions.Required Skills and Qualifications:Strong background in data architecture and engineeringProficiency in...
-
Chief Data Pipeline Architect
2 weeks ago
Jodhpur, Rajasthan, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000About UsWe are a global leader in providing premium data services for the ever-evolving AI ecosystem. Our team empowers businesses to scale and redefine possibilities with integrated customer experience and cutting-edge digital solutions.From machine learning to computer vision and Generative AI (GenAI), we provide high-quality data and human intelligence to...
-
Data Engine Architect
1 week ago
Jodhpur, Rajasthan, India beBeeSolution Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Search Solutions ArchitectWe are seeking an experienced Search Solutions Architect to lead the development of our data engine from the ground up. As a key member of our team, you will be responsible for designing and implementing advanced search features using OpenSearch/Elasticsearch.Key Responsibilities:Design and implement search solutions: Architect and...
-
Chief Data Pipeline Architect
7 days ago
Jodhpur, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Job TitleA highly skilled Data Engineer is needed to develop and maintain large-scale data pipelines using Google Cloud tools.
-
Data Architect
2 weeks ago
Jodhpur, Rajasthan, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Data Architect SpecialistWe are seeking an experienced Data Architect to design and implement scalable data architectures.Key Responsibilities:Develop and maintain high-quality data pipelinesCollaborate with cross-functional teams to identify and prioritize business needsEnsure data quality and integrity through rigorous testing and...
-
Lead Data Solutions Architect
2 weeks ago
Jodhpur, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Description:We are seeking a highly skilled Lead Data Solutions Architect to join our team. This is a senior technical role with high expectations.The ideal candidate will design, develop, and optimize data pipelines using Azure and Databricks.They will work with Databricks Asset Bundles (DABs) for CI/CD and environment management.Build and manage...
-
Principal Data Architect
2 weeks ago
Jodhpur, Rajasthan, India Tech Anand Rathi - ARIT Full time US$ 1,50,000 - US$ 2,00,000 per yearJob Title: Principal Data Architect (on Contract)Location:Jodhpur (Hybrid)Department:Data Engineering & AnalyticsCompany:AnandRathi IT Pvt Ltd ServicesAbout Us:AnandRathi is one of India's leading financial services firms, offering a wide range of services in wealth management, capital markets, brokerage, investment banking, and financial planning. As part...
-
Chief Data Architect
2 weeks ago
Jodhpur, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Seeking a visionary Data Engineer to spearhead the design and development of scalable data pipelines. Collaborate with cross-functional teams to drive cutting-edge solutions, leveraging expertise in AI/ML integration and cloud infrastructure.Key ResponsibilitiesPipeline Development: Design high-throughput, low-latency pipelines to process massive datasets...
-
Data Pipeline Specialist
2 weeks ago
Jodhpur, Rajasthan, India beBeeDataEngineer Full time ₹ 1,60,00,000 - ₹ 2,20,00,000Job Summary:A highly skilled Data Engineer is required to develop, construct, test and maintain large data pipelines in Google Cloud.The ideal candidate will have strong communication skills, be able to translate business needs to technical requirements and leverage various tools in the Google Cloud Ecosystem.Key Responsibilities:Develop complex datasets...
Lead Data Pipeline Architect
2 weeks ago
About this role:
Key Responsibilities- Design and implement a shared component library for data pipelines, including ingestion, parsing, validation, enrichment, and publishing.
- Define patterns and templates for Apache Beam pipelines and Databricks jobs, ensuring standardization of configuration, packaging, versioning, CI/CD, and documentation.
- Create pluggable interfaces to enable multiple teams to swap extractors, OCR providers, and EMR publishers without code rewrites.
- Own end-to-end profiling and tuning of data pipelines, using tools such as cProfile, py-spy, and line_profiler.
- Instrument services with Elastic APM and correlate traces/metrics with Splunk logs, building dashboards and runbooks.
- Implement concurrency best practices, including asyncio for I/O-bound tasks, ThreadPool/ProcessPool for CPU-bound tasks, batching, rate limiting, retries, etc.
- Mentor developers, lead design reviews, codify best practices, and write clear documentation and examples.
- Partner with ML engineers on the future LLM/SLM path, evaluating harnesses, safety/PII, cost/perf.
Requirements:
Expertise- 7+ years of experience in Python, with strong depth in performance and concurrency, profiling, and memory tuning.
- Observability expertise: Elastic APM instrumentation and dashboarding; Splunk for logs and correlation; OpenTelemetry familiarity.
- Hands-on experience with LLM-based solutions and their production support.
- API engineering for high-throughput integrations, resilience patterns, and secure handling of sensitive data.
- Strong architecture/design skills: clean interfaces, packaging shared libraries, versioning, CI/CD, testing.
- 3+ years of experience building large-scale data pipelines with Apache Beam and/or Spark, including hands-on Databricks experience (Jobs, Delta Lake, cluster tuning).
- Document processing: OCR (Tesseract, AWS Textract, Azure Form Recognizer), PDF parsing, text normalization.
- LLM/SLM integration experience (e.g., OpenAI/Azure AI, local SLMs), prompt/eval frameworks, PII redaction/guardrails.
- Cloud and tooling: AWS/Azure/GCP, Dataflow/Flink, Terraform, Docker; cost/performance tuning on Databricks.
- Security/compliance mindset (HIPAA), secrets management, least-privilege access.
Benefits:
- Competitive compensation package.
- Talent development-focused culture with quarterly promotion cycles and company-sponsored higher education and certifications.
- Opportunity to work with cutting-edge technologies.
- Employee engagement initiatives, including project parties, flexible work hours, and Long Service awards.
- Annual health check-ups.
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents.
Diversity and Inclusion:
- We are committed to fostering diversity and inclusion in the workplace.
- We welcome applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
