Data Pipeline Architect

1 week ago

Dombivli, Maharashtra, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Senior Python Engineer

We are seeking a seasoned Senior Python Engineer to lead our engineering group. As a key member of the team, you will be responsible for designing and developing scalable data pipelines using Python and Pandas.

You will work closely with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting tools. Your primary focus will be on ensuring high standards of data quality, reliability, and integrity throughout the pipeline.

Your responsibilities will include:

  • Designing and developing ETL workflows using Python and Pandas
  • Implementing and managing data ingestion and transformation processes using Hive SQL for data warehousing
  • Configuring, monitoring, and optimizing Elasticsearch clusters for indexing, searching, and analytics performance
  • Building and maintaining RESTful APIs using Flask to facilitate secure data exchange
  • Collaborating with cross-functional teams to support data-driven applications and reporting tools

Key qualifications for this role include strong command of Hive SQL, working with distributed data systems, experience with Elasticsearch, API development using Flask or similar frameworks, and knowledge of data modeling, schema design, and workflow orchestration.

The ideal candidate will have 5-16 years of experience in software development, with a strong background in Python programming and data processing. You should be proficient in debugging, analytical, and communication skills.

In this role, you will have the opportunity to work on large-scale, high-availability systems that handle complex supply chain operations, order management, and personalized customer experiences at massive scale.

  • Data Pipeline Architect

    5 days ago

    Dombivli, Maharashtra, India beBeePipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline ArchitectOverview:We are seeking a skilled data pipeline architect to design, develop, and manage data pipelines that drive business growth. The ideal candidate will have strong expertise in designing and developing data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns, Python,...

  • Senior Data Pipeline Architect

    2 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Opportunity:Seeking a seasoned Data Architect to lead the design and implementation of scalable data pipelines.Key Responsibilities:Develop and maintain robust ETL/ELT pipelines using Spark, PySpark, SQL, and PythonOptimize large-scale data processing workflows for performance and reliabilityCollaborate with cross-functional teams on AWS services such as...

  • Data Pipeline Specialist

    2 days ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Cloud Data EngineerWe are seeking a skilled and motivated cloud data engineer to join our team.The ideal candidate will be proficient in designing, developing, and optimizing robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow, and Cloud Storage. They will also have experience in architecting and managing scalable BigQuery data...

  • Data Pipeline Architect

    1 week ago

    Dombivli, Maharashtra, India beBeeAzure Full time ₹ 12,00,000 - ₹ 20,10,000

    Job DescriptionThreatXIntel, a cybersecurity company dedicated to protecting businesses from cyber threats, is seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure...

  • Highly Skilled Data Pipeline Architect

    1 week ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About Foodsmart:We are a leading provider of personalized nutrition and foodcare solutions.Our platform is designed to foster healthier eating habits, drive lasting behavior change, and deliver long-term health outcomes.We serve 2.2 million members on a tailored journey to eating well while saving time and money.We partner with national and regional...

  • Cloud Data Architect – Design and Build Scalable Data Pipelines

    7 days ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a seasoned Data Engineer to architect, deploy and maintain scalable data pipelines using cloud-based technologies like GCP, AWS or Azure.This is an exciting chance to work on cutting-edge data infrastructure with real-world impact, ensuring data reliability, quality and availability to support business needs.Design, develop and...

  • Senior Data Architect

    5 days ago

    Dombivli, Maharashtra, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ArchitectJob SummaryWe are seeking an experienced and highly skilled Senior Data Architect to join our team. The ideal candidate will have a strong background in data analysis, engineering, and solution design.Key ResponsibilitiesThe Senior Data Architect will be responsible for:Designing and implementing large-scale data architectures...

  • Cloud Data Solutions Architect

    1 day ago

    Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 10,96,589 - ₹ 16,49,847

    Job Title: Cloud Data Solutions ArchitectAbout the RoleWe are seeking a skilled and experienced data engineer to join our team as a Cloud Data Solutions Architect. This is an exciting opportunity for you to work on large-scale financial institution projects, leveraging your expertise in designing and implementing data pipelines in Google Cloud Platform...

  • Chief Data Architect

    2 days ago

    Dombivli, Maharashtra, India beBeeCloudNative Full time ₹ 18,00,000 - ₹ 25,00,000

    Cloud Native Architect for Modern HealthcareA highly skilled Cloud Native Architect is required to drive the modernization of healthcare provider data pipelines, credentialing, and compliance-driven workflows.This role serves as the technical anchor for our cloud native journey, defining and evolving the platform architecture with a strong focus on data...

  • Transformative Data Architect

    2 days ago

    Dombivli, Maharashtra, India beBeeData Full time US$ 1,75,000 - US$ 2,25,000

    AI-Driven Solutions ArchitectWe are seeking a highly skilled AI-Driven Solutions Architect to join our team. As an AI-Driven Solutions Architect, you will play a key role in designing and delivering scalable, future-proof data and AI solutions for our global clients.Key Responsibilities:Engage with clients to understand business goals, technical constraints,...