Data Pipeline Architect

5 days ago

Nashik, Maharashtra, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Lead Python Developer

We're seeking an accomplished Lead Python developer to spearhead the design and development of scalable data pipelines.

Job Description:

As a key member of our technology team, you'll be responsible for designing, developing, and automating large-scale ETL workflows using Python and Pandas.

You'll work closely with cross-functional teams to implement data ingestion and transformation processes using Hive SQL for data warehousing, configure and optimize Elasticsearch clusters for indexing, searching, and analytics performance, and build and maintain RESTful APIs using Flask to facilitate secure data exchange.

Required Skills:

  • Proficient in Python with hands-on experience using Pandas for large dataset processing
  • Solid knowledge of ETL frameworks and pipeline automation strategies
  • Experience with Elasticsearch: indexing, querying, and optimizing for performance
  • Strong command of Hive SQL and working with distributed data systems
  • Experience building APIs using Flask or similar Python frameworks
  • Understanding of data modeling, schema design, and workflow orchestration

Benefits:

  • Opportunity to work on large-scale, high-availability systems that handle complex supply chain operations, order management, and personalized customer experiences at massive scale
  • Collaborative and dynamic work environment with experienced professionals
  • Ongoing training and professional development opportunities

About Us:

We're a global retail and e-commerce organization dedicated to serving millions of guests daily through a vast network of physical stores and a cutting-edge digital platform.

  • Chief Data Pipeline Architect

    21 hours ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Data Pipelines ExpertiseTo succeed in this challenging role, you will need to have a deep understanding of designing and developing scalable data pipelines that power business insights. Main Responsibilities:Develop ETL/ELT pipelines using Snowflake Tasks, Streams, and Stored Procedures to ensure seamless data integration.Create optimized data models...

  • Chief Data Pipeline Architect

    5 days ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Key Data Engineering Roles and ResponsibilitiesWe are seeking a highly skilled data engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data pipelines using Python and AWS technologies.The data engineer will work closely with cross-functional teams to develop and implement efficient ETL...

  • Chief Data Architect

    7 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,01,50,000

    About This RoleThis is a fantastic opportunity to excel in the field of data architecture. As a visionary data architect, you will be responsible for crafting and governing data architecture and pipelines.

  • Cloud Based Data Pipeline Architect

    6 days ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Lead Data EngineerWe are seeking a skilled Lead Data Engineer to join our team. In this role, you will be responsible for designing, developing, and implementing large-scale data pipelines using Azure services such as Data Factory, Databricks, and Data Lake.Key Responsibilities:Develop complex data pipelines utilizing PySpark and SQL.Implement...

  • Data Pipeline Engineer

    5 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Senior Data Pipeline EngineerThis role involves ensuring the accuracy, integrity, and performance of data pipelines deployed into cloud environments.The Senior Data Pipeline Engineer will be responsible for designing and developing comprehensive test cases to validate data transformations, mappings, and system behaviors using Python scripting and Pytest...

  • Data Pipeline Developer

    21 hours ago

    Nashik, Maharashtra, India beBeeDataPipelineDeveloper Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline DeveloperKey Responsibilities:Design and develop scalable data pipelines using cloud-based services with a solid understanding of data patterns, Python, and SQL.Orchestrate data workflows ensuring seamless integration and automation across data services.Utilize cloud infrastructure components for building and managing data lakes,...

  • Data Pipeline Specialist

    6 days ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled professional to design and implement robust data pipelines using Python and SQL.Main Responsibilities:Design, implement, and manage continuous integration/continuous deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.Configure and maintain GitHub branch protection rules and workflows to ensure smooth...

  • Data Pipeline Specialist

    5 days ago

    Nashik, Maharashtra, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    ETL Developer PositionWe are seeking a skilled ETL developer to join our data engineering team.Job Description:The successful candidate will design, develop and maintain ETL pipelines using IBM Data Stage (CP4 D) and AWS Glue/Lambda for ingestion from various sources such as flat files, APIs, Oracle, DB2, etc.Key Responsibilities include:Designing scalable...

  • Data System Architect

    7 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Systems ArchitectWe are seeking a highly skilled Data Systems Architect to join our team. The ideal candidate will have expertise in designing, building and maintaining scalable data pipelines for data ingestion, processing and storage.The role requires strong knowledge of data management, processing and architecture. Additionally, the...

  • Master Data Architect

    1 day ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Master Data Architect">Key Responsibilities:Design and Implement Scalable Data Architecture: Develop high-quality data pipelines, leveraging Google BigQuery/Google SQL for querying and manipulating large datasets. Create scripts in Python, Go, or Perl to extract, transform, and update datasets.Build Data Visualization Dashboards: Utilize Google...