Data Pipeline Architect

2 days ago

Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Senior Data Engineer

About the Role:

We are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our engineering group, you will be responsible for designing, developing, and implementing large-scale data processing systems.

Key Responsibilities:

  • Design and develop scalable ETL workflows using Python and Pandas.
  • Implement and manage data ingestion and transformation processes using Hive SQL for data warehousing.
  • Configure, monitor, and optimize Elasticsearch clusters for indexing, searching, and analytics performance.
  • Build and maintain RESTful APIs using Flask to facilitate secure data exchange.
  • Collaborate with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting tools.

Requirements:

  • 5-16 years of experience in software development.
  • Proficient in Python, with hands-on experience using Pandas for large dataset processing.
  • Solid knowledge of ETL frameworks and pipeline automation strategies.
  • Experience with Elasticsearch: indexing, querying, and optimizing for performance.
  • Strong command of Hive SQL and working with distributed data systems.
  • Experience building APIs using Flask or similar Python frameworks.
  • Understanding of data modeling, schema design, and workflow orchestration.
  • Strong debugging, analytical, and communication skills.

Benefits:

  • Opportunity to work on large-scale, high-availability systems that handle complex supply chain operations, order management, and personalized customer experiences at massive scale.
  • Collaborative and dynamic work environment.
  • Professional growth and development opportunities.

What We Offer:

A competitive salary and benefits package, including health insurance, retirement plan, and paid time off.

We are an equal opportunity employer and welcome applications from diverse candidates.

  • Data Pipeline Architect

    3 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Data Engineer">">Our company is seeking an experienced Senior Data Engineer to join our team. This role will play a critical part in building scalable data pipelines and integrating healthcare data.">

  • Data Architect

    1 week ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a seasoned Data Architect to lead the design and development of scalable data engineering solutions that drive business growth.">Design, develop, and implement high-performance data processing pipelines using Apache Spark, Streamsets, or similar frameworks.Collaborate with cross-functional teams to integrate data systems and ensure...

  • Cloud Data Pipeline Architect

    14 hours ago

    Mangalore, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity: Data Engineer">We are seeking a skilled professional to lead our data engineering efforts.Our team requires someone who can design, develop and maintain robust data pipelines using cloud services such as GCP, AWS or Azure.">Main Responsibilities:Develop scalable data pipelines for real-time data processing.Implement data ingestion,...

  • Data Architect

    14 hours ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job DescriptionAs a senior Data Architect, you will be responsible for designing and implementing a scalable data warehouse architecture on PostgreSQL, leveraging open-source technologies. You will work closely with cross-functional teams to deliver high-quality, reliable data solutions that meet business and analytics requirements.Key...

  • Data Architect

    3 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Job Overview">This Data Architect role involves designing and implementing scalable data pipelines to support increasing data volume and complexity.">Key Responsibilities:Develop and Maintain Data Pipelines: Ensure data pipelines are scalable, efficient, and secure.Collaborate with Cross-Functional Teams: Work closely with analytics, business, and...

  • Cloud Data Architect

    3 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data ArchitectOur organization is seeking a highly skilled Cloud Data Architect to design, develop, and implement end-to-end data pipelines on cloud platforms.Key Responsibilities:Design and deploy scalable data architectures on cloud infrastructure using Azure Data Factory, Databricks, and Data Lake.Develop and maintain complex data pipelines using...

  • Senior Data Pipeline Architect

    8 hours ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Key ResponsibilitiesWe're looking for a skilled professional to lead the development of scalable data pipelines.Design and Implement Efficient ETL ProcessesCollaborate with Data TeamsImplement Data Governance and Security StandardsOptimize Data Workflows for Scalability and PerformanceRequired Skills & QualificationsTo succeed in this role, you'll...

  • Data Architect

    9 hours ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data ArchitectWe are seeking a skilled Data Architect to design and implement robust data infrastructure for our clients.The ideal candidate will have experience with ETL pipelines, database structures, and BI solutions.Design high-performance database structures for analytics.Develop BI dashboards and reports using Power BI, SSRS, or...

  • Senior Data Architect Position

    3 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Lead Data ArchitectWe are seeking an experienced Lead Data Architect to join our team.About the Role:This is a senior leadership position that involves designing, developing, and maintaining high-performance data processing systems using Apache Trino.The successful candidate will collaborate with cross-functional teams to implement data pipelines and ensure...

  • Senior Data Architect

    2 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Posting:We seek a highly skilled Senior Data Architect to join our organization. This individual will be responsible for designing and implementing scalable data systems following Medallion Architecture and best practices.Key Responsibilities:Data Ingestion and Transformation: Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF),...