Data Platform Specialist

2 days ago

Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 2,30,00,000
Senior Data Engineer Opportunity

We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation.

This role is ideal for someone with deep expertise in building and managing big data pipelines using modern technologies, and who is passionate about driving efficiency in data processing systems.

  • Data Ingestion Framework Design & Development: Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.
  • Framework Optimization: Use cloud services such as Glue, Lambda, EMR, ECS, EC2, and Step Functions to build highly scalable, resilient, and automated data pipelines.

Data Quality & Validation Processes:

  • Validation Routines: Develop and implement automated data quality checks and error-handling mechanisms to ensure the accuracy and integrity of incoming data.
  • Monitoring & Reporting: Establish comprehensive monitoring, logging, and alerting systems to proactively identify and resolve data quality issues.

API Development:

  • Design & Implementation: Architect and develop secure, high-performance APIs to enable seamless integration of data services with external applications and internal systems.
  • Documentation & Best Practices: Create thorough API documentation and establish standards for API security, versioning, and performance optimization.

Collaboration & Agile Practices:

  • Cross-Functional Communication: Work closely with business stakeholders, data scientists, and operations teams to understand requirements and translate them into technical solutions.
  • Agile Development: Participate in sprint planning, code reviews, and agile ceremonies, while contributing to continuous improvement initiatives and CI/CD pipeline development.

Required Qualifications & Experience:

Experience & Technical Skills:

  • Professional Background: At least 5 years of relevant experience in data engineering with a strong emphasis on analytical platform development.
  • Programming Skills: Proficiency in Python and/or PySpark, SQL for developing ETL processes and handling large-scale data manipulation.
  • Cloud Expertise: Extensive experience using cloud services including Glue, Lambda, Step Functions, and S3 to build and manage data ingestion frameworks.
  • Data Platforms: Familiarity with big data systems (e.g., EMR, Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, Postgres, or Redshift.
  • API Development: Proven experience in designing and implementing RESTful APIs and integrating them with external and internal systems.
  • CI/CD & Agile: Hands-on experience with CI/CD pipelines (preferably with GitLab) and Agile development methodologies.

Desirable Soft Skills:

  • Strong problem-solving abilities and attention to detail.
  • Excellent communication and interpersonal skills with the ability to work independently and collaboratively.
  • Capacity to quickly learn and adapt to new technologies and evolving business requirements.

What We Offer:

  • Opportunity to drive innovation and growth.
  • Collaborative and dynamic work environment.
  • Continuous learning and professional development opportunities.

  • Customer Data Platform Data Analyst

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    About the PositionWe are seeking talented individuals to fill a role in our Customer Data Platform team.This position offers a solid foundation for a career in data-driven marketing, data engineering, and analytics.You will work with industry-leading marketing technology tools, manage large-scale customer data, and contribute to creating actionable insights...

  • Data Transformation Specialist

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeTransformation Full time ₹ 3,00,000

    Data Transformation SpecialistJob Title: Data Transformation SpecialistJob Overview:As a data transformation specialist, you will be responsible for converting and transforming data into a standardized format.Main Responsibilities:Converting data from various formats into XML using data integration technologies.Ensuring that the converted data is accurate...

  • Expert Power Platform Governance Specialist

    1 week ago

    Tiruchi, Tamil Nadu, India beBeeGovernance Full time ₹ 9,00,000 - ₹ 12,00,000

    Power Platform Governance SpecialistWe are seeking a highly skilled Power Platform governance specialist to lead the development and maintenance of our Microsoft 365 platform.The ideal candidate will have extensive experience in Power Apps, Power Automate, Power BI, and SharePoint Online, as well as strong hands-on skills in data modeling, workflow...

  • Data Quality Specialist

    1 day ago

    Tiruchi, Tamil Nadu, India beBeeDataQuality Full time ₹ 8,00,000 - ₹ 15,00,000

    We are seeking a skilled Data Quality Specialist to join our team. This role will focus on ensuring the accuracy and reliability of our data pipelines, analytics platforms, and reporting systems.

  • Data Architect Specialist

    7 days ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Architect SpecialistWe are seeking a highly skilled Data Architect Specialist to design, develop, and maintain scalable data pipelines and infrastructure that support real-time and batch data processing.You will collaborate with cross-functional teams to deliver reliable, high-quality data systems that power analytics, insights, and data-driven...

  • Customer Data Platform Strategist

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeProduct Full time ₹ 18,00,000 - ₹ 25,00,000

    A Unified Customer Data Platform Product Manager is responsible for the strategy, development, and lifecycle of a platform, focusing on unifying customer data from various sources to create single customer views for personalized marketing and insights.Key Responsibilities:Develop and maintain a clear product roadmap for the platform, aligning with business...

  • Senior Data Platform Architect

    1 hour ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 90,00,000 - ₹ 2,10,00,000

    Key Engineering Role: Data Platform ArchitectOur organization seeks a highly skilled Data Platform Architect to lead the design and development of our enterprise data foundation. As a key member of our engineering team, you will be responsible for architecting clean, scalable models, driving data platform strategy, and enabling high-velocity product...

  • Data Management Specialist

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeDataManagement Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Management SpecialistThe role of a data management specialist involves overseeing and maintaining the organization's data management systems. As a key member of the team, you will be responsible for ensuring data quality and integrity.Key Responsibilities:Develop and implement data management strategies to ensure data quality and...

  • Trading Platform QA Specialist

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeQuality Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Quality Assurance Specialist for Trading PlatformsWe are seeking an experienced Quality Assurance specialist to join our team in ensuring the quality, stability, and performance of our trading systems.This role will focus on executing QA activities on the Trading Platform, with a primary emphasis on the Endur tool used for energy and commodities...

  • Data Platform Architect Lead

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeCloud Full time US$ 1,20,000 - US$ 1,60,000

    Job DescriptionWe are seeking a highly skilled and proactive professional to lead the implementation and operational excellence of a scalable, multitenant modern data platform.This role requires hands-on experience in managing cloud services, supporting data pipeline orchestration, enforcing platform-level standards, and ensuring observability, performance,...