Data Engineer Specialist

1 week ago

madurai, India beBeeDataEngineer Full time

Job SummaryWe are building the future of healthcare analytics. Our goal is to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. These pipelines should be reliable, observable, and continuously improving in production.Responsibilities:Data Pipeline Development: Design, build, and maintain scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA).Data Lake Management: Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility.Distributed Processing: Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.Ingestion Frameworks: Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).Quality Checks: Enforce validation and quality checks to ensure reliable analytics and ML readiness.Pipeline Monitoring: Monitor and troubleshoot pipelines with CloudWatch, integrating observability tools like Grafana, Prometheus, or Datadog.Infrastructure Automation: Automate infrastructure provisioning with Terraform, following AWS best practices.Database Integrations: Manage SQL Server, PostgreSQL, and Snowflake integrations into the Lakehouse.On-Call Support: Participate in an on-call rotation to support pipeline health and resolve incidents quickly.Engineering Best Practices: Write production-grade code, and contribute to design/code reviews and engineering best practices.

  • Data Specialist

    4 weeks ago

    Madurai, India Revature Full time

    About the Role:The Data Specialist evaluates learners’ technical proficiency in data engineering, analytics, and cloud data platforms. This role involves comprehensive assessment across SQL, data pipeline development, data modeling, and visualization capabilities, while providing actionable feedback to accelerate learner development. . The specialist...

  • Data Specialist

    4 weeks ago

    Madurai, India Revature Full time

    About the Role:The Data Specialist evaluates learners’ technical proficiency in data engineering, analytics, and cloud data platforms. This role involves comprehensive assessment across SQL, data pipeline development, data modeling, and visualization capabilities, while providing actionable feedback to accelerate learner development. . The specialist...

  • Data Integration Specialist

    7 days ago

    madurai, India beBeeDataIntegration Full time

    Data Integration SpecialistWe are seeking an experienced Data Integration Specialist to join our team. As a key member of our data engineering group, you will play a critical role in designing, developing and optimizing large-scale data pipelines.The ideal candidate should have extensive experience with SQL, Ab-Initio, Teradata and Google Cloud Platform...

  • Data Modeling Specialist

    3 days ago

    madurai, India beBeeData Full time

    We are seeking an accomplished Data Modeling Specialist to spearhead the development of high-grade predictive models that detect early warning signals in real-time sensor data, driving exceptional uptime outcomes.You will design and implement robust data pipelines to process massive amounts of IoT data from vehicle systems, collaborating with engineering...

  • Data Engineering Specialist

    2 days ago

    madurai, India beBeeDataEngineer Full time

    Job OverviewWe are seeking highly skilled Data Engineers to join our international data platform, analytics, and cloud engineering teams.Develop and implement scalable, reliable data pipelines using modern data engineering tools and frameworks.Design ETL/ELT workflows for structured, semi-structured, and unstructured data.Key Responsibilities:Implement data...

  • Data Visualization Specialist

    1 hour ago

    madurai, India beBeeCyber Full time

    Job Title: Data Visualization SpecialistAs a skilled Data Visualization Specialist, you will play a critical role in designing and implementing a Cyber Operations dashboard to replace the current manual dashboard/PowerPoint reporting.This key project involves research and documentation of existing data sources, workflows, and processes used in the current...

  • Azure Data Engineer

    2 weeks ago

    madurai, India beBeeDataIntegration Full time

    Job Title: Data Integration SpecialistWe are seeking a skilled Data Integration Specialist to join our team. This role involves designing and implementing data pipelines, ensuring seamless integration of various data sources and targets.Bachelor's or Master's degree in Computer Science, Information Technology, or related field.+5 years of experience in data...

  • Data Engineering Specialist

    2 weeks ago

    madurai, India beBeeDataEngineering Full time

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled Data Engineer to join our team.Job Description:The successful candidate will design, develop, and optimize scalable data pipelines and cloud-based data solutions using Python. A strong understanding of ETL/ELT processes, AWS cloud services (S3, Glue, Lambda, Redshift, Kinesis, DynamoDB),...

  • Data Review Specialist

    2 days ago

    madurai, India beBeeData Full time

    Job OpportunityWe are seeking a skilled Data Review Specialist to join our team. This role involves reviewing and labelling online content to ensure high-quality training data for machine learning models.Key Responsibilities:Review and label online contentMaintain quality and accuracy standardsHelp train AI systems with real-world dataRequirements:Good...

  • Data Engineer Specialist

    18 hours ago

    madurai, India beBeeDataSupport Full time

    As a key member of our entrepreneurial group, you will have the opportunity to work on client projects with an asset management firm. In this role as Data Support Engineer, you'll be responsible for monitoring data support issues and collaborating with team members.You will have a large degree of independence and trust, which allows you to fix issues within...