Data Engineer for Advanced Data Solutions

1 day ago

Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title: Data Engineer for Advanced Data Solutions

We are seeking a seasoned Data Engineer to develop, optimize, and maintain automated data pipelines supporting business intelligence initiatives.

This role will focus on building production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and metadata integration using Azure Databricks, Azure Data Lake, and Microsoft Purview.

Key Responsibilities:

  • Pipeline Development – Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks.
  • Granular Data Quality Capture – Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation.
  • Governance Metrics Automation – Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.
  • Microsoft Purview Integration – Automate asset onboarding, metadata enrichment, classification tagging, and lineage extraction for integration into governance reporting.
  • Data Retention & Policy Enforcement – Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).
  • Job & Query Monitoring – Build pipelines to track job performance, SLA adherence, and query costs for cost and performance optimization.

  • Cloud Solutions Architect

    10 hours ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: AWS Data Engineer">We are seeking a skilled professional to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering, and knowledge of upstream, midstream, or downstream Oil & Gas processes to support advanced analytics, reporting, and digital...

  • Advanced AI/ML Solutions Engineer

    15 hours ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 17,50,000

    AI/ML Expert PositionAt our organization, we are seeking a highly skilled AI/ML engineer to join our team. The ideal candidate will have extensive experience in developing and implementing advanced AI/ML solutions.Machine Learning Model Development:The successful applicant will be responsible for designing and implementing algorithms and models to address...

  • Data Solutions Architect

    11 hours ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Data Engineer RoleWe are seeking a skilled Data Engineer to lead our data engineering team in delivering scalable and secure data solutions. This role involves designing and overseeing the architecture of Microsoft Fabric solutions, including integration with Power BI, Synapse, Data Factory, and other Azure services.Key Responsibilities:Design and oversee...

  • Lead Data Engineer

    3 weeks ago

    Salem, Tamil Nadu, India CoffeeBeans Full time

    Founded in the year 2017, Coffee Beans specialises in offering high end consulting services in technology, product, and processes.We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries.The company uses...

  • Senior Data Engineer

    23 hours ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a highly skilled Senior Data Engineer to join our team and play a key role in scaling our analytics and reporting capabilities.This role is perfect for someone with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure who thrives in a fast-paced, engineering-driven environment.You'll work...

  • Transforming Data Engineering Expert

    14 hours ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,20,000

    Data Engineer Job DescriptionOur team is looking for a skilled Data Engineer to join our organization. As a Data Engineer, you will be responsible for designing and implementing large-scale data processing systems that are fast, reliable, and scalable.The ideal candidate will have a strong background in computer science, experience with modern data...

  • Mastering Advanced Data Science

    2 days ago

    Salem, Tamil Nadu, India beBeeDataScientist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Scientist OpportunityWe are seeking a seasoned data scientist to join our team.Job Description:The ideal candidate will have a strong background in developing and deploying machine learning models, as well as experience with cloud-based systems.Required Skills and Qualifications:Proficiency in Python and SQLExperience building and evaluating...

  • Data-Driven Solutions Specialist

    1 day ago

    Salem, Tamil Nadu, India beBeeDataAnalysis Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Business Intelligence DeveloperThe ideal candidate will possess a deep understanding of business intelligence and analytics, with the ability to design and develop data-driven solutions.Key Responsibilities:Design, develop, and maintain advanced data analysis and reporting applications using SAS EG and other tools.Work closely with stakeholders to...

  • Advanced Data Infrastructure Specialist

    1 day ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewRole Summary: We are seeking a Senior Data Engineer with deep expertise in building scalable, event-driven data pipelines that support real-time clinical workflows.About the Role: As a key member of our team, you will design, build, and operate reliable systems to ingest, track, and update clinical events in real-time.Key...

  • Senior Data Engineer

    2 weeks ago

    Salem, Tamil Nadu, India Staffington Global Full time

    Role – Lead Data Engineer Skills – Mandatory AWS, Postgres, Python, SQL Skills - Primary Postgres, Python, SQL, AWS Work Shifts – General / US / UK General Qualification Bachelor's Degree Total Experience 7+ Relevant Experience 5+ Work Location Kochi/TVM Expected Date of Onboarding 20/08/2025 Job Purpose (both Onsite /...