Advanced Data Developer Position

23 hours ago

Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Job Title: Azure Data Engineer

We are seeking a skilled data professional to develop and maintain automated data pipelines, supporting business intelligence and analytics initiatives. This role involves building production-ready workflows for data ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and metadata integration using Azure Databricks, Azure Data Lake, and Microsoft Purview.

Key Responsibilities:

  • Pipeline Development - Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks.
  • Granular Data Quality Capture - Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation.
  • Governance Metrics Automation - Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.
  • Microsoft Purview Integration - Automate asset onboarding, metadata enrichment, classification tagging, and lineage extraction for integration into governance reporting.
  • Data Retention & Policy Enforcement - Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).
  • Job & Query Monitoring - Build pipelines to track job performance, SLA adherence, and query costs for cost and performance optimization.
  • Metadata Storage & Optimization - Maintain curated Delta tables for governance metrics, structured for efficient dashboard consumption.
  • Testing & Troubleshooting - Monitor pipeline execution, optimize performance, and resolve issues quickly.
  • Collaboration - Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues.
  • Security & Compliance - Ensure all pipelines meet organizational governance, privacy, and security standards.

Required Skills and Qualifications:

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
  • 4+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake.
  • Proficiency in PySpark, SQL, and ETL/ELT pipeline design.
  • Demonstrated experience building granular data quality checks and integrating governance logic into pipelines.
  • Working knowledge of Microsoft Purview for metadata management, lineage capture, and classification.
  • Experience with Azure Data Factory or equivalent orchestration tools.
  • Understanding of data modeling, metadata structures, and data cataloging concepts.
  • Strong debugging, performance tuning, and problem-solving skills.
  • Ability to document pipeline logic and collaborate with cross-functional teams.

  • Advanced Data Scientist

    4 hours ago

    Nagpur, Maharashtra, India beBeeDataScientist Full time ₹ 35,00,000 - ₹ 40,00,000

    Unlock the Power of Data ScienceJob DescriptionAs a seasoned data scientist, you will play a pivotal role in driving business growth through data-driven insights. Your primary responsibilities will include designing and developing advanced machine learning models to solve complex business problems.Develop and implement large-scale machine learning models...

  • Advanced Data Migration Specialist

    2 days ago

    Nagpur, Maharashtra, India beBeeDataMigration Full time ₹ 10,00,000 - ₹ 15,00,000

    Job TitleWe are seeking an experienced Data Migration Specialist to lead data migration projects by extracting, transforming, and loading data from legacy systems to new platforms. The ideal candidate will be highly proficient in Excel for data analysis and transformation, have strong English communication skills, solid mathematical abilities, and experience...

  • AI/Machine Learning Developer Position

    3 hours ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Junior Data and AI/ML Engineer PositionWe are seeking a talented Junior Data and AI/ML Engineer to join our team. In this role, you will be responsible for developing and maintaining data pipelines, working with large-scale datasets, and collaborating with our research team to advance the field of aerospace technology.Key Responsibilities:Design and...

  • Advanced Data Management Specialist

    3 hours ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Informatica IDMC Developer PositionWelcome to this exciting opportunity in the field of data management!This role focuses on developing ETL solutions using Informatica IDMC (CDI & CDQ Modules) and designing, developing, and implementing data quality rules and transformations using Informatica CDQ.Responsibilities:• Develop ETL solutions using IICS / IDMC...

  • Software Developer Position

    5 hours ago

    Nagpur, Maharashtra, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Software EngineerKey Responsibilities:Develop comprehensive test strategies for complex software systemsDesign and execute automated test plans using tools like AWS and SnowflakeCollaborate with cross-functional teams to identify and prioritize testing needsRequirements:6+ years of total IT experienceExperience in data migration projects and data...

  • Advanced Clinical Data Analyst

    2 days ago

    Nagpur, Maharashtra, India beBeeStatistical Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior Statistical Programmer Job SummaryThis is an exciting opportunity to join a global pharmaceutical client as a Senior Statistical Programmer.As a Senior Statistical Programmer, you will be dedicated to supporting or leading Phase I-IV clinical trials, leveraging your advanced SAS programming skills and proficiency in CDISC standards (SDTM & ADaM).About...

  • Senior Financial Data Analyst Position

    24 hours ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Unlock the full potential of financial data with a career in strategic analysis.About This RoleWe are seeking a highly analytical individual to join our team and contribute to shaping business outcomes through informed decision-making.Financial Data Insights: Analyze complex financial data to identify trends, variances, and opportunities for growth. Present...

  • Research Analyst Position

    3 hours ago

    Nagpur, Maharashtra, India beBeeDataAnalysis Full time ₹ 6,00,000 - ₹ 12,00,000

    Research Analyst PositionWe are seeking a motivated and skilled Research Analyst to support our research efforts by analyzing data, conducting technical research, and collaborating with various teams to drive innovation.Responsibilities:Conduct in-depth research on various technical topics and present findings in PowerPoint presentations.Assist in the...

  • Strategic Data Science Leader

    24 hours ago

    Nagpur, Maharashtra, India beBeeDataScientist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key ResponsibilitiesDefine and Champion the Company's Data Science Vision and Strategy: Align data science initiatives with business objectives to drive growth and innovation.Design Scalable Data Platforms: Architect robust and scalable data solutions to support advanced analytics and AI/ML initiatives.Lead Advanced Statistical and Machine Learning Model...

  • Advanced Splunk Professional

    2 days ago

    Nagpur, Maharashtra, India beBeeSplunk Full time ₹ 15,98,153 - ₹ 24,29,124

    Job DescriptionWe are seeking an experienced Splunk Developer to join our team on a long-term contract.The ideal candidate will have strong expertise in developing, configuring, and maintaining Splunk environments to support monitoring, alerting, and advanced analytics.Design, develop, and implement dashboards, alerts, and reports in Splunk.Optimize and...