Strategic Data Pipeline Architect

4 days ago

Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 17,50,000 - ₹ 25,85,000
Lead Data Engineer Opportunity

We are seeking a highly skilled and experienced Lead Data Engineer to join our team.

The ideal candidate will have deep hands-on expertise in Azure and Databricks, with a strong track record of delivering high-quality solutions with speed and precision.

Key Responsibilities:

  • Design, develop, and optimize data pipelines using Azure and Databricks.
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability.
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
  • Mentor team members to improve overall team productivity and technical capability.

Required Skills & Qualifications:

  • 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks.
  • Strong expertise in Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, unity catalog)
  • Azure Data Services (ADF, Azure Synapse good to have), Azure Data Lake, Azure SQL
  • Python, SQL, Spark with proven performance optimization skills
  • Strong knowledge of modern data architectures Lakehouse, governance

Benefits:

  • Efficiency-driven mindset focused on speeding up both personal and team delivery
  • Strong communicator within the team able to share knowledge and mentor effectively
  • Highly motivated proactive and results-oriented
  • Ability to work in a fast-paced environment with quick turnarounds
  • Team-first approach drives collective improvement and efficiency

Preferred Skills:

  • Experience with AI-driven development to accelerate coding improve productivity and maintain high-quality implementations
  • Exposure to Generative AI in Databricks good to have

Work Hours:

  • Must have 5–6 hours daily overlap with USA team EST time zone for collaboration

  • Lead Data Pipeline Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Engineer">About the PositionWe are seeking a highly skilled data engineer with expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and architectures. This role involves collaborating with cross-functional teams to develop and implement data-driven solutions that meet business needs.Key...

  • Expert Data Architect

    2 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    About This RoleWe are looking for a skilled Data Architect to design and implement scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.Key Responsibilities:Collaborate with cross-functional teams to develop high-quality data solutions.Design and deploy efficient ETL/ELT pipelines with Azure Databricks by utilizing PySpark and...

  • High-Performance Data Pipeline Architect

    1 day ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Job OverviewThe role of Data Engineer is a critical component in the design and implementation of high-performance data pipelines. Our ideal candidate will possess extensive knowledge of AWS cloud services, Databricks, and Python/SQL for data transformation.

  • Data Pipeline Specialist

    4 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled Senior Data Engineer to take on the challenge of building and maintaining our data pipelines.Responsibilities:Develop ETL pipelines using FiveTran, DBT Cloud, and custom frameworksImplement client-specific data transformations for HighTouch integrationSupport data ingestion and quality checks during client...

  • Data Pipeline Specialist

    4 days ago

    Dindigul, Tamil Nadu, India beBeeSoftwareEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking an experienced professional to drive testing strategy and execution for a project leveraging Databricks, Data Factory pipelines and Power BI. The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management. Additionally, the role requires experience with GitHub/Bitbucket...

  • Data Solutions Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Solutions ArchitectJob Summary:We are seeking a skilled and detail-oriented professional to design, build, and manage scalable data pipelines and enterprise data solutions. This role will be critical in supporting our analytics, reporting, and data science initiatives by delivering high-quality, reliable, and performant data systems.The ideal...

  • Strategic Data Architect

    2 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,77,00,000 - ₹ 2,87,75,000

    About UsWe are a world leader in insurance, driving digital transformation through engineering excellence and analytics. We foster an environment where everyone can thrive, innovate, and grow.We have a team of over 2500 talented professionals, promoting collaboration, diverse perspectives, and a solution-driven attitude. We build expertise in engineering,...

  • Chief Data Architect

    1 day ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,52,16,000 - ₹ 2,01,93,600

    Job OverviewWe are seeking a seasoned Data Engineering Specialist to join our team. In this role, you will design and implement cutting-edge data warehousing solutions using Snowflake and Azure Data Factory.As a key member of our engineering team, you will work closely with DW/BI leads to understand ETL pipeline development requirements, identify gaps in...

  • Data Solutions Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to design and optimize data-driven solutions that support our analytics, reporting, and member-focused initiatives.This role is ideal for a professional with deep expertise in ETL development, data modeling, and financial data domains, particularly within banking systems.Design, develop,...

  • Senior Data Pipeline Specialist

    3 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewData Engineering RoleThis role involves designing and implementing robust data pipelines using AWS, Python, and SQL to support business analytics and decision-making.The successful candidate will be responsible for ensuring the integrity, security, and performance of data processing and storage systems while collaborating with cross-functional...