Lead Data Engineering Specialist

1 day ago

Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

We are seeking a Data Engineering Expert with strong expertise in Teradata ETL development & migration, Azure Databricks, SQL, and Python to drive business growth through data-driven solutions.

This role requires technical leadership, ability to troubleshoot complex migration challenges, and experience collaborating with stakeholders in enterprise environments.

  • Convert Teradata ETL workloads into Databricks SQL for seamless data integration.
  • Refactor ingestion pipelines using SQL and/or Python to enhance data processing efficiency.
  • Design and implement data validation scripts for side-by-side comparisons to ensure data consistency.
  • Configure orchestration and job scheduling within the Databricks environment to optimize data workflow.
  • Perform unit, integration, UAT, and performance testing for migrated code to ensure high-quality data delivery.
  • Validate data consistency between Teradata and Databricks environments to maintain data integrity.
  • Deploy workloads in Unity Catalog enabled workspaces and ensure governance best practices to maintain data security.
  • Implement job monitoring using Databricks-native tools (system tables, workflows) to track data pipeline performance.

Required Technical Skills

  • Strong expertise in Teradata ETL development & migration to drive data transformation.
  • Proficiency in Azure Databricks, SQL, and Python to develop efficient data solutions.
  • Deep understanding of orchestration, scheduling, and data validation techniques to ensure data quality.
  • Hands-on knowledge of Unity Catalog for permissions and governance to maintain data security.
  • Solid experience in data testing: unit, integration, UAT, and performance to ensure high-quality data delivery.
  • Strong troubleshooting, debugging, and optimization skills to resolve complex data issues.

Benefits of Working with Us

We offer a dynamic work environment that fosters innovation, collaboration, and continuous learning. Our team is passionate about delivering high-quality data solutions that drive business growth.

About This Role

This is an exciting opportunity to join our team as a Data Engineering Expert and contribute to the development of cutting-edge data solutions. If you are passionate about data engineering and want to make a meaningful impact, we encourage you to apply.

  • Data Engineering Lead

    3 hours ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering LeadWe are seeking a highly skilled and experienced Data Engineering Lead to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems that meet the needs of our business.

  • Data Engineering Specialist

    2 hours ago

    Tiruppur, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 23,00,000

    Job SummaryWe are seeking a highly skilled Data Engineering Specialist to lead our data pipeline initiatives. The ideal candidate will have a strong understanding of data warehousing and data modeling techniques, as well as experience with distributed computing principles.Key ResponsibilitiesSelect and integrate Big Data tools and frameworks to provide...

  • Lead Big Data Specialist

    3 days ago

    Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Lead Big Data SpecialistJob Description:As a lead big data specialist, you will be responsible for designing and maintaining scalable pipelines using advanced tools such as Databricks, Azure Data Factory, and ETL.The ideal candidate will have expertise in optimizing workflows for efficient data ingestion, transformation, and delivery. You will...

  • Lead Management and Data Specialist

    14 hours ago

    Tiruppur, Tamil Nadu, India beBeeDataSpecialist Full time ₹ 8,00,000 - ₹ 12,00,000

    Job DescriptionWe are seeking a highly skilled Lead Management and Data Specialist to join our team. In this role, you will be responsible for ensuring seamless integration and management of CRM systems and data platforms.You will be responsible for lead generation, enrichment, automation, reporting, and providing sales teams with the right tools and data at...

  • Big Data Engineering Lead

    3 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Opportunity:A Senior Big Data Engineer is required to lead data engineering teams and manage cross-team collaboration, ensuring seamless integration with existing systems.Key Responsibilities:Lead data engineering teamsDesign and implement scalable big data pipelines using Apache Spark, Scala, and PythonWork with architects and product managers to ensure...

  • Lead Data Engineer

    3 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineering Project LeadWe seek an experienced Senior Data Engineering Project Lead to drive our data engineering initiatives forward.About the Role:Prioritize and deliver high-impact data engineering projects that support business growth.Leverage agile methodologies to streamline project workflows and enhance collaboration among cross-functional...

  • Data Engineering Lead

    1 day ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are currently seeking a seasoned Data Engineering Leader to spearhead our data engineering initiatives in Mumbai. This is an exceptional opportunity for a highly skilled professional to make a meaningful impact and contribute to the growth of our organization.About the Role:Design, build, and deploy cutting-edge data applications that meet business...

  • Advanced Data Engineering Lead Position

    3 hours ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 35,00,000

    Lead Data Engineering PositionAs a seasoned professional in data engineering, you will be responsible for overseeing the development and maintenance of our data infrastructure. We are seeking an expert with a strong background in team leadership and technical expertise to fill this pivotal role.Job Description: Develop and implement scalable data...

  • Lead Data Strategist

    6 days ago

    Tiruppur, Tamil Nadu, India beBeeBusiness Full time ₹ 25,00,000 - ₹ 35,00,000

    Business Intelligence Specialist Job OpeningWe are seeking a skilled professional to support our data-driven initiatives.This role combines data engineering, ETL development, and business intelligence with Power BI reporting delivery. The ideal candidate will be proficient in SQL, SSIS, SSRS, and Power BI.Key Responsibilities:Report Development and...

  • Lead Data Engineer

    3 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    As a senior data engineer on our team, your key areas of focus will include assessing current data integration frameworks and developing spark jobs using Scala for new project requirements.You will be responsible for enhancing existing spark jobs for ongoing product enhancements, ensuring optimal performance tuning and stress testing.In this role, you will...