Senior Data Pipeline Specialist

2 weeks ago


Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Opportunity: Data Engineer

We are seeking an experienced professional with strong expertise in Databricks, specifically in Unity Catalog, Py Spark, and SQL, to join our data team.

Key Responsibilities:

  • Design and implement ETL/ELT pipelines using Databricks and Py Spark to build secure, scalable data pipelines.
  • Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets.
  • Develop high-performance SQL queries and optimize Spark jobs for efficient data processing.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver value-driven solutions.
  • Ensure data quality and compliance across all stages of the data lifecycle.
  • Implement best practices for data security and lineage within the Databricks ecosystem.
  • Participate in CI/CD, version control, and testing practices for data pipelines to ensure reliability and scalability.

Requirements:

  • Proven experience with Databricks and Unity Catalog.
  • Strong hands-on skills with Py Spark and Spark SQL.
  • Solid experience writing and optimizing complex SQL queries.
  • Familiarity with Delta Lake, data lakehouse architecture, and data partitioning.
  • Experience with cloud platforms like Azure or AWS.
  • Understanding of data governance, RBAC, and data security standards.


  • Bengaluru, Karnataka, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Senior Data Pipeline Specialist to lead the development and maintenance of complex data pipelines and enterprise-grade data systems.Job DescriptionThe ideal candidate will have 6-15 years of experience in ETL testing, software development, and data engineering. They must be proficient in Python, SQL, DWH, CI/CD, AWS, Automation,...


  • Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title : Data Pipeline SpecialistKey Responsibilities :Develop and manage scalable data pipelines using PySpark and SQL to drive business growth.Collaborate with cross-functional teams to implement data-driven solutions leveraging AWS services.Utilize Databricks for advanced data processing and analytics, working closely with data scientists and analysts...


  • Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Data Engineering OpportunityThis role involves designing and developing scalable data pipelines for batch and real-time processing. This includes building robust data models and data integration workflows from multiple structured and unstructured data sources, ensuring reliable data delivery and availability through collaboration with Data Scientists,...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking an experienced Data Engineer to join our team.As a Data Engineer, you will design, build, and maintain robust data pipelines for processing channel activity data. You will work on AWS cloud infrastructure and orchestration tools like Airflow to ensure high availability, scalability, and performance.You will collaborate with cross-functional...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    Job DescriptionWe are seeking an experienced Data Engineer who can build and maintain efficient data pipelines, utilizing SQL and Kafka technologies. The ideal candidate will have a strong understanding of data architectures and be able to optimize data delivery for optimal business outcomes.Key Responsibilities:Create and maintain scalable data pipelines...


  • Bengaluru, Karnataka, India beBeeData Full time ₹ 22 - ₹ 28

    Job OpportunityWe are seeking a skilled professional to fill the role of Big Data Specialist. This position requires expertise in designing, developing, and maintaining large-scale data pipelines using AWS services such as Glue, Lambda, and DMS.The ideal candidate will have hands-on experience with Apache Spark (Py Spark) for processing and transforming big...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong focus on designing, developing, and maintaining scalable and reliable data pipelines using PySpark.This role involves leveraging the Databricks Lakehouse Platform and its advanced AI/ML features to unlock data-driven insights and power our...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job SummaryThis is a Data Engineer position that involves working with cutting-edge data platform technologies to deliver high-quality, scalable solutions. The ideal candidate will have a strong background in computer science and experience in handling large datasets.Key Responsibilities:Design and develop data pipelines using Azure Synapse Analytics and...


  • Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 22,00,000

    Data Engineering SpecialistOur organization is seeking a highly skilled Data Engineering Specialist to design, develop, and maintain robust data pipelines for processing channel activity data.This role involves working with various data sources, including Hadoop and Terradata, to ensure seamless integration and high-quality data.The ideal candidate will...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 7,00,000 - ₹ 8,50,000

    Senior Data EngineerWe are seeking an accomplished Senior Data Engineer to spearhead the design, optimization, and maintenance of ETL pipelines in a Python & SQL-based ecosystem.This role demands strong architectural expertise, ensuring that new data pipeline solutions are scalable, maintainable, and aligned with existing designs.Key Responsibilities:Design...