Senior Data Pipeline Specialist

2 weeks ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Summary

This is a Data Engineer position that involves working with cutting-edge data platform technologies to deliver high-quality, scalable solutions. The ideal candidate will have a strong background in computer science and experience in handling large datasets.

Key Responsibilities:
  • Design and develop data pipelines using Azure Synapse Analytics and other related tools.
  • Work closely with cross-functional teams to understand business requirements and design effective data solutions.
  • Collaborate with data scientists and analysts to ensure that data is properly ingested, processed, and presented for analysis.
  • Develop and maintain reusable data components using Python, SQL, and Spark.
  • Deploy and manage enterprise analytics solutions on Azure cloud infrastructure.
  • Ensure data quality, security, and compliance across the entire data pipeline.
Qualifications and Essential Skills:
  • MS/BS degree in Computer Science, Engineering, or equivalent experience.
  • 4+ years of experience in data engineering and software development.
  • Proficiency in programming languages such as Python, Java, and C++.
  • Experience with big data processing approaches, schema-on-read methodologies, and distributed computing frameworks like Apache Spark.
  • Knowledge of Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and other related tools.
  • Understanding of agile delivery frameworks and tools like SAFe, Jira, Confluence, GitHub Actions, and Azure DevOps.
Desirable Skills:
  • Knowledge of Microsoft Fabric, Power BI, Power Apps, Azure Synapse, Purview, and Scala.
  • Experience with visualization tools like Tableau, Power BI, and QlikView.
Delivery Methodology:
  • Incorporate agile ways of working into the delivery process using DABL (Discovery, Alpha, Beta, Launch).
  • Collaborate with product-centric delivery teams to focus on delivering value independently while embracing integrated DevOps approaches.
Ownership and Governance:
  • Take ownership of delivery projects and help steer them to completion.
  • Maintain governance that allows projects and stakeholders to manage overall project performance and risks within the global nature of some programs.

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Senior Data Pipeline Specialist to lead the development and maintenance of complex data pipelines and enterprise-grade data systems.Job DescriptionThe ideal candidate will have 6-15 years of experience in ETL testing, software development, and data engineering. They must be proficient in Python, SQL, DWH, CI/CD, AWS, Automation,...

  • Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title : Data Pipeline SpecialistKey Responsibilities :Develop and manage scalable data pipelines using PySpark and SQL to drive business growth.Collaborate with cross-functional teams to implement data-driven solutions leveraging AWS services.Utilize Databricks for advanced data processing and analytics, working closely with data scientists and analysts...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Data Engineering OpportunityThis role involves designing and developing scalable data pipelines for batch and real-time processing. This includes building robust data models and data integration workflows from multiple structured and unstructured data sources, ensuring reliable data delivery and availability through collaboration with Data Scientists,...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity: Data EngineerWe are seeking an experienced professional with strong expertise in Databricks, specifically in Unity Catalog, Py Spark, and SQL, to join our data team.Key Responsibilities:Design and implement ETL/ELT pipelines using Databricks and Py Spark to build secure, scalable data pipelines.Work with Unity Catalog to manage data...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking an experienced Data Engineer to join our team.As a Data Engineer, you will design, build, and maintain robust data pipelines for processing channel activity data. You will work on AWS cloud infrastructure and orchestration tools like Airflow to ensure high availability, scalability, and performance.You will collaborate with cross-functional...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    Job DescriptionWe are seeking an experienced Data Engineer who can build and maintain efficient data pipelines, utilizing SQL and Kafka technologies. The ideal candidate will have a strong understanding of data architectures and be able to optimize data delivery for optimal business outcomes.Key Responsibilities:Create and maintain scalable data pipelines...

  • Data Pipeline Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 22 - ₹ 28

    Job OpportunityWe are seeking a skilled professional to fill the role of Big Data Specialist. This position requires expertise in designing, developing, and maintaining large-scale data pipelines using AWS services such as Glue, Lambda, and DMS.The ideal candidate will have hands-on experience with Apache Spark (Py Spark) for processing and transforming big...

  • Data Pipelines Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong focus on designing, developing, and maintaining scalable and reliable data pipelines using PySpark.This role involves leveraging the Databricks Lakehouse Platform and its advanced AI/ML features to unlock data-driven insights and power our...

  • Building Robust Data Pipelines

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 22,00,000

    Data Engineering SpecialistOur organization is seeking a highly skilled Data Engineering Specialist to design, develop, and maintain robust data pipelines for processing channel activity data.This role involves working with various data sources, including Hadoop and Terradata, to ensure seamless integration and high-quality data.The ideal candidate will...

  • Chief Data Pipeline Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 7,00,000 - ₹ 8,50,000

    Senior Data EngineerWe are seeking an accomplished Senior Data Engineer to spearhead the design, optimization, and maintenance of ETL pipelines in a Python & SQL-based ecosystem.This role demands strong architectural expertise, ensuring that new data pipeline solutions are scalable, maintainable, and aligned with existing designs.Key Responsibilities:Design...