Senior Data Pipeline Specialist

2 weeks ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000
Job Description

We are seeking an experienced Data Engineer who can build and maintain efficient data pipelines, utilizing SQL and Kafka technologies. The ideal candidate will have a strong understanding of data architectures and be able to optimize data delivery for optimal business outcomes.

Key Responsibilities:

  • Create and maintain scalable data pipelines using SQL and Kafka
  • Design and implement data architectures that meet functional and non-functional business requirements
  • Identify opportunities for process improvements and automate manual tasks to increase efficiency
  • Work with stakeholders to define data infrastructure requirements and ensure optimal extraction, transformation, and loading of data from various sources
  • Support data sets in analytics tools to provide actionable insights into operational efficiency and key business performance metrics
  • Collaborate with data and analytics experts to enhance data system functionality

Required Skills and Qualifications

  • Bachelor's Degree with 3-5 years relevant work experience as a data engineer
  • Strong problem-solving skills with emphasis on data value
  • Experience working with data architectures and relational databases
  • Advanced knowledge of SQL and query authoring
  • Experience performing root cause analysis and manipulating large datasets
  • Strong analytical skills related to working with unstructured datasets
  • Ability to build processes supporting data transformation, structures, metadata, dependency, and workload management

Preferred Qualifications

  • Project management and organizational skills
  • Experience with Agile Scrum teams and associated tools
  • 5-7 years of experience manipulating data sets and pipelines
  • Coding knowledge and experience with several languages and environments
  • Experience preparing data for visualizations using Qlikview, QuickSight, Tableau, Business Objects, etc.
  • Working knowledge of message queuing, stream processing, and big data stores

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Senior Data Pipeline Specialist to lead the development and maintenance of complex data pipelines and enterprise-grade data systems.Job DescriptionThe ideal candidate will have 6-15 years of experience in ETL testing, software development, and data engineering. They must be proficient in Python, SQL, DWH, CI/CD, AWS, Automation,...

  • Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title : Data Pipeline SpecialistKey Responsibilities :Develop and manage scalable data pipelines using PySpark and SQL to drive business growth.Collaborate with cross-functional teams to implement data-driven solutions leveraging AWS services.Utilize Databricks for advanced data processing and analytics, working closely with data scientists and analysts...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Data Engineering OpportunityThis role involves designing and developing scalable data pipelines for batch and real-time processing. This includes building robust data models and data integration workflows from multiple structured and unstructured data sources, ensuring reliable data delivery and availability through collaboration with Data Scientists,...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity: Data EngineerWe are seeking an experienced professional with strong expertise in Databricks, specifically in Unity Catalog, Py Spark, and SQL, to join our data team.Key Responsibilities:Design and implement ETL/ELT pipelines using Databricks and Py Spark to build secure, scalable data pipelines.Work with Unity Catalog to manage data...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking an experienced Data Engineer to join our team.As a Data Engineer, you will design, build, and maintain robust data pipelines for processing channel activity data. You will work on AWS cloud infrastructure and orchestration tools like Airflow to ensure high availability, scalability, and performance.You will collaborate with cross-functional...

  • Data Pipeline Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 22 - ₹ 28

    Job OpportunityWe are seeking a skilled professional to fill the role of Big Data Specialist. This position requires expertise in designing, developing, and maintaining large-scale data pipelines using AWS services such as Glue, Lambda, and DMS.The ideal candidate will have hands-on experience with Apache Spark (Py Spark) for processing and transforming big...

  • Data Pipelines Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong focus on designing, developing, and maintaining scalable and reliable data pipelines using PySpark.This role involves leveraging the Databricks Lakehouse Platform and its advanced AI/ML features to unlock data-driven insights and power our...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job SummaryThis is a Data Engineer position that involves working with cutting-edge data platform technologies to deliver high-quality, scalable solutions. The ideal candidate will have a strong background in computer science and experience in handling large datasets.Key Responsibilities:Design and develop data pipelines using Azure Synapse Analytics and...

  • Building Robust Data Pipelines

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 22,00,000

    Data Engineering SpecialistOur organization is seeking a highly skilled Data Engineering Specialist to design, develop, and maintain robust data pipelines for processing channel activity data.This role involves working with various data sources, including Hadoop and Terradata, to ensure seamless integration and high-quality data.The ideal candidate will...

  • Chief Data Pipeline Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 7,00,000 - ₹ 8,50,000

    Senior Data EngineerWe are seeking an accomplished Senior Data Engineer to spearhead the design, optimization, and maintenance of ETL pipelines in a Python & SQL-based ecosystem.This role demands strong architectural expertise, ensuring that new data pipeline solutions are scalable, maintainable, and aligned with existing designs.Key Responsibilities:Design...