Senior Data Pipeline Specialist

2 days ago

Kanpur, Uttar Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

Unlock the Power of Data Engineering with a Career that Transforms.

We're seeking an accomplished Big Data Engineer to spearhead our data engineering team. The ideal candidate will be highly skilled in designing, developing, and optimizing large-scale data pipelines and distributed data processing systems using Scala, Spark (PySpark), Python, NiFi, and Apache Kafka.

A successful Big Data Engineer at our organization will focus on building scalable cloud-based data architectures while collaborating with cross-functional teams. Key responsibilities include writing efficient queries, performing data analysis, ensuring high-quality code delivery through code reviews and performance tuning, and contributing to product development with a focus on scalability, maintainability, and performance.

To excel in this role, you'll need strong expertise in:

  • Scala – Minimum 3+ years of hands-on experience
  • Strong expertise in Spark (PySpark) and Python
  • Hands-on experience with Apache Kafka
  • Knowledge of NiFi / Airflow for orchestration
  • Strong experience in Distributed Data Systems (5+ years)
  • Proficiency in SQL and query optimization
  • Good understanding of Cloud Architecture

Bonus skills include exposure to messaging technologies like Apache Kafka or equivalent, experience in designing intuitive UIs for data analytics visualization, familiarity with Splunk or other monitoring/alerting solutions, and hands-on experience with CI/CD tools (Git, Jenkins).

In return, we offer a dynamic work environment, opportunities for growth and development, and a chance to make a real impact on the world of data engineering.

  • Data Pipeline Specialist

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeMachine Full time ₹ 25,00,000 - ₹ 28,00,000

    Senior Machine Learning EngineerKey Responsibilities:Develop and optimize complex data pipelines, applying machine learning engineering principles to enhance efficiency and scalability.Integrate and optimize data and model pipelines within production environments, diagnosing data inconsistencies and documenting assumptions.Employ experimental methodologies,...

  • Data Pipeline Specialist

    5 days ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    Big Data EngineerWe are seeking a highly skilled professional to join our team as a Big Data Engineer. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data.Key Responsibilities:Design, develop, and manage end-to-end data pipelines for stocks, crypto, and other financial...

  • Data Pipeline Specialist

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeBusiness Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Business Intelligence Developer","Role Summary:","We are seeking an experienced professional to design and implement scalable data pipelines using industry-standard tools.","Key Responsibilities:","Design and implement scalable data pipelines.","Develop ETL/ELT solutions within a cloud-based environment.","Manage and optimize data storage and...

  • Data Pipeline Engineer

    5 days ago

    Kanpur, Uttar Pradesh, India beBeeETL Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior ETL DeveloperWe are seeking an accomplished Senior ETL Developer to join our Data Engineering team. The ideal candidate will have a proven track record of designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.The role involves collaborating with architects, business analysts, and data...

  • Data Pipeline Specialist

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 17,50,000

    About the RoleWe're seeking a highly skilled Data Engineer to build robust pipelines that transform large, messy technical datasets into high-quality structured data.

  • Financial Data Pipeline Specialist

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled data engineer to take on the challenge of designing and building robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and develop end-to-end data pipelines for stocks, cryptocurrencies, and other financial datasets.Integrate third-party APIs and data feeds into internal systems.Build and...

  • Data Pipeline Specialist

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled professional to take on the role of Data Engineer, responsible for designing, developing, and maintaining data pipelines that ingest data from various sources into our enterprise-wide data warehouse system.Utilize cutting-edge technologies like AWS services (AWS Lambda, AWS DMS, and AWS Glue) for data ingestion and...

  • Strategic Data Architect

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data SpecialistWe are seeking a skilled Senior Data Specialist to design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that power our digital marketing platform. As a key member of our data infrastructure team, you will transform raw marketing data into actionable insights that drive business growth.Key...

  • Data Insights Specialist

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Senior Data Insights SpecialistWe are seeking an accomplished and results-driven Senior Data Insights Specialist to join our organization. As a key member of the team, you will play a vital role in driving business growth through data-driven insights and informed decision making.Key Responsibilities:Maintain and enhance internal data infrastructure to ensure...

  • Data Pipeline Architect

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design and build scalable data pipelines for processing channel activity data from multiple sources.The ideal candidate will possess strong knowledge of AWS cloud infrastructure, particularly services like Pyspark, Glue, EMR, lambda, Redshift, Athena, and other tools like...