High-Performance Data Pipelines Expert

21 hours ago

Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

Are you a data engineering expert looking for a new challenge? This is an excellent opportunity to leverage your skills and experience in designing, developing, and maintaining scalable and high-performance data pipelines using Databricks and PySpark.

About the Role
  • This is a Senior Data Engineer position where you will be working on the design, development, and maintenance of data solutions on AWS, including services like S3, Glue, Lambda, EMR, and Redshift.
  • You will also be responsible for implementing and managing data workflows using CI/CD tools and Terraform to provision and manage cloud resources.
  • In addition, you will collaborate with data scientists, analysts, and other engineering teams to support end-to-end data solutions.
  • Your focus will be on monitoring, troubleshooting, and optimizing performance of data pipelines and cloud infrastructure.

We are seeking a highly skilled professional with strong hands-on experience in Databricks and AWS, proficiency in PySpark and distributed data processing, and experience in CI/CD implementation for data workflows.

About Our Ideal Candidate

We are looking for a candidate who has a solid background in data engineering, with expertise in designing, developing, and maintaining data pipelines. The ideal candidate should have experience in working with large-scale datasets, data visualization tools, and collaboration with cross-functional teams.

The successful candidate will have excellent problem-solving skills, with the ability to troubleshoot complex technical issues. They should also have strong communication skills, with the ability to effectively communicate with stakeholders at all levels.

We offer a competitive salary and comprehensive benefits package, flexible work environment with a supportive company culture, and opportunities for continuous learning and professional growth.

Benefits
  • Competitive Salary
  • Comprehensive Benefits Package
  • Flexible Work Environment
  • Supportive Company Culture
  • Opportunities for Continuous Learning and Professional Growth

  • High-Performance Data Pipeline Specialist

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Us We're looking for a talented Data Engineer to help us scale and optimize our data processing capabilities. Role Overview You will design, build, and maintain high-performance data pipelines that process terabytes of data. Key Responsibilities Design and implement scalable batch processing systems using Python and big data technologies Optimize...

  • Data Pipeline Specialist

    17 hours ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 17,50,000

    About the RoleWe're seeking a highly skilled Data Engineer to build robust pipelines that transform large, messy technical datasets into high-quality structured data.

  • Data Engineering Expert

    21 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering ExpertAbout the Role:We are seeking a skilled Data Engineer to build and maintain large-scale data processing workflows using leading-edge technologies like Azure Databricks, PySpark, and Apache Spark.The ideal candidate will be responsible for performing rigorous data pre-processing tasks such as cleaning, transformation,...

  • Data Pipeline Architect

    5 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role:The ideal candidate will have a solid foundation in data engineering with a minimum of 7 years of experience in development on data-centric projects.Mandatory Skills:Expertise in working with real-time data and Kafka framework, including kSQL/Mirror Maker etc.Proficiency in at least one programming language: Groovy or Java.Thorough...

  • Senior Data Pipeline Architect

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeEngineeringManager Full time ₹ 20,00,000 - ₹ 25,00,000

    About the RoleWe are seeking an experienced Engineering Manager to lead a team of data engineers in designing and delivering scalable data pipelines and analytics platforms using Big Data platforms, Microsoft Azure, and Databricks.Main ResponsibilitiesLead, mentor, and grow a team of data engineers working on large-scale distributed data systems.Architect...

  • High-Level Software Architectures for Scalable Data Pipelines

    7 hours ago

    Kanpur, Uttar Pradesh, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Python Platform EngineerAbout the Position:We are seeking a skilled Python engineer to lead our platform engineering efforts with hands-on experience in Apache Beam, Databricks, and related technologies.Key Responsibilities:Design and build a shared component library/SDK for pipelines: ingestion, parsing/OCR, extraction, validation, enrichment,...

  • High-Performance Backend Engineer

    3 days ago

    Kanpur, Uttar Pradesh, India beBeeBackendDeveloper Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Skillful Backend Developer WantedWe are looking for an accomplished software developer to design and implement high-performance backend systems.Key Responsibilities:Create robust, scalable, and efficient backend solutions.Implement algorithms and data models to support business workflows.Collaborate with cross-functional teams to deliver high-quality...

  • Engineering Pipeline Expert

    20 hours ago

    Kanpur, Uttar Pradesh, India beBeeAutomation Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job SummaryPure Storage seeks a hands-on Engineering Manager to lead the Tools & Frameworks Team in Observability & Reliability, responsible for scaling automated test infrastructure for all-flash storage solutions.This role requires a passionate leader who improves efficiency, streamlines build-test pipelines, and drives faster development cycles.Key...

  • Data Pipeline Specialist

    21 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled professional to take on the role of Data Engineer, responsible for designing, developing, and maintaining data pipelines that ingest data from various sources into our enterprise-wide data warehouse system.Utilize cutting-edge technologies like AWS services (AWS Lambda, AWS DMS, and AWS Glue) for data ingestion and...

  • Senior Data Platform Expert

    7 hours ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Platform ExpertWe are seeking an experienced and skilled Senior Data Platform Expert to join our team.Job DescriptionThe Senior Data Platform Expert will be responsible for designing, implementing, and managing large-scale data platforms to support business growth and innovation. The ideal candidate will have a deep understanding of...