Data Engineering Expert

10 hours ago

Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: Data Engineering Expert

About the Role:

  • We are seeking a skilled Data Engineer to build and maintain large-scale data processing workflows using leading-edge technologies like Azure Databricks, PySpark, and Apache Spark.
  • The ideal candidate will be responsible for performing rigorous data pre-processing tasks such as cleaning, transformation, deduplication, normalization, encoding, and scaling to ensure high-quality input for downstream analytics.
  • This role involves designing and maintaining cloud-based data architectures including data lakes, lakehouses, and warehouses following industry-standard best practices.
  • The successful candidate will deploy and optimize data solutions on cloud platforms such as Azure (preferred), AWS, or GCP with a focus on performance, security, and scalability.
  • Developing and optimizing ETL/ELT pipelines for structured and unstructured data from various sources is also an essential part of this role.
  • A strong understanding of DevOps principles and CI/CD practices is necessary to automate data workflows ensuring security and compliance with industry standards.
  • Maintaining high availability and reliability of data pipelines is crucial in this position.
  • Familiarity with containerization using Docker and Kubernetes is highly desirable.
  • This role requires collaboration with automation team, data scientists, and engineers to provide clean, structured data for AI/ML models.

Requirements:

  • Minimum 4 years of experience in data engineering.
  • Expertise in PySpark, Databricks, SQL, Azure/AWS/GCP, ETL, ELT.
  • Strong understanding of cloud-based data architectures and data processing technologies.
  • Ability to design and implement scalable data pipelines.
  • Experience with Docker and Kubernetes is a plus.

  • Expert Cloud Data Engineer

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,40,00,000

    Cloud Data Engineering Expert WantedWe are seeking a seasoned cloud data engineering expert to design and build large-scale data platforms using modern data engineering tools and best practices.Key Responsibilities:Design and develop robust data pipelines for ingestion, transformation, and analytics using industry-standard tools and technologies.Collaborate...

  • High-Performance Data Pipelines Expert

    9 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Are you a data engineering expert looking for a new challenge? This is an excellent opportunity to leverage your skills and experience in designing, developing, and maintaining scalable and high-performance data pipelines using Databricks and PySpark.About the RoleThis is a Senior Data Engineer position where you will be working on the design, development,...

  • Expert Data Engineer Wanted

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeDataStrategist Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data Strategist OpportunityAbout the RoleWe're seeking an experienced Lead Data Strategist to join our team and drive business growth through data-driven decision making. As a key member of our analytics department, you will be responsible for creating actionable insights that inform our product development roadmap.Key Responsibilities:Design and...

  • Lead Azure Data Engineering Expert

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Lead Azure Data Engineer\This is an opportunity to join our organization as a highly skilled Lead Data Engineer with expertise in Azure and Databricks. The role requires hands-on technical skills, strong communication skills, and the ability to work in a fast-paced environment.\Key Responsibilities:\\Design and develop data pipelines using Azure...

  • Data Engineer

    2 weeks ago

    Kanpur, Uttar Pradesh, India Natlov Technologies Pvt Ltd Full time

    We are looking for a skilled Data Engineer with expertise in AWS services and strong programming skills.Key Responsibilities:Build and maintain data pipelines and workflows using AWS services (Lambda, S3, DynamoDB, Glue, SageMaker).Develop and deploy solutions leveraging Python and Docker.Work on image processing tasks using libraries such as OpenCV (CV2),...

  • Senior Data Modeling Expert

    8 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataScientist Full time ₹ 35,00,000 - ₹ 40,00,000

    Data Science Career OpportunityAs a skilled Data Scientist, you will play a key role in driving business success by leveraging data, analytics, and artificial intelligence (AI) technologies to extract insights and develop predictive models.You will be responsible for leading end-to-end initiatives, analyzing and interpreting findings, drawing conclusions and...

  • Data Engineer

    2 days ago

    Kanpur, Uttar Pradesh, India Denave Full time

    Job ResponsibilitiesDesign, build & maintain scalable data pipelines for ingestion, processing & storage.Collaborate with data scientists, analysts, and product teams to deliver high-quality data solutions.Optimize data systems for performance, reliability, scalability, and cost-efficiency.Implement data quality checks ensuring accuracy, completeness, and...

  • Data Governance Expert

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeExpert Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job TitleA seasoned professional with expertise in Master Data Governance (MDG) is sought after by a forward-thinking organization.Key responsibilities include data cleansing, migration to TMS systems, and integrating Customer Vendor Integration (CVI).Strong experience in SAP ECC and S/4 Hana is essential for this role.As we transition from SAP ECC to SAP...

  • Data Engineering Lead

    5 days ago

    Kanpur, Uttar Pradesh, India beBeeDatabaseEngineering Full time ₹ 25,00,000 - ₹ 40,00,000

    We are seeking an experienced Data Engineering Lead to drive the development and implementation of our data infrastructure.Job DescriptionThe Data Engineering Lead will be responsible for designing, building, and maintaining scalable data systems that support our AI and ML initiatives. This includes:Designing and implementing database schemas, structures,...

  • Data Architect and Engineer

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer NeededWe're looking for a highly skilled data engineer to join our team.Hands-on expertise in Python and PySpark is essential.5+ years of experience in data engineering with a focus on big data, telemetry, and streaming analytics.The ideal candidate will have strong business acumen, excellent communication skills, and the ability to work...