Data Infrastructure Specialist

2 days ago

Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Description

We are seeking a skilled Data Engineer to drive the development and maintenance of our data infrastructure. This role involves designing, building, and optimizing data pipelines and ETL workflows to ensure efficient data processing and delivery.

The ideal candidate will have expertise in Python, Spark, and PySpark, with hands-on experience with Spark SQL, DataFrames, UDFs, and DAG execution.

Additionally, the successful candidate will have knowledge of data ingestion tools such as Kafka, Flume, and Kinesis, as well as data formats like Parquet, Avro, and ORC.

A strong understanding of performance tuning in Spark, including partitioning, caching, and broadcast joins, is also essential for this role.

Experience deploying on cloud platforms like Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc is highly valued.

Furthermore, proficiency in Airflow/Prefect for scheduling and orchestration, as well as exposure to testing and CI/CD for data pipelines, is desirable.

Required Skills and Qualifications
  • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, and PySpark.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, and DAG execution.
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
  • Exposure to testing and CI/CD for data pipelines (pytest, Jenkins, GitHub Actions).
Benefits

As a Data Engineer at our company, you will have the opportunity to work on challenging projects, collaborate with cross-functional teams, and develop your skills in a rapidly evolving field.

Additionally, you will be part of a dynamic and supportive team that values innovation, creativity, and teamwork.

Others

Our company is committed to providing a safe and inclusive work environment, with equal opportunities for growth and advancement.

We encourage diversity, equity, and inclusion in all aspects of our organization.

  • Network Infrastructure Specialist

    2 days ago

    Amrāvati, Maharashtra, India beBeeInfrastructure Full time ₹ 18,00,000 - ₹ 24,00,000

    Network Infrastructure SpecialistWe are seeking a skilled Network Infrastructure Specialist to join our team. This is an exciting opportunity to leverage your expertise in designing, implementing, and maintaining complex network infrastructure using Cisco Catalyst, Nexus, HP, and Juniper platforms.

  • Highly Skilled Cloud Infrastructure Specialist Wanted

    2 days ago

    Amrāvati, Maharashtra, India beBeeCloudEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Cloud Infrastructure Specialist RoleWe are seeking a skilled Cloud Infrastructure Specialist to join our team. This is a fantastic opportunity for an experienced professional with hands-on expertise in designing, automating and operating production-grade cloud infrastructure.Design and deploy infrastructure using a broad set of AWS services including VPC,...

  • Chief Data Infrastructure Specialist

    13 hours ago

    Amrāvati, Maharashtra, India beBeeDataengineer Full time ₹ 1,50,00,000 - ₹ 1,80,00,000

    About This Role:We're seeking a highly skilled Senior Data Engineer to design, build and maintain our modern data platform. This position is ideal for someone with deep technical expertise in ETL pipeline design, data modeling and infrastructure who thrives in an engineering-driven environment.You'll work across the full data stack, from ingestion and...

  • Network Infrastructure Documentation Consultant

    2 days ago

    Amrāvati, Maharashtra, India beBeeDocumentation Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Network Documentation SpecialistWe are seeking a skilled professional to develop and implement a structured documentation framework for our network infrastructure.This role involves working closely with the network team to gather data, convert designs into standardized templates, and train the team on maintaining and expanding the documentation.The primary...

  • Cloud Infrastructure Specialist

    13 hours ago

    Amrāvati, Maharashtra, India beBeeCloud Full time ₹ 64,26,000 - ₹ 82,70,000

    Unlock Your Cloud Engineering PotentialAt People Prime Worldwide, we guide our clients in navigating the digital landscape by unlocking the value of their data and applications. We operate across major industry sectors, including Banking, Financial Services & Insurance (BFSI), Technology, Media & Telecommunications (TMT), Healthcare & Life Sciences, and...

  • Cloud Infrastructure Specialist

    2 days ago

    Amrāvati, Maharashtra, India beBeeInfrastructure Full time ₹ 20,00,000 - ₹ 30,00,000

    We are seeking a highly skilled professional to join our team at pebble. In this role, you will design and operate large-scale infrastructure systems.Key Responsibilities:Architect Kubernetes clusters and drive automation for provisioning and scaling.Develop cost optimization strategies for cloud services and infrastructure utilization.Build internal...

  • Lead Infrastructure Specialist

    2 days ago

    Amrāvati, Maharashtra, India beBeeSystemEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Description:The Senior System Engineer will provide day-to-day support of client networks, servers, storage, and overall infrastructure. They will be responsible for maintaining the IT infrastructure remotely and at customer site(s) when needed.

  • Cloud Infrastructure Specialist

    11 hours ago

    Amrāvati, Maharashtra, India beBeeCloudEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Job DescriptionWe are seeking a Cloud Infrastructure Engineer to design, implement and maintain cloud-based infrastructure and services.This individual will be responsible for designing, implementing and maintaining distributed storage systems using Ceph, ZFS and NFS for hybrid and cloud-native environments.Design and implement distributed storage systems...

  • Data Protection Specialist

    13 hours ago

    Amrāvati, Maharashtra, India beBeeDataProtection Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Protection SpecialistWe are seeking a highly skilled professional to fill the role of Data Protection Specialist.The ideal candidate will have extensive experience in data backup and recovery solutions, particularly with Commvault product.The successful candidate will be responsible for:Ensuring seamless data protection processesMaintaining a...

  • Data Analytics Specialist

    10 hours ago

    Amrāvati, Maharashtra, India beBeeDataAnalytics Full time ₹ 10,00,000 - ₹ 15,00,000

    Data Analytics SpecialistWe are seeking a highly skilled Data Analytics Specialist to lead the development of innovative data analytics solutions using SAS Base, Macro, and EG. As a key member of our team, you will be responsible for designing and implementing data warehouses and ETL processes that drive business growth.Key Responsibilities:Designing and...