Senior Big Data Engineer

1 week ago

Delhi NCR Chennai Bengaluru Bangalore, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000
PySpark Developer Role

We are seeking a highly skilled and experienced PySpark developer to join our team.

As a key member of our analytics team, you will be responsible for designing, building, and optimizing large-scale data pipelines on the Databricks Unified Analytics Platform using PySpark and other big data frameworks.

  • Develop and manage scalable ETL/ELT pipelines using PySpark on Databricks.
  • Optimize data pipelines for performance, scalability, and cost-effectiveness.
  • Deploy and manage Databricks on Azure (ADF, Delta Lake, SQL).
  • Build CI/CD pipelines (Azure DevOps/GitHub Actions/Jenkins).
  • Collaborate with cross-functional teams to deliver robust data solutions.
Required Skills and Qualifications
  • Proficiency in Python and PySpark programming languages.
  • Experience with Databricks, Azure Cloud, and Hadoop technologies.
  • Strong understanding of SQL and NoSQL databases (PostgreSQL, SQL Server, MongoDB, Cosmos DB).
  • Familiarity with MLflow and Kubernetes is an added advantage.
Benefits
  • Competitive salary and benefits package.
  • Opportunities for career growth and professional development.
  • A collaborative and dynamic work environment.
Other Requirements
  • Bachelor's degree in Computer Science, Data Engineering, or related field.
  • Databricks, PySpark, or cloud certifications are desirable.

  • Senior Data Engineer for Big Data Platforms

    2 weeks ago

    Chennai, Pune, Bengaluru / Bangalore, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 30,00,000

    Job Title: Senior Data Engineer for Big Data PlatformsWe are looking for an experienced Senior Data Engineer to join our team and help us build, maintain and optimize our big data platforms. As a key member of our engineering team, you will be responsible for designing, developing, testing, and deploying large-scale data processing systems using distributed...

  • Big Data Engineer

    1 week ago

    Chennai, Bengaluru / Bangalore, India beBeeBigDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Job OverviewWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement big data solutions using Hadoop and Spark technologies.Work with cross-functional teams to understand business...

  • Senior Big Data Engineer

    3 days ago

    bangalore, India Veltris Full time

    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance. With a focus on innovation and acceleration, Veltris...

  • Big Data Engineers/Senior Engineers

    2 days ago

    Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Big Data Engineers/Senior Engineers

    19 hours ago

    Bengaluru, India Peoplelogic Full time

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Big Data Engineer Position

    2 weeks ago

    Chennai, Bengaluru / Bangalore, India beBeebigData Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data Engineer OpportunityWe are seeking a skilled Big Data Engineer to join our team. 4+ years of experience in Big Data technologies.This is a permanent position with competitive benefits.Our company offers a dynamic work environment and opportunities for growth and development.

  • Senior Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Guide&Bridge Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title: Senior Big Data EngineerExperience Required: 3+ YearsAbout the RoleWe are looking for an experiencedSenior Big Data Engineerto design, build, and optimize large-scale data pipelines and platforms. The ideal candidate will have strong expertise in distributed data processing, cloud-based data solutions, and a proven ability to work with complex...

  • Big Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to lead our data engineering team and drive the development of scalable, secure, and high-performance big data solutions.Experience in leading distributed teams across multiple geographies and time zones is essential.Strong technical expertise in Scala, Python, Apache Spark...

  • Senior Big Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewSummary of the Role:As a senior data engineering professional, you will play a crucial role in designing, developing, and maintaining large-scale data processing systems. This is an excellent opportunity to utilize your technical expertise in Big Data technologies and work closely with cross-functional teams to drive business growth through...

  • Senior Big Data Engineer

    4 days ago

    Delhi, India Veltris Full time

    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance.With a focus on innovation and acceleration, Veltris...