Lead Big Data Developer

4 days ago

Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000
Big Data Engineer

We are seeking a skilled big data engineer with experience in Databricks to design, build, and optimize large-scale data pipelines and processing solutions.

  • Develop and manage data pipelines using PySpark on Databricks.
  • Implement ETL/ELT processes to process structured and unstructured data at scale.
  • Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks.

Technical Requirements:

  • 4+ years of experience in data engineering or distributed systems development.
  • Strong programming skills in Python and PySpark.
  • Hands-on experience with Databricks and its ecosystem, including Delta Lake and Databricks SQL.

Additional Skills:

  • Knowledge of Hadoop, Spark, and Kafka frameworks.
  • Proficiency in setting up and managing Databricks Workspaces, Clusters, and Jobs.
  • Cloud Platforms: Expertise in deploying Databricks solutions on Azure (e.g., Data Lake, Synapse).

Education Requirements: A Bachelors Degree in Computer Science, Data Engineering, or a related field is preferred.
General Qualifications: Strong analytical and problem-solving skills. Ability to manage multiple tasks in a high-intensity, deadline-driven environment. Excellent communication and organizational skills.

  • Big Data Engineering Lead

    2 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to lead our data engineering team and drive the development of scalable, secure, and high-performance big data solutions.Experience in leading distributed teams across multiple geographies and time zones is essential.Strong technical expertise in Scala, Python, Apache Spark...

  • Big Data Engineering Lead

    4 days ago

    Chennai, Tamil Nadu, India Professional Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    The Senior Big Data engineering lead will play a pivotal role in designing, implementing, and optimizing large-scale data processing and analytics solutions. This role requires a visionary leader who can drive innovation, define architecture strategy, and ensure the scalability and efficiency of our big data infrastructure.Key Responsibilities Lead the...

  • Big Data Developer

    1 week ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    7 days ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal...

  • Big Data Developer

    19 hours ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Technical Lead

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Role: Big Data EngineerA dynamic and challenging opportunity has arisen for an experienced Big Data Engineer to join our organization.This role will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.The ideal candidate will have a strong...

  • Big Data Developer

    1 week ago

    Chennai, Tamil Nadu, India beBeeBigData Full time ₹ 9,00,000 - ₹ 12,00,000

    We're seeking experienced Big Data Developers with strong Python skills to contribute to our team's success.Key Responsibilities:Design and develop scalable data pipelines using PySpark and Python.Collaborate with cross-functional teams to implement data processing solutions.Develop expertise in Hadoop, Hive, Spark, and other Big Data technologies.Implement...

  • Big Data Developer

    5 days ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join...

  • Lead Big Data Professional

    2 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Are you passionate about working with big data?We are seeking a skilled Big Data Developer to join our team!Greetings from our organization, a global leader in the technology arena.We offer a challenging and rewarding career opportunity for a talented individual who can help us drive growth and innovation in the field of big data.About the Role:This is a...

  • Big Data Engineering Lead- C13

    3 weeks ago

    Chennai, Tamil Nadu, India Citigroup Full time

    The Senior Big Data engineering lead will play a pivotal role in designing implementing and optimizing large-scale data processing and analytics solutions This role requires a visionary leader who can drive innovation define architecture strategy and ensure the scalability and efficiency of our big data infrastructure Key Responsibilities Lead the...