Principal Data Engineer

1 day ago


Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Title: Big Data Engineer

Location:

  • Bangalore
  • Chennai
  • Gurgaon
  • Pune
  • Mumbai
Experience:
  • 7–10 Years

We are seeking an experienced Big Data Architect to join our data engineering team. The ideal candidate will have a proven track record in designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.

The successful candidate will work extensively with Scala, Spark (PySpark), and Python for data processing and transformation. They will also develop and integrate streaming solutions using Apollo Kafka and orchestration tools like NiFi/Airflow.

Key Responsibilities:
  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apollo Kafka and orchestration tools like NiFi/Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.
Required Skills:
  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.
Preferred Skills:
  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.


  • Dindigul, Tamil Nadu, India beBeeMLOps Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionObjective: Skillful MLOps EngineerWe are seeking a seasoned professional for the role of MLOps Engineer with at least 3 years of experience.Responsibilities:To effectively implement and maintain machine learning pipelines within our infrastructureTo integrate multiple data sources, both internal and external, to support the development of AI...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Data EngineerWe are seeking highly skilled and motivated data engineers to join our team.This is a unique opportunity for you to leverage your technical expertise and passion for data-driven solutions in a fast-paced environment.In this role, you will play a critical part in designing, implementing, and maintaining our data infrastructure to...


  • Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Engineer RoleWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Job DescriptionThe ideal candidate will have a strong background in computer science or a related field, with at least 3-6 years of experience...


  • Dindigul, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Expert Data Engineer SoughtWe are on the lookout for a seasoned Senior Data Engineer to spearhead our cutting-edge data platform.This role is ideal for an individual with in-depth technical expertise in ETL pipeline design, data modeling, and data infrastructure who thrives in a dynamic, engineering-driven environment.You'll be responsible for working across...


  • Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering Role OverviewAs a key team member, you will play a vital part in developing and refining data pipelines. Your expertise is crucial in ensuring that data is reliable, secure, and accessible for analytics and operations.This role offers the opportunity to work autonomously while being part of a dynamic team, tackling diverse challenges daily...


  • Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Summary:Seeking an experienced and strategic Data Engineering Manager to lead a team of talented data engineers in designing and delivering scalable data pipelines and analytics platforms. About the Role:The ideal candidate will oversee the development of end-to-end data solutions using Azure Data Services and Databricks, collaborating with...

  • Cloud Data Engineer

    13 hours ago


    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Engineer RoleWe seek a skilled Cloud Data Engineer to develop and maintain large-scale data processing systems.Design, implement, and manage scalable data pipelines on cloud platforms.Collaborate with cross-functional teams to identify business needs and provide innovative solutions.Develop ETL processes using Python and other tools to ensure...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data EngineerThe ideal candidate for this role will have extensive knowledge of data engineering principles and experience in developing scalable data pipelines.Develop complex algorithms that provide unique insights into our data, working closely with the data science team.Implement agile software development processes to make iterative...


  • Dindigul, Tamil Nadu, India beBeeEngineering Full time ₹ 25,00,000 - ₹ 40,00,000

    About This RoleWe are seeking an experienced software development professional to contribute to the design and implementation of a manufacturing data model.This is an opportunity to join a global development group working with cross-functional teams in various locations around the world.Key ResponsibilitiesDesign, develop, and validate modules/components of...


  • Dindigul, Tamil Nadu, India VeriPark Full time

    Principal Business Analyst – LOSWe enable financial institutions to become digital leaders. As a professional team of global scale, we work with best clients for great and exciting projects, in an environment where we learn amazing things every day.Each code, each voice, each contribution, each challenge, each success is celebrated here.We welcome...