High-Impact Big Data Pipeline Development Position

1 day ago

Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Big Data Pipeline Developer Role

We are seeking a highly skilled Big Data Pipeline Developer to design and optimize our distributed data pipelines, infrastructure, and tools that power insights across the business.

This is an exciting opportunity to work on high-impact projects shaping the future of data-driven technologies.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines and infrastructure.
  • Assemble and manage large, complex datasets from diverse sources.
  • Automate and optimize data processes for greater efficiency and scalability.
  • Develop and manage ETL workflows using SQL and cloud-based big data tools.
  • Build analytics tools to deliver actionable insights into business performance.
  • Collaborate with executives, product managers, architects, and analysts to meet evolving data needs.
  • Ensure data systems are secure, reliable, and high-performing.

Requirements:

  • 2–7 years of hands-on experience as a Big Data Pipeline Developer.
  • A graduate degree in Computer Science, IT, Statistics, or a related quantitative field.
  • Advanced knowledge of SQL and relational databases, with exposure to multiple database technologies.
  • Proven experience building and optimizing big data pipelines, architectures, and data sets.
  • Strong analytical skills, especially in handling unstructured datasets.
  • Working knowledge of cloud-based big data services (AWS, Azure, or GCP).
  • Familiarity with big data tools such as Hadoop, Spark, Kafka, etc.
  • Experience with ETL tools like Informatica, DataStage, or Azure Data Factory.
  • Knowledge of stream-processing systems like Storm or Spark Streaming.
  • Proficiency in scripting/programming languages such as Python, Java, or Scala.
  • Excellent communication skills and the ability to thrive in cross-functional teams.

  • High-Performance Data Pipeline Specialist

    1 week ago

    Shimoga, Karnataka, India beBeePerformance Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerThis role is ideal for a skilled professional who can design, build, and maintain high-performance data pipelines. Key Responsibilities: Design and implement scalable batch processing systems using Python and big data technologies Optimize database performance, focusing on slow-running queries and latency improvements Use...

  • Big Data Innovator

    3 days ago

    Shimoga, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 1,60,000

    Your potential unleashed.We present an opportunity to unleash and realise your potential amongst cutting-edge leaders, and organisations shaping the future of the region, and indeed, the world beyond. As a data engineer, you will work with a talented team to drive innovation and solve complex business problems using big data...

  • Big Data Analyst

    22 hours ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    About the RoleWe are seeking an experienced data analyst to spearhead our big data initiatives. The ideal candidate will have hands-on experience with programming languages such as Java and Scala, utilizing frameworks like Maven, Apache Spark, and Unix Shell scripting.Key Responsibilities:Design and develop scalable big data solutions using technologies like...

  • Big Data Specialist

    3 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data SpecialistDuration: Full-time OpportunityLocation: Shivamogga, India (Work from office)Key Responsibilities:Design and develop large-scale data processing architectures using SQL, Python, PySpark, and Linux.Implement complex data pipelines and distributed systems to handle high-velocity data streams effectively.Collaborate with...

  • Big Data Expert

    3 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are currently hiring a Data Specialist to join our team. This role is ideal for professionals with 6-12 years of experience in Big Data technologies.This position requires extensive knowledge of data structures and algorithms.Key Skills We're Looking For:Mastery of Big Data tools including PySpark, Scala Spark, and Java Spark SQL.Experience in building...

  • Big Data Solutions Architect

    3 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Databricks EngineerWe are seeking an experienced professional to design, develop and maintain scalable, high-performance data solutions using Databricks.The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture. They will work with cross-functional teams to create robust...

  • Data Pipeline Specialist

    5 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline SpecialistAbout the Role:We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining production-level data pipelines that handle large volumes of structured and unstructured data.Key Responsibilities:Design and implement end-to-end ETL/ELT processes to...

  • High-Performance Data Specialist

    19 hours ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 15,30,000 - ₹ 25,34,000

    Senior Data EngineerThis is a high-performance data pipeline role that requires expertise in scalable batch processing systems using Python and big data technologies.The ideal candidate will have a strong analytical mindset, excellent problem-solving skills, and the ability to work effectively in a collaborative team environment.A bachelor's degree in...

  • Unlock the Potential of Big Data: Senior Data Engineer Position

    5 days ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 1,30,17,368 - ₹ 2,09,28,996

    Senior Data EngineerThis is a high-level position that requires in-depth knowledge of data engineering principles and practices.The ideal candidate should have extensive experience with designing, building, and maintaining large-scale data pipelines using technologies such as Apache Spark and Python.Key Responsibilities:Design, build, and optimize complex...

  • Big Data Engineer

    14 hours ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    About this role: Our team is seeking a seasoned professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions.**Job Summary**We are looking for a skilled data engineer to lead the development of our data analytics platform. The ideal candidate will have a strong background...