Big Data Expertise Wanted

17 hours ago

Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Job Title: Data Engineer

About the Role:

We are seeking an experienced Data Engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing data pipelines, and hands-on experience in distributed data systems.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

Mandatory Skills:

  • Scala - Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

What We Offer:

  • A challenging role in a dynamic environment.
  • Opportunities for professional growth and development.
  • A collaborative and innovative work culture.

  • Big Data Administrator

    17 hours ago

    Shimoga, Karnataka, India beBeeDataAdministrator Full time ₹ 25,00,000 - ₹ 40,00,000

    Job Title: Big Data AdministratorAbout Our Client:We are a leading technology consulting and digital solutions company that empowers enterprises to innovate through digital technologies.With over 84,000 professionals across more than 30 countries, we cater to numerous clients with our extensive domain and technology expertise.Key responsibilities include...

  • Big Data Analyst

    2 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    About the RoleWe are seeking an experienced data analyst to spearhead our big data initiatives. The ideal candidate will have hands-on experience with programming languages such as Java and Scala, utilizing frameworks like Maven, Apache Spark, and Unix Shell scripting.Key Responsibilities:Design and develop scalable big data solutions using technologies like...

  • Big Data Innovator

    4 days ago

    Shimoga, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 1,60,000

    Your potential unleashed.We present an opportunity to unleash and realise your potential amongst cutting-edge leaders, and organisations shaping the future of the region, and indeed, the world beyond. As a data engineer, you will work with a talented team to drive innovation and solve complex business problems using big data...

  • Big Data Expert

    1 week ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    **Unlocking Big Data Opportunities:**We are seeking a highly skilled data expert to design and develop innovative solutions that drive business growth.Essential Skills:PySparkHiveDesirable Skills:SparkHBaseData Quality ToolsAgile Methodologies ExperienceExposure in Data Ingestion from Various Sources onto Big Data PlatformsRequirements:A minimum of 6-12...

  • Big Data Specialist

    5 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data SpecialistDuration: Full-time OpportunityLocation: Shivamogga, India (Work from office)Key Responsibilities:Design and develop large-scale data processing architectures using SQL, Python, PySpark, and Linux.Implement complex data pipelines and distributed systems to handle high-velocity data streams effectively.Collaborate with...

  • Big Data Development Lead

    17 hours ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionKey Responsibilities:Lead the development of scalable, high-performance data pipelines using Hadoop, Spark, Hive, HDFS, and Kafka.Collaborate with junior engineers to guide them on coding standards, best practices, debugging, and project execution.Review code and provide feedback to junior engineers to maintain high quality and...

  • Big Data Expert

    4 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are currently hiring a Data Specialist to join our team. This role is ideal for professionals with 6-12 years of experience in Big Data technologies.This position requires extensive knowledge of data structures and algorithms.Key Skills We're Looking For:Mastery of Big Data tools including PySpark, Scala Spark, and Java Spark SQL.Experience in building...

  • Big Data Engineering Solution Specialist

    1 week ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Solution Architect for Big Data EngineeringWe are seeking an experienced Solution Architect to lead the design and implementation of large-scale data engineering solutions. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Data Factory, Synapse, Fabric, and Databricks. Additionally, they should have...

  • Big Data Engineering Leader

    5 days ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Big Data Engineering LeaderJob Title: Big Data Engineering LeaderLocation: Shivamogga, IndiaJob DescriptionWe are seeking a highly experienced leader to spearhead our data engineering efforts. The successful candidate will have a proven track record of leading cross-functional teams and working on large-scale distributed systems.Key Responsibilities:Leading...

  • Cloud Architect

    4 days ago

    Shimoga, Karnataka, India beBeeBigData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled Cloud Architect to lead the design and implementation of our Big Data architecture.This is an exceptional opportunity to work with a talented team and contribute to the development of innovative data management solutions.Key Responsibilities:Design and implement scalable cloud-based architectures for Big Data...