Big Data Expert

2 days ago

Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000
Job Title: Big Data Expert

This is a remote contract role that seeks a highly motivated data engineer with expertise in building, optimizing, and maintaining large-scale data processing solutions.

Location: India. Remote. Job type: Contract

Key Responsibilities:
  • Design, develop, and optimize data pipelines using big data technologies like PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.
Required Skills & Qualifications:
  • 3–4 years of experience in data engineering with a focus on big data technologies.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.
Benefits:

The ideal candidate will have the opportunity to work on challenging projects, collaborate with experienced professionals, and grow professionally.

  • Big Data Developer

    20 hours ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ExpertAbout the Role:We are looking for a highly skilled Data Engineer with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data...

  • Chief Big Data Architect

    5 days ago

    Nagpur, Maharashtra, India beBeeCloudDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,10,00,000

    Big Data ExpertJob OverviewA seasoned professional with a strong background in big data technologies is required to spearhead the development and implementation of cutting-edge solutions.Key ResponsibilitiesDesign and develop scalable architectures for big data processing using Hadoop, Spark, and No-SQL databases.Collaborate with cross-functional teams to...

  • Big Data Professional

    2 days ago

    Nagpur, Maharashtra, India beBeeBigData Full time ₹ 30,00,000 - ₹ 50,00,000

    About the Big Data RoleWe are seeking an experienced professional to design, develop and implement big data solutions using cutting-edge technologies.Key responsibilities include developing and implementing scalable data architectures, ensuring high-performance data processing, and collaborating with cross-functional teams to drive business outcomes.Our...

  • Big Data Developer

    3 weeks ago

    Nagpur, Maharashtra, India DigiHelic Solutions Pvt. Ltd. Full time

    Job descriptionKey Responsibilities:Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.PySpark Development: Develop and implement efficient ETL...

  • Big Data Engineer

    6 days ago

    Nagpur, Maharashtra, India Naukri E Hire Campaign Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role- Big dataExperience- 3 to 5 yrsLocation- NagpurInterview mode- 2 Virtual roundNotice period- 30 daysInterview date- 23rd AugJob Summary:We are looking for a skilled Big Data Developer with strong expertise in Apache Spark, Scala, and Linux to join our dynamic data engineering team. The ideal candidate will design, develop, and maintain big data...

  • Big Data Developer

    1 day ago

    Nagpur, Maharashtra, India Naukri E Hire Campaign Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Roles and Responsibilities :Design, develop, test, deploy and maintain large-scale big data solutions using Scala and Spark.Collaborate with cross-functional teams to gather requirements and deliver high-quality software products.Troubleshoot complex issues related to big data processing pipelines and provide timely resolutions.Stay up-to-date with industry...

  • Big Data Professional

    3 days ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data EngineerDesign and implement large-scale data processing systems using big data technologies.Develop scalable data pipelines using Spark, Scala, and Linux-based Hadoop Ecosystem.Implement real-time data processing platforms using Spark Streaming and Kafka.Collaborate with cross-functional teams to identify technical requirements.Ensure high-quality...

  • Big Data Developer

    2 weeks ago

    Nagpur, Maharashtra, India HCLTech Full time

    Position: Big Data DeveloperExperience: 3 - 7 yearLocation: Nagpur, MHResponsibilities:Preferred Skillset: Spark, Scala , Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.), SQL, Jenkins, and Unix Commands.Experience in Big data technologies , real time data processing platform(Spark Streaming - Kafka) experience in Cloudera would be an...

  • Big Data Solutions Developer

    1 week ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Engineer Job Description:">This role involves designing and developing large-scale data processing systems using Big Data technologies. We are seeking a highly skilled engineer to join our team.">Key Responsibilities:">">Develop data ingestion pipelines to collect data from disparate sources onto the Big Data platform.">Collaborate with...

  • Big Data Developer

    4 weeks ago

    Nagpur, Maharashtra, India HCLTech Full time

    Position: Big Data DeveloperExperience: 3 - 7 yearLocation: Nagpur, MHResponsibilities:- Preferred Skillset: Spark, Scala, Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.), SQL, Jenkins, and Unix Commands.- Experience in Big data technologies , real time data processing platform(Spark Streaming - Kafka) experience in Cloudera would be an...