Big Data Developer

2 weeks ago

Nagpur, Maharashtra, India DigiHelic Solutions Pvt. Ltd. Full time

Job description

Key Responsibilities:

  • Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.
  • Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.
  • PySpark Development: Develop and implement efficient ETL processes using PySpark to extract, transform, and load large datasets.
  • Performance Optimization: Optimize PySpark applications for better performance, scalability, and resource management.

Qualifications:

  • Proven experience as a Big Data Engineer with a strong focus on PySpark.
  • Deep understanding of Big Data processing frameworks and technologies.
  • Strong proficiency in PySpark for developing and optimizing ETL processes and data transformations.
  • Experience with distributed computing and parallel processing.
  • Ability to collaborate in a fast-paced, innovative environment.

Skills

PySpark, Big Data, Python.

  • Big Data Developer

    3 weeks ago

    Nagpur, Maharashtra, India HCLTech Full time

    Position: Big Data DeveloperExperience: 3 - 7 yearLocation: Nagpur, MHResponsibilities:- Preferred Skillset: Spark, Scala, Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.), SQL, Jenkins, and Unix Commands.- Experience in Big data technologies , real time data processing platform(Spark Streaming - Kafka) experience in Cloudera would be an...

  • Big Data Developer

    2 weeks ago

    Nagpur, Maharashtra, India HCLTech Full time

    Position: Big Data Developer Experience: 3 - 7 year Location: Nagpur, MH Responsibilities: Preferred Skillset: Spark, Scala , Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.), SQL, Jenkins, and Unix Commands. Experience in Big data technologies , real time data processing platform(Spark Streaming - Kafka) experience in Cloudera would be an...

  • Big Data Developer

    3 weeks ago

    Nagpur, Maharashtra, India HCLTech Full time

    Position: Big Data (Senior Developer / Lead) Experience: 4 - 9 years Location: Nagpur Responsibilities: Preferred Skillset: Spark, Scala , Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.), SQL, Jenkins. Experience in Big data technologies , real time data processing platform (Spark Streaming - Kafka). Experience in Cloudera would be an...

  • Big Data Developer

    4 days ago

    Nagpur, Maharashtra, India HCLTech Full time

    Position: Big Data DeveloperExperience: 3 - 7 yearLocation: Nagpur, MHResponsibilities:Preferred Skillset: Spark, Scala , Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.), SQL, Jenkins, and Unix Commands.Experience in Big data technologies , real time data processing platform(Spark Streaming - Kafka) experience in Cloudera would be an...

  • Big Data Development Opportunities

    2 days ago

    Nagpur, Maharashtra, India beBeeDataDeveloper Full time ₹ 18,00,000 - ₹ 21,00,000

    Big Data Developer PositionAbout the Role:We are looking for a skilled data professional to take on the role of big data developer. The ideal candidate will have hands-on experience with big data technologies, including Hadoop Ecosystem, Spark, and Scala.Strong foundation in computer science fundamentals: data structures, algorithms, and coding skills.Prior...

  • High-Performance Big Data Professional

    2 days ago

    Nagpur, Maharashtra, India beBeeBigDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Big Data Engineering Role">We are looking for a talented Big Data Engineer to join our team. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

  • Transforming Data into Insights

    2 days ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer PositionJob Summary:This is an exciting opportunity for a skilled Big Data Engineer to join our team in designing, developing, and implementing scalable data processing systems.Key Responsibilities:Design and develop complex big data processing pipelines using PySpark.Work with distributed data storage systems such as HDFS and S3.Develop...

  • Data Engineer

    2 weeks ago

    Nagpur, Maharashtra, India Quess IT Staffing Full time

    Hi All, Greeting We have hirings at Gurugram Location for following role: Hands on in SQL and its Big Data variants (Hive-QL, Snowflake ANSI, Redshift SQL) Python and Spark and one or more of its API (PySpark, Spark SQL, Scala), Bash/Shell scripting Experience with Source code control - GitHub, VSTS etc. Knowledge and exposure to Big Data technologies Hadoop...

  • Full Stack Data Engineer

    15 hours ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Informatica BDM/DEI DeveloperAs a skilled ETL developer, you will be responsible for designing, developing and testing of ETL architecture, transformation jobs and workflow schedules using Informatica BDM/DEI.Design and develop scalable ETL workflows using Informatica BDM/DEI.Integrate data from structured and unstructured sources including big data...

  • Data Engineer

    3 weeks ago

    Nagpur, Maharashtra, India Live Connections Full time

    Position: Data Engineer – Big Data & Azure Location: Bangalore, IndiaRole Purpose: We are seeking a highly skilled Data Engineer with expertise in Big Data, Python, and PySpark to design, develop, and optimize large-scale data solutions on Azure. The role involves working with complex structured and unstructured datasets to deliver high-quality analytics...