Big Data Developer

4 weeks ago

Gulbarga, Karnataka, India DigiHelic Solutions Pvt. Ltd. Full time

Job description

Key Responsibilities:

  • Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.
  • Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.
  • PySpark Development: Develop and implement efficient ETL processes using PySpark to extract, transform, and load large datasets.
  • Performance Optimization: Optimize PySpark applications for better performance, scalability, and resource management.

Qualifications:

  • Proven experience as a Big Data Engineer with a strong focus on PySpark.
  • Deep understanding of Big Data processing frameworks and technologies.
  • Strong proficiency in PySpark for developing and optimizing ETL processes and data transformations.
  • Experience with distributed computing and parallel processing.
  • Ability to collaborate in a fast-paced, innovative environment.

Skills

PySpark, Big Data, Python.

  • Senior Big Data Solutions Developer

    1 day ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineer RoleWe are seeking a highly skilled Data Engineer to join our team and contribute to the development of innovative big data engineering solutions. The ideal candidate will have expertise in cloud technologies, data processing architectures, and data pipelines.Key Responsibilities:Design, build, and maintain robust data pipelines for...

  • Visionary Big Data Engineer

    5 days ago

    Gulbarga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a seasoned Big Data Solutions Architect to spearhead the development of large-scale data processing systems.The ideal candidate will have 8-15 years of experience in designing and implementing big data engineering solutions using technologies such as Apache Spark, Hadoop, Hive, and NoSQL databases.Key skills required include:

  • Big Data Engineer

    5 days ago

    Gulbarga, Karnataka, India Tata Consultancy Services Full time

    Greetings from TCSTCS is hiring for Big Data Location: - Chennai/Mumbai/PuneDesired Experience Range: 6 to 12 yearsMust-Have • PySpark • HiveGood-to-Have• Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika

  • Lead Big Data Engineer

    17 minutes ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    About the Role:This position requires a highly skilled data engineer to develop efficient and scalable data pipelines, perform integration testing, and provide estimates for development, testing & deployments.Key Responsibilities:Design and implement high-quality data pipelines that support increasing data volume and complexityCollaborate with analytics and...

  • Senior Big Data Architect

    6 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer OpportunityWe are seeking a highly skilled Big Data Engineer to join our data engineering team. The ideal candidate will have expertise in Scala, Spark, Python, NiFi, and Apache Kafka.The role involves designing, developing, and optimizing large-scale data pipelines and distributed data processing systems. Strong experience in cloud-based...

  • Big Data Solutions Architect

    4 minutes ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionWe are seeking an experienced Data Engineer to design and implement big data solutions.The ideal candidate will have expertise in distributed computing principles, Apache Spark, and Python programming.Key responsibilities include designing and implementing big data solutions using technologies like Apache Spark, Hadoop, and NoSQL...

  • Chief Big Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineering Full time US$ 80,000 - US$ 1,40,000

    Big Data EngineerThe role involves working on large-scale data processing systems, leveraging expertise in Big Data technologies to drive business growth.Required Skills and Qualifications:Proficiency in Python programming language

  • Big Data Cloud Specialist

    2 days ago

    Gulbarga, Karnataka, India beBeeCloud Full time ₹ 36,00,000 - ₹ 48,00,000

    Job Title: Cloud Architect for Big Data SolutionsJob Description:We are seeking a highly skilled Cloud Architect with expertise in Big Data management and data quality to join our team. As a key member of our organization, you will be responsible for designing and implementing scalable cloud-based solutions that meet the needs of our clients.The ideal...

  • Senior Big Data Technology Expert

    1 day ago

    Gulbarga, Karnataka, India beBeeBigData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Big Data Specialist OpportunityThe ideal candidate for this role will possess a thorough understanding of big data ecosystem tools, including Scala, Spark, Hive, and Hadoop. They should also have expertise in strong SQL experience and be able to develop, tweak queries, and work on performance enhancement.

  • Big Data Solutions Specialist

    17 minutes ago

    Gulbarga, Karnataka, India beBeeData Full time US$ 7,50,000 - US$ 15,00,000

    Role SummaryWe are seeking a highly skilled Big Data Developer to join our data engineering team. As a key member of the team, you will be responsible for designing, developing, and deploying large-scale data processing systems.Key ResponsibilitiesDesign and develop scalable data processing systemsDevelop and implement efficient algorithms for data...