Big Data Developer

6 days ago

Bengaluru, India Kezan Consulting Full time

Position : Big Data Engineer (Immediate Joiner)

Experience : 5+ Years

Location : (Gurugram / Bangalore)

Joining : Immediate Joiner

Job Summary :

We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala.

The ideal candidate will have expertise in building data pipelines, data warehousing, and data processing applications.

Key Responsibilities :

Data Warehousing :

- Design, develop, and maintain large-scale data warehouses using Amazon Redshift.

- Optimize Redshift cluster performance, scalability, and cost-effectiveness.

Data Pipelines :

- Build and maintain data pipelines using Apache Spark, Scala, and AWS services like S3, Glue, and Lambda.

- Ensure data quality, integrity, and security across the data pipeline.

Data Processing :

- Develop and optimize data processing applications using Spark, Scala, and AWS services.

- Work with data scientists and analysts to develop predictive models and perform advanced analytics.

AWS Services :

- Leverage AWS services like S3, Glue, Lambda, and IAM to build scalable and secure data systems.

- Ensure data systems are highly available, scalable, and and Optimization :

- Troubleshoot and optimize data pipeline performance issues.

- Ensure data systems are optimized for cost, performance, and scalability.

Requirements :

Experience : 5+ years of experience in big data engineering or a related field.

Technical Skills :

- Proficiency in Amazon Redshift, Apache Spark, and Scala.

- Experience with AWS services like S3, Glue, Lambda, and IAM.

- Knowledge of data processing frameworks like Spark and data storage solutions like S3 and Redshift.

Data Architecture : Strong understanding of data architecture principles and design patterns.

Problem-Solving : Excellent problem-solving skills and attention to detail.

Preferred Qualifications :

Certifications : AWS Certified Big Data Specialty or similar certifications.

Machine Learning : Familiarity with machine learning frameworks like Spark MLlib or TensorFlow.

Agile Methodology : Experience working in agile development environments.

Data Governance : Experience with data governance, data quality, and data security.


(ref:hirist.tech)

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tech Consulting Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Itss-big Data/hadoop/splunk Developer-humjp00032981

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 325776 We are currently seeking a ITSS-Big Data/Hadoop/Splunk Developer-HUMJP00032981 to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Azure Data Factory, Azure Synapse, and Databricks **About NTT DATA

  • Big Data Developer

    4 days ago

    Bengaluru, India LION AND ELEPHANTS Full time

    Job Description: We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi. Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...

  • Big Data Developer

    7 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob DescriptionHands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid understanding...

  • Big Basket

    2 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big data developer

    6 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, Py Spark, Spark SQL, HIVEJob DescriptionHands-on experience of Py Spark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid...

  • Big Basket

    2 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Big Data Developer

    3 weeks ago

    Bengaluru, Chennai, Pune, India Progressive Video Private Limited Full time

    Job DescriptionWe are seeking an experienced Big Data Developer with 57 years of hands-on expertise in designing, developing, and optimizing large-scale data processing systems. The ideal candidate will have strong proficiency in Scala, Hadoop, Hive, and Spark, along with a solid understanding of distributed computing and data engineering best practices.Key...

  • Senior Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeBigDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Big Data EngineerWe are seeking a skilled and innovative Big Data Engineer to join our team. This role involves designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data.Key Responsibilities:Data Pipeline Development: Design, build, and maintain robust and scalable ETL...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob Description- Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.- Strong SQL experience.- Should be able to develop, tweak queries and work on performance enhancement.- Solid...