Big Data Developer

1 day ago

Gurgaon, Haryana, India Kezan Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Position: Big Data Engineer

Experience: 5+ Years

Location: ( Gurugram / Bangalore )

Joining: Immediate Joiner

Budget=16.5 LPA

Job Summary:

We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate will have expertise in building data pipelines, data warehousing, and data processing applications.

Key Responsibilities:

  • Data Warehousing:
  • Design, develop, and maintain large-scale data warehouses using Amazon Redshift
  • Optimize Redshift cluster performance, scalability, and cost-effectiveness
  • Data Pipelines:
  • Build and maintain data pipelines using Apache Spark, Scala, and AWS services like S3, Glue, and Lambda
  • Ensure data quality, integrity, and security across the data pipeline
  • Data Processing:
  • Develop and optimize data processing applications using Spark, Scala, and AWS services
  • Work with data scientists and analysts to develop predictive models and perform advanced analytics
  • AWS Services:
  • Leverage AWS services like S3, Glue, Lambda, and IAM to build scalable and secure data systems
  • Ensure data systems are highly available, scalable, and fault-tolerant
  • Troubleshooting and Optimization:
  • Troubleshoot and optimize data pipeline performance issues
  • Ensure data systems are optimized for cost, performance, and scalability

Requirements:

  • Experience: 5+ years of experience in big data engineering or a related field
  • Technical Skills:
  • Proficiency in Amazon Redshift, Apache Spark, and Scala
  • Experience with AWS services like S3, Glue, Lambda, and IAM
  • Knowledge of data processing frameworks like Spark and data storage solutions like S3 and Redshift
  • Data Architecture: Strong understanding of data architecture principles and design patterns
  • Problem-Solving: Excellent problem-solving skills and attention to detail

Preferred Qualifications:

  • Certifications: AWS Certified Big Data - Specialty or similar certifications
  • Machine Learning: Familiarity with machine learning frameworks like Spark MLlib or TensorFlow
  • Agile Methodology: Experience working in agile development environments
  • Data Governance: Experience with data governance, data quality, and data security

What We Offer:

  • Competitive salary and benefits package
  • Opportunities for professional development and growth
  • Collaborative and dynamic work environment
  • Flexible work arrangements

  • Big Data Developer

    3 weeks ago

    Gurgaon, Haryana, India Intraedge Technologies Ltd. Full time

    Job Title : Big Data Developer (Java/Python)Location : Chennai, Bangalore, GurugramExperience Required : 5+ years (5 to 15 yrs)Joining : Immediate or Early Joiners PreferredEmployment Type : Full-timeJob Summary : We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big Data Developer

    1 day ago

    Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About The OpportunityA staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.We are hiring an...

  • Big Data Developer

    1 day ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: Big Data Engineer ( Immediate Joiner)Experience: 5+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerBudget LPAJob Summary:We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate...

  • Big Data Tester

    1 day ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 6,00,000 - ₹ 15,00,000 per year

    Job Title:Big Data Tester (SQL)Experience:3+YearsLocation:[Gurugram/Bangalore]Employment Type:Full-TimeJob Summary:We are seeking a highly skilledBig Data Tester with strong SQL expertiseto join our team. The ideal candidate will be responsible for validating, testing, and ensuring the quality of large-scale data pipelines, data lakes, and big data...

  • Big Data Tester

    23 hours ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 9,60,000 - ₹ 13,20,000 per year

    Big Data Tester (AWS + SQL) (Immediate joiner)Location:Gurugram / Bangalore (Hybrid)Experience:4–7 YearsBudget:Up to ₹11 LPAAbout the Role:We are looking for a skilled and detail-orientedBig Data Testerwith expertise inAWSandSQLto join our growing team. This role requires hands-on experience in data validation, test automation for big data pipelines, and...

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Infogain Full time

    Posted on August 17 2024ROLES RESPONSIBILITIESBig Data Engineer Senior As a Big Data Engineer Senior you will be responsible for designing and implementing complex big data solutions You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs You will also be responsible for...

  • Data Scientist/Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Techmora Full time

    Job Description : Data Science / Big Data EngineerLocation : Gurgaon / PuneEmployment Type : Full-timeNotice Period : 30 DaysExperience : 4-6 YearsAbout the Role :We are seeking a skilled Data Science / Big Data Engineer with strong expertise in data wrangling, large-scale data processing, and advanced analytics. The ideal candidate will have hands-on...

  • Big Data Engineer

    1 day ago

    Gurgaon, Haryana, India Insight Global Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Pay Range: LPA (INR)Required Qualifications:3–5 years of hands-on experience in Big Data engineering.Proficiency in Python (Java is a plus).Strong understanding of Google Cloud Platform (GCP) services and architecture. GCP certification is a plus.Solid problem-solving skills and a structured thought process.Experience with data migration and...

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Idyllic Services Pvt Ltd Full time

    Job Title : Big Data Engineer - ScalaExperience : 7 to 10Years (Minimum 3+ years in Scala)Notice Period : Immediate to 30 DaysRole Overview : We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track...

  • Big Data Automation QA

    1 day ago

    Gurgaon, Haryana, India Xcel HR Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Responsibilities: Develop and automate processes for gathering of expected results from data sources and comparing data results from testing.Assist with the development and maintenance of smoke, performance, functional, and regression tests to ensure code is functioning as designed.Work with the team to understand how changes in the DL affect maintenance of...