Big Data Developer

2 days ago

Gurgaon, Haryana, India Kezan Inc Full time ₹ 16,90,000 per year

Position: Big Data Engineer

Experience: 5+ Years

Location: ( Gurugram / Bangalore )

Joining: Immediate Joiner

Budget=16.5 LPA

Job Summary:

We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate will have expertise in building data pipelines, data warehousing, and data processing applications.

Key Responsibilities:

  • Data Warehousing:
  • Design, develop, and maintain large-scale data warehouses using Amazon Redshift
  • Optimize Redshift cluster performance, scalability, and cost-effectiveness
  • Data Pipelines:
  • Build and maintain data pipelines using Apache Spark, Scala, and AWS services like S3, Glue, and Lambda
  • Ensure data quality, integrity, and security across the data pipeline
  • Data Processing:
  • Develop and optimize data processing applications using Spark, Scala, and AWS services
  • Work with data scientists and analysts to develop predictive models and perform advanced analytics
  • AWS Services:
  • Leverage AWS services like S3, Glue, Lambda, and IAM to build scalable and secure data systems
  • Ensure data systems are highly available, scalable, and fault-tolerant
  • Troubleshooting and Optimization:
  • Troubleshoot and optimize data pipeline performance issues
  • Ensure data systems are optimized for cost, performance, and scalability

Requirements:

  • Experience: 5+ years of experience in big data engineering or a related field
  • Technical Skills:
  • Proficiency in Amazon Redshift, Apache Spark, and Scala
  • Experience with AWS services like S3, Glue, Lambda, and IAM
  • Knowledge of data processing frameworks like Spark and data storage solutions like S3 and Redshift
  • Data Architecture: Strong understanding of data architecture principles and design patterns
  • Problem-Solving: Excellent problem-solving skills and attention to detail

Preferred Qualifications:

  • Certifications: AWS Certified Big Data - Specialty or similar certifications
  • Machine Learning: Familiarity with machine learning frameworks like Spark MLlib or TensorFlow
  • Agile Methodology: Experience working in agile development environments
  • Data Governance: Experience with data governance, data quality, and data security

What We Offer:

  • Competitive salary and benefits package
  • Opportunities for professional development and growth
  • Collaborative and dynamic work environment
  • Flexible work arrangements

  • Big Data Developer

    4 days ago

    Gurgaon, Haryana, India Intraedge Technologies Ltd. Full time

    Job Title : Big Data Developer (Java/Python)Location : Chennai, Bangalore, GurugramExperience Required : 5+ years (5 to 15 yrs)Joining : Immediate or Early Joiners PreferredEmployment Type : Full-timeJob Summary : We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big Data Developer

    3 days ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Position: Big Data Engineer ( Immediate Joiner)Experience: 5+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerBudget LPAJob Summary:We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate...

  • Big Data Tester

    3 days ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Tester (SQL)Experience:3+YearsLocation:[Gurugram/Bangalore]Employment Type:Full-TimeJob Summary:We are seeking a highly skilledBig Data Tester with strong SQL expertiseto join our team. The ideal candidate will be responsible for validating, testing, and ensuring the quality of large-scale data pipelines, data lakes, and big data...

  • Big Data Tester

    2 days ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 11,00,000 per year

    Big Data Tester (AWS + SQL) (Immediate joiner)Location:Gurugram / Bangalore (Hybrid)Experience:4–7 YearsBudget:Up to ₹11 LPAAbout the Role:We are looking for a skilled and detail-orientedBig Data Testerwith expertise inAWSandSQLto join our growing team. This role requires hands-on experience in data validation, test automation for big data pipelines, and...

  • Big Data Strategist

    4 days ago

    Gurgaon, Haryana, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AWS Data Architect RoleKey characteristics of a successful AWS Data Architect include hands-on experience in Big Data and Cloud Technologies. The ideal candidate will possess expertise in designing and developing applications using Big Data, DWH, Cloud technologies, ETL, SQL.Primary Responsibilities:Develop a modernization approach and strategy for the...

  • Big Data Engineer

    1 day ago

    Gurgaon, Haryana, India Infogain Full time

    Posted on August 17 2024ROLES RESPONSIBILITIESBig Data Engineer Senior As a Big Data Engineer Senior you will be responsible for designing and implementing complex big data solutions You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs You will also be responsible for...

  • Big Data Architect

    4 days ago

    Gurgaon, Haryana, India beBeeData Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    Senior Data Engineer PositionWe're seeking an experienced Senior Big Data Engineer to spearhead the design, development, and implementation of large-scale data systems using Redshift, AWS, Spark, and Scala.Data Architecture- Design and develop large-scale data warehouses using Amazon Redshift to maximize efficiency and scalability.- Optimize Redshift cluster...

  • Big Data Engineer

    3 days ago

    Gurgaon, Haryana, India Insight Global Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Pay Range: LPA (INR)Required Qualifications:3–5 years of hands-on experience in Big Data engineering.Proficiency in Python (Java is a plus).Strong understanding of Google Cloud Platform (GCP) services and architecture. GCP certification is a plus.Solid problem-solving skills and a structured thought process.Experience with data migration and...

  • Big Data Engineer

    4 days ago

    Gurgaon, Haryana, India beBeeData Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Cloud Engineering Lead">We are looking for a Cloud Engineering Lead to drive the design and implementation of scalable, secure, and high-performance cloud-based big data solutions. As a key member of our team, you will be responsible for leading the development and deployment of cloud-native technologies and architectures.">Develop and implement cloud...

  • Big Data Expert

    3 days ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Big Data ExpertWe are seeking a skilled data engineer with expertise in designing and developing scalable data pipelines using cloud-based technologies.Key Responsibilities:Data Pipeline Design: Develop end-to-end scalable data pipelines that meet business requirements.Cross-Functional Collaboration: Collaborate with cross-functional teams to...