Apache Spark

5 days ago

Gurgaon, Haryana, India ICS Consultancy Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year


Job Description:

Project Role : Application Developer  Project Role Description : Design, build and configure applications to meet business process and application requirements Must have Skills : Apache Spark  Good to Have Skills :  Microsoft SQL Server,Unix to Linux Migration,Data Warehouse ETL Testing,Amazon Web Service  Job Requirements :    Key Responsibilities :   A:Resource needs to be conversant with Apache Spark architecture, RDDs, various transformations and actions, spark configuration and tuning techniques B:Must have the Ability to work on Hadoop architecture; execution engines, frameworks, applications tools  C:Should be able to work on Pyspark using Spark MLlib library  D:Must be able to deliver Data warehousing concepts methods    Technical Experience :   A:Should have 4-5 years of experience using PySpark with Apache Spark RDDs Spark SQL DataFrames  B: Should have 2-3 years of experience in AWS Sagemaker and AWS Glue  C: Should have 3-4 years of experience in data wrangling and data analysis with Pandas and Numpy  D:Should have 3-4 years of Working experience with ML algorithms like Random Forest, Linear Regression, Logistic Regression, Decision Trees, K Means etc    Professional Attributes :   A: Should have good communication and analytical skills    Educational Qualification :       Additional Information :   A: Should have good communication and analytical skills


  • Data Lakehouse Engineer

    1 week ago

    Gurgaon, Haryana, India Mindstech Full time ₹ 8,33,333 - ₹ 25,00,000 per year

    8 yrs. in software development background, with major experience in intense:Business requirements analysis and data modellingData querying, particularly with SQL query enginesBig data analytics data processing,data lake / lakehouse architecture Required Candidate profileHands-on experience of Big Data opensource technologies :Apache KafkaApache PekkoApache...

  • Big Data Developer

    4 days ago

    Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About The OpportunityA staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.We are hiring an...

  • Manager

    2 weeks ago

    Gurgaon, Haryana, India EXL Talent Acquisition Team Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    J ob Title: Senior Data Engineer – Big Data, ETL & Java Experience Level: 5 + Years Employment Type: Full - time About the Role EXL is seeking a Senior Software Engineer with a strong foundation in Java , along with expertise in Big Data technologies and ETL development . In this role, you'll design and implement scalable, high - performance data and...

  • 3563942-Manager

    7 days ago

    Gurgaon, Haryana, India EXL Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    DescriptionJ ob Title: Senior Data Engineer – Big Data, ETL & Java Experience Level: 5 + Years Employment Type: Full - time About the Role EXL is seeking a Senior Software Engineer with a strong foundation in Java , along with expertise in Big Data technologies and ETL development . In this role, you'll design and implement scalable, high - performance...

  • Data Engineer

    1 day ago

    Gurgaon, Haryana, India InsuranceDekho Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    DescriptionStrong proficiency in Python for data processing and ETLAdvanced SQL skills, including query optimization, indexing, joins, and analytical functionsHands-on experience with ClickHouse, MongoDB, Redis, and ElasticSearchProficiency in Apache Spark/PySpark and working with data lakesExperience with ETL and data ingestion tools such as Apache...

  • Azure Data Engineer

    2 days ago

    Gurgaon, Haryana, India Infogain Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    ROLES & RESPONSIBILITIESKey ResponsibilitiesAnalyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark.Implement data ingestion and transformation pipelines using Delta Lake best practices.Apply conversion rules and templates for automated code migration and testing.Conduct data validation between legacy...

  • sapient - Hadoop

    7 days ago

    Gurgaon, Haryana, India SQUIRCLE IT CONSULTING SERVICES Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company Description Squircle IT Consulting Services is a leading IT solutions and servicesBangalore company established with a specific mission of providing comprehensive, top of the line solutions around ERP and BI. Since its inception in November, 2007, SQUIRCLE has emerged as a key player in ERP and BI space. SQUIRCLE brings together the best...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India kevell Corp Full time ₹ 60,200 - ₹ 20,00,978 per year

    Position: Data EngineerSummary: Seeking a passionate Data Engineer (2–3 years' experience) to build scalable data solutions. Must have expertise in Spark (Scala), Java, AWS EMR, and AWS Glue, with end-to-end data pipeline exposure. Oracle ERP migration experience is a plus.Key Responsibilities· Design, build, and optimize scalable data pipelines on AWS...

  • Manager - Data Lake and Data Architecture - Primary AWS, Secondary Azure, Good to have GCP

    7 days ago

    Gurgaon, Haryana, India Sirius AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities:Data Architecture & Management: Design and implement scalable, cloud-agnostic Data Lake, Data LakeHouse, Data Mesh and Data Fabric architectures to efficiently store, process, and manage structured and unstructured data from various sources.Data Pipeline Development : Design, develop, and maintain robust data pipelines to ingest,...

  • Principal Engineer

    7 days ago

    Gurgaon, Haryana, India Airtel International Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are looking for a hands-on Principal Engineer with a strong background in system design and architecture, coupled with excellent coding skills. The ideal candidate will be proficient in Java (specifically in distributed architectures without reliance on Spring Boot or microservices frameworks) or have solid experience in C or C++. Experience with Big Data...