Current jobs related to Scala & Hadoop Engineer - ETL/Data Ingestion - Anywhere in IndiaMultiple Locations - Taggd

  • Spark/Scala Developer

    3 months ago


    Anywhere in India/Multiple Locations Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...

  • Data Engineer

    21 hours ago


    Anywhere in India/Multiple Locations Stratosphere IT Services PVT Ltd Full time

    Role : Data Engineer (3rd party payroll) Experience : 4+ years Location : PAN India Notice : Immediate JOB DESCRIPTION : We are seeking a technologist with experience in system architecture and Java/Scala development with Big Data technology, to work on strategic and regulatory applications. You will be heavily involved in shaping the company's'...

  • Senior Data Engineer

    4 months ago


    Anywhere in India/Multiple Locations MindBrain Full time

    Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

  • Data Engineer

    3 months ago


    Anywhere in India/Multiple Locations Gama Advisory Services LLP Full time

    Overview :We are looking for a highly skilled Data Engineer with extensive experience in ETL (Extract, Transform, Load) processes and PySpark to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines that support data transformation and processing needs. Your expertise in PySpark and...

  • Big Data Engineer

    3 days ago


    Anywhere in India/Multiple Locations Salorix Consulting Full time

    Exp : 6+ yrs. Type : Contract. Mode : Remote. Candidate MUST have exp in Spark & Scala. Company Description : At Salorix, we offer reliable and strategic staffing solutions to align talent strategy with business strategy. Our focus is on driving businesses forward by understanding and meeting diversified and intricate HR needs. Role Description : This is a...

  • Azure Data Engineer

    3 days ago


    Anywhere in India/Multiple Locations Stratosphere IT Services PVT Ltd Full time

    Job Description :We are seeking a talented Azure Data Engineer with expertise in Azure Databricks and Scala to join our dynamic team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure on the Azure platform. You will collaborate closely with data...


  • India Maestro Technologies, Inc. Full time

    Technical Skills & Expertise:PySpark & Apache Spark:Extensive experience with PySpark and Spark for big data processing and transformation.Strong understanding of Spark architecture, optimization techniques, and performance tuning.Ability to work with Spark jobs in distributed computing environments like Databricks.Data Mining & Transformation:Hands-on...


  • India Maestro Technologies, Inc. Full time

    Technical Skills & Expertise: PySpark & Apache Spark: Extensive experience with PySpark and Spark for big data processing and transformation. Strong understanding of Spark architecture, optimization techniques, and performance tuning. Ability to work with Spark jobs in distributed computing environments like Databricks. Data Mining & Transformation: ...

  • Big Data

    1 week ago


    india Myananta Technologies Full time

    At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job descriptionFull-Time Big Data (Hadoop) DeveloperMyananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience: 3 - 5 Years.Salary: 5.0 - 12.0...

  • Data Engineer

    4 months ago


    Anywhere in India/Multiple Locations Circuit Compilers Full time

    Job Description : - 5 to 8 years in the build release management, software configuration, design, development, and cloud implementation. - Data Engineer with expertise in Python, Scala, PySpark, AWS S3, Glue, Redshift, Lambda, DBT, Serverless, Snowflake, SQL, Datalake, and Data Pipeline. - Leveraged AWS Glue for data cataloging, ETL job orchestration, and...

  • Big Data Developer

    7 days ago


    india Truelancer.com Full time

    Job Title: Java Spark Experience: 8+ yrs (4-5 Yrs in Java, 2-3 exp - Spark) Location: Chennai, Hyderabad, Pune, Mumbai, Bangalore, Gurugram Must Have: Advanced Java proficient, Microservices, Spring boot, Writing SQL Queries (proficient), AWS Good to have: Unix Shell scripting JD Minimum of 8 years of experience in building complex Data Platforms and...

  • Data Architect

    4 months ago


    Anywhere in India/Multiple Locations/Bangalore SGS Technical Services Pvt. Ltd Full time

    Job Title : Data Architect Location : Bangalore, India Job Type : Full-Time Notice period : 0-15 days Job Description : Position Overview : The Senior Data Architect will be responsible for the strategic design, implementation, and management of high-quality, scalable data solutions. This role requires extensive experience in data architecture, data...

  • AbInitio Developer

    4 months ago


    Anywhere in India/Multiple Locations Huquo Full time

    Role : Abinitio Developer Experience : 3-10 yearsJob Description :- 3 - 10 years hands on strong experience in Ab-Initio technology.- Should have good knowledge about Ab-Initio components like Reformat, Join, Sort, Rollup, Normalize, Scan, Lookup, MFS, Ab-Initio parallelism and products like Metadata HUB, Conduct>IT, Express>IT, Control center and good to...


  • India Leading IT Company Full time

    Crystal Solutions Ltd. is a leading International Recruitment Service provider for more than 30 years across the globe. We are hiring Data Engineer for an IT Company in Dubai. Details of the requirement is stated below. Position: 6 months & extendable contract Designation: Data Engineer Experience: 8+ years Education: Bachelor's Degree in IT ...


  • India Leading IT Company Full time

    Crystal Solutions Ltd. is a leading International Recruitment Service provider for more than 30 years across the globe. We are hiring Data Engineer for an IT Company in Dubai. Details of the requirement is stated below.Position: 6 months & extendable contractDesignation: Data EngineerExperience: 8+ yearsEducation: Bachelor's Degree in ITRequire:8+ years of...


  • Anywhere in India/Multiple Locations HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Role : QA Test Analyst ; Data Engineer Role and Responsibilities Overview :- Oversee all aspects of quality assurance including establishing and reporting on metrics, applying industry best practices and developing new tools and processes to ensure quality goals are met.- Adhere to formal QA processes, ensuring that the Systems...

  • Data Engineer

    4 months ago


    Anywhere in India/Multiple Locations Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • Celebal Technologies

    2 hours ago


    Anywhere in India/Multiple Locations Celebal Technologies Full time

    About Us : Celebal Technologies is a leading Solution Service company that provides Services the field of Data Science, Big Data, Enterprise Cloud & Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As part of our commitment to staying ahead in the industry, we are seeking a...


  • india Radioactive Technologies Full time

    Spark Scala DeveloperShift- Malaysian / EURExp- 8 yrsFull time Contract OpportunityFully Remoteplease share resume at Khalil@weradioactive.comResponsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing...


  • Anywhere in India/Multiple Locations QUARKS TECHNOSOFT PRIVATE LIMITED Full time

    Job Title : Senior Data EngineerExperience - 6+ Years Job Overview : We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on the cloud. The Senior Data Engineer will work closely with cross-functional teams to...

Scala & Hadoop Engineer - ETL/Data Ingestion

3 months ago


Anywhere in IndiaMultiple Locations Taggd Full time

Responsibilities :

- Design, develop, and implement data pipelines and ETL processes using Scala and Spark for efficient data ingestion, transformation, and loading.

- Utilize PySpark and Spark SQL for large-scale data analysis and manipulation.

- Possess strong proficiency in SQL for querying and manipulating data within Big Data platforms.

- Leverage your experience with Big Data tools and Hadoop to manage distributed data processing tasks.

- Work with DataFrames and Resilient Distributed Datasets (RDDs) for efficient data processing in Spark.

- Apply your cloud expertise to utilize AWS services like S3, Lambda, RDS, EKS, Glue, and EMR for data storage, processing, and analytics.


- Integrate messaging/data streaming services, especially Kafka, into your data pipelines.

- Work collaboratively within an Agile Scrum environment using tools like Jira.

- Implement CI/CD/CT practices for smooth software deployment and integration.

Requirements :

- Bachelor's degree in Computer Science, Information Technology, or a related field (preferred).

- 3-4 years of experience developing software applications using Scala programming language.

- In-depth knowledge of Apache Spark and its functionalities (PySpark, Spark SQL).

- Strong understanding of Big Data concepts and distributed processing frameworks.

- Proficiency in SQL for data querying and manipulation.

- Experience with cloud platforms like AWS and its Big Data services (S3, EMR, Glue, etc.) is a plus.

- Familiarity with data streaming services like Kafka is a plus.

- Experience with Agile methodologies (Scrum) and project management tools (Jira).

- Understanding of CI/CD/CT principles and practices for software delivery.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills

(ref:hirist.tech)