Bigdata and Hadoop and Spark Developer

3 days ago

Chennai Gurugram Pune, India Xoriant Full time US$ 1,20,000 - US$ 2,00,000 per year

Bigdata Developer

Domain Skills:

1. KYC / AML expertise

Technical Skills:

Data Pipeline Development (scalable ETL/ELT pipelines)

Big Data Infrastructure (Spark, Flink, Hadoop, Kafka)

Programming (Python or Scala)

Data Processing Frameworks (Spark, Hadoop, or Flink, Iceberg)

Cloud Data Platforms (AWS, Azure, or GCP)

SQL and database technologies (e.g., Oracle, PostgreSQL)

NoSQL database technologies (e.g., Mongo, Couch)

Data Orchestration (Airflow or Prefect)

Technical Skills (Plus):

Containerization (Docker, Kubernetes)

Technical Skills (Good to Have):

Large-scale document processing (Deep learning, Spacy, NLTK, LLMs, Embedding Technique)

Agentic RAG framework (LangChain, CrewAI, Google ADK, Vector Databases)

Distributed caching (Hazelcast or Redis or Elsatic Search )

Distributed, multi-tier application experience

High-performance, scalable application experience

Soft Skills:

  1. Strong communication and stakeholder management

  2. Analytical mindset with attention to data accuracy and integrity

3) Ability to work in agile, cross teams

  • Bigdata and Hadoop Engineer

    13 hours ago

    Bengaluru, Chennai, Hyderabad, India Artech Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title: Developer Experience: 4-6 Years Work Location: Chennai, TN || Bangalore, KA || Hyderabad, TSSkill Required: Digital : Bigdata and Hadoop Ecosystems Digital : PySparkJob Description:Need to work as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing ? Work on Hadoop, Hive SQL?s, Spark, Bigdata Eco System Tools.? Experience...

  • Scala Spark Developer

    3 days ago

    Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...

  • Bigdata / Hadoop Architect

    3 hours ago

    Chennai, India Jobs for Humanity Full time

    Company Description Jobs for Humanity is dedicated to building an inclusive and just employment ecosystem. Therefore, we have dedicated this job posting to individuals coming from the following communities: Refugee, Neurodivergent, Single Parent, Blind or Low Vision, Deaf of Hard of Hearing Black, Hispanic, Asian, Military Veterans, the Elderly, the LGBTQ,...

  • BigData-Hadoop/Scala Engineer. AS

    7 days ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionBigData-Hadoop/Scala Engineer. ASPosition OverviewJob Title :BigData-Hadoop/Scala EngineerLocation : Pune, IndiaRole DescriptionAn Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the Bank. Root cause...

  • BigData-Hadoop/Scala Engineer. AS

    1 day ago

    Pune, Maharashtra, India Deutsche Bank Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    BigData-Hadoop/Scala Engineer. ASJob ID: R0388874Full/Part-Time: Full-timeRegular/Temporary: RegularListed: Location: PunePosition OverviewJob Title : BigData-Hadoop/Scala EngineerLocation : Pune, IndiaRole DescriptionAn Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness...

  • Hadoop Bigdata 4-10 Yrs Pan India

    4 days ago

    Chennai, India Capgemini Full time

    Build data lake using big data skills and use the data for enabling analytics and building predictive models. - Exposure Hadoop tools (Hive, HBase, HDFS etc), Shell Scripting/Linux Commands - Nice to have CI/CD (like Jenkins, Run deck etc.) - Experience on Hadoop Ecosystem Architecture and components - Strong technical and architectural knowledge on...

  • Hadoop Bigdata 4-10 Yrs Pan India

    4 days ago

    Chennai, India Capgemini Full time

    **Job Description**: - Build data lake using big data skills and use the data for enabling analytics and building predictive models. - Exposure Hadoop tools (Hive, HBase, HDFS etc), Shell Scripting/Linux Commands - Nice to have CI/CD (like Jenkins, Run deck etc.) - Experience on Hadoop Ecosystem Architecture and components - Strong technical and...

  • BigData-Hadoop/Scala Engineer, AVP

    7 days ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionBigData-Hadoop/Scala Engineer, AVPPosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected,...

  • Bigdata Engineer

    3 days ago

    Bengaluru, Chennai, Gurugram, India Impetus Technologies Full time US$ 1,50,000 - US$ 2,00,000 per year

    Skills : Bigdata, Pyspark, Hive, Spark OptimizationGood to have : GCPRoles and Responsibilities Skills : Bigdata, Pyspark, Hive, Spark OptimizationGood to have : GCP

  • Knime Hadoop/bigdata Admin

    3 days ago

    Chennai, India Quillsoft IT Services Private Limited Full time

    WE are looking for Knime machine learning expertise along with hadoop /bigdata admin, for part time/temporary job for one of client based at Dubai. Complete remote job. Should have experience in open source. After installation 6 months Support job(paid hourly basis) **Job Types**: Part-time, Contractual / Temporary, Freelance Contract length: 1...