Spark Engineer

6 days ago


Bangalore, India Anlage Infotech (India) P Ltd Full time

Job Posting: Spark Engineer

Location: Bangalore / Pune (5 days' Work from Office)

Experience: 4 to 6 years

Notice Period: 15-20 days only

Are you a Spark enthusiast ready to ignite your career? We're seeking a talented Spark Engineer to join our dynamic team and drive our data processing capabilities to new heights.

Key Responsibilities:

• Develop and optimize data pipelines using Apache Spark

• Implement Spark SQL for efficient data transformations

• Design and maintain workflows using Apache Airflow

• Collaborate on cloud-based solutions (AWS, Azure, or Google Cloud)

• Contribute to continuous integration and deployment processes

Required Skills and Experience:

• 4-6 years of hands-on experience with Apache Spark, including Spark SQL and PySpark

• Strong proficiency in Python and/or Scala programming

• Proven track record in developing and maintaining Spark applications

• Experience with Apache Airflow for workflow orchestration

• Solid understanding of SQL and relational databases

• Familiarity with data modeling and data warehousing concepts

• Experience working with cloud platforms (AWS, Azure, or Google Cloud)

Preferred Qualifications:

• Knowledge of containerization (Docker) and orchestration (Kubernetes)

• Understanding of DevOps practices and CI/CD pipelines

• Experience with Big Data technologies and frameworks

Ideal Candidate:

• Demonstrates strong problem-solving skills and attention to detail

• Thrives in a fast-paced, agile environment

• Possesses excellent communication and collaboration abilities

• Shows enthusiasm for staying current with emerging technologies

We offer an exciting opportunity to work on cutting-edge data processing projects in a collaborative environment. This position requires 5 days of work from our office in Bangalore or Pune.

If you're passionate about Spark development and ready to make an immediate impact, we want to hear from you

#SparkEngineer #ApacheSpark #DataEngineering #BigData #PySpark #SparkSQL #CloudComputing #AgileMethodology #ImmediateOpening


  • Spark Engineer

    3 hours ago


    Bangalore City, India Anlage Infotech (India) P Ltd Full time

    Job Posting: Spark EngineerLocation: Bangalore / Pune (5 days' Work from Office)Experience: 4 to 6 yearsNotice Period: 15-20 days onlyAre you a Spark enthusiast ready to ignite your career? We're seeking a talented Spark Engineer to join our dynamic team and drive our data processing capabilities to new heights.Key Responsibilities:- Develop and optimize...

  • Big Data Engineer

    3 months ago


    bangalore, India Leinex Consulting Full time

    Job Description : Role : Bigdata EngineerRequirements : - 3+ Years of experience in Python, Pyspark, SQL is must.- 3+ years of software development experience with (HDFS, Spark, Sqoop, Hive, HQL, Spark, Scala, PySpark)- Experience using Scala/Java/Python, SQL, and shell scripting.- Experience in developing and tuning spark applications.- Excellent...

  • Java Spark

    1 week ago


    bangalore, India Ankyah Infinity Pvt. Ltd. Full time

    Java SparkMin Experience – 8+Key Points - Must Have● Advanced Java proficient● Microservices● Spring boot● Writing SQL Queries (proficient)● AWS● 4-5 Yrs in Java, 2-3 exp - Spark● Good to have● Unix Shell scriptingJD● Minimum of 8 years of experience in building complex Data Platforms and Data Engineering● Minimum of 6 years of hands on...

  • Java Spark

    1 week ago


    Bangalore City, India Ankyah Infinity Pvt. Ltd. Full time

    Java SparkMin Experience – 8+Key Points Must Have● Advanced Java proficient● Microservices● Spring boot● Writing SQL Queries (proficient)● AWS● 4-5 Yrs in Java, 2-3 exp Spark● Good to have● Unix Shell scriptingJD● Minimum of 8 years of experience in building complex Data Platforms and Data Engineering● Minimum of 6 years of hands on...

  • Data Engineer

    3 months ago


    Any Location/Mumbai/Bangalore/Delhi/Hyderabad, India WEN Full time

    Job Summary:We are seeking an experienced Data Engineer with strong skills in Databricks, Python/PySpark, and Spark Streaming.Key Responsibilities:- Build and maintain data pipelines using Databricks and PySpark.- Implement and manage real-time data processing with Spark Streaming.- Collaborate with data teams to develop data solutions.- Optimize and...

  • Java + Spark

    1 week ago


    bangalore, India Impetus Full time

    Qualifications:Bigdata + Java: Java, Microservices, Spring boot, API, Bigdata, Python, PysparkExperience with design and coding across one or more platforms and languages (e.g. Java, Spark/SQL) as appropriateHands-on expertise with application design, software development and automated testing Proficient in Big Data technologies Designs, codes, tests,...


  • Bangalore, India Visa Full time

    Job DescriptionTeam SummaryThe Risk and Identity Solutions (RaIS) team provides risk management services for banks, merchants, and other payment networks. Machine learning and AI models are the heart of the real-time insights used by our clients to manage risk. Created by the Visa Predictive Models (VPM) team, continual improvement and efficient deployment...

  • Technical Lead

    3 months ago


    bangalore, India Suitable.AI Full time

    Skills required : - Minimum 2+ years in Data Engineering - Last 5 years of experience should be from consulting companies - Skillsets - (Java/Scala/Python) + Big Data stack+ DSA + cloud experience - Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as GCP/AWS preferred - Must...

  • Big Data Engineer

    3 months ago


    bangalore, India WEN Full time

    Role : Big Data Engineer (Scala)Responsibilities :- Develop and maintain scalable data pipelines using Spark and Hive within the Hadoop ecosystem- Utilize Scala programming language to implement efficient data processing solutions- Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions- Implement best practices...

  • Senior Data Engineer

    3 months ago


    bangalore, India Zyoin group Full time

    Key Accountabilities and Decision Ownership: - Data Pipeline Development: Develop and maintain robust data pipelines to ingest, transform, and deliver data from various sources to downstream systems, data lakes, and data warehouses. - Data Transformation: Perform data cleansing, enrichment, and transformation using Python, Spark, and SQL to ensure data...

  • Data Engineer

    3 months ago


    Hyderabad/Bangalore/Chennai, India SPG Consulting Solutions Pvt.Ltd Full time

    Job Description: Senior Data EngineerLocation: Hyderabad, Chennai, BangaloreExperience: 4 to 10 YearsPrimary Skills:- Hadoop- Spark (Mandatory)- ScalaSecondary Skills:- Python- SQLRole Summary/Purpose:The Senior Data Engineer will join our dynamic scrum teams to perform functional and system development for Hadoop applications as part of our Enterprise Data...

  • Big Data Developer

    4 months ago


    bangalore, India Impetus Full time

    Looking for #immediatejoiners preferredExperience - 2-6 yearsLocation - Gurgaon /BangaloreJob DescriptionExperience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriateHands-on expertise with application design, software development and automated testing Proficient in Big Data technologies Designs,...

  • Sr. Data Engineer

    1 month ago


    Bangalore, India Visa Full time

    Job DescriptionTeam Summary The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing...

  • Senior Data Engineer

    4 months ago


    Bangalore, India GLAXOSMITHKLINE ASIA PVT. LTD Full time

    A new world-leading consumer health company. Shaped by all who join us. Together, we're improving everyday health for billions of people. By growing and innovating our global portfolio of category-leading brands including Sensodyne, Panadol, Advil, Voltaren, Theraflu, Otrivin, and Centrum through a unique combination of deep human understanding and...


  • Bengaluru/ Bangalore, India timesjobs Full time

    Big Data Engineers (Java/Scala/Hadoop/Spark/AWS) Bangalore, IndiaTechnology Engineering /Full Time/ HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when...

  • Saturam Inc

    3 months ago


    Bangalore, India f Full time

    Job Responsibility :- Strong programming skills in Python and SQL.- Experience with data processing leveraging programming skills in Python and Spark- In-depth understanding of the Kafka platform for (real-time) data ingestion and processing of high-volume data.- Design and architect data flows, data management in Cloud environment which are scalable,...

  • Data Engineer

    2 months ago


    Bangalore, India Visa Full time

    Job DescriptionTeam Summary The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing...


  • Bengaluru/ Bangalore, India timesjobs Full time

    Big Data Engineers (Airflow, Python, Spark) Bangalore, IndiaTechnology Engineering /Full Time/ HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you...


  • Bengaluru/ Bangalore, India timesjobs Full time

    Position: Senior Software Engineer - Bigdata (Java/Scala/Python & Spark, SQL, AWS)Location: Bengaluru, IndiaTechnology: Other / HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We...

  • Big Data Developer

    4 months ago


    Bangalore Urban, India Impetus Full time

    Looking for #immediatejoiners preferred Experience - 2-6 years Location - Gurgaon /Bangalore Job Description Experience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriate Hands-on expertise with application design, software development and automated testing Proficient in Big Data technologies...