Spark Engineer
6 days ago
Job Posting: Spark Engineer
Location: Bangalore / Pune (5 days' Work from Office)
Experience: 4 to 6 years
Notice Period: 15-20 days only
Are you a Spark enthusiast ready to ignite your career? We're seeking a talented Spark Engineer to join our dynamic team and drive our data processing capabilities to new heights.
Key Responsibilities:
• Develop and optimize data pipelines using Apache Spark
• Implement Spark SQL for efficient data transformations
• Design and maintain workflows using Apache Airflow
• Collaborate on cloud-based solutions (AWS, Azure, or Google Cloud)
• Contribute to continuous integration and deployment processes
Required Skills and Experience:
• 4-6 years of hands-on experience with Apache Spark, including Spark SQL and PySpark
• Strong proficiency in Python and/or Scala programming
• Proven track record in developing and maintaining Spark applications
• Experience with Apache Airflow for workflow orchestration
• Solid understanding of SQL and relational databases
• Familiarity with data modeling and data warehousing concepts
• Experience working with cloud platforms (AWS, Azure, or Google Cloud)
Preferred Qualifications:
• Knowledge of containerization (Docker) and orchestration (Kubernetes)
• Understanding of DevOps practices and CI/CD pipelines
• Experience with Big Data technologies and frameworks
Ideal Candidate:
• Demonstrates strong problem-solving skills and attention to detail
• Thrives in a fast-paced, agile environment
• Possesses excellent communication and collaboration abilities
• Shows enthusiasm for staying current with emerging technologies
We offer an exciting opportunity to work on cutting-edge data processing projects in a collaborative environment. This position requires 5 days of work from our office in Bangalore or Pune.
If you're passionate about Spark development and ready to make an immediate impact, we want to hear from you
#SparkEngineer #ApacheSpark #DataEngineering #BigData #PySpark #SparkSQL #CloudComputing #AgileMethodology #ImmediateOpening
-
Spark Engineer
3 hours ago
Bangalore City, India Anlage Infotech (India) P Ltd Full timeJob Posting: Spark EngineerLocation: Bangalore / Pune (5 days' Work from Office)Experience: 4 to 6 yearsNotice Period: 15-20 days onlyAre you a Spark enthusiast ready to ignite your career? We're seeking a talented Spark Engineer to join our dynamic team and drive our data processing capabilities to new heights.Key Responsibilities:- Develop and optimize...
-
Big Data Engineer
3 months ago
bangalore, India Leinex Consulting Full timeJob Description : Role : Bigdata EngineerRequirements : - 3+ Years of experience in Python, Pyspark, SQL is must.- 3+ years of software development experience with (HDFS, Spark, Sqoop, Hive, HQL, Spark, Scala, PySpark)- Experience using Scala/Java/Python, SQL, and shell scripting.- Experience in developing and tuning spark applications.- Excellent...
-
Java Spark
1 week ago
bangalore, India Ankyah Infinity Pvt. Ltd. Full timeJava SparkMin Experience – 8+Key Points - Must Have● Advanced Java proficient● Microservices● Spring boot● Writing SQL Queries (proficient)● AWS● 4-5 Yrs in Java, 2-3 exp - Spark● Good to have● Unix Shell scriptingJD● Minimum of 8 years of experience in building complex Data Platforms and Data Engineering● Minimum of 6 years of hands on...
-
Java Spark
1 week ago
Bangalore City, India Ankyah Infinity Pvt. Ltd. Full timeJava SparkMin Experience – 8+Key Points Must Have● Advanced Java proficient● Microservices● Spring boot● Writing SQL Queries (proficient)● AWS● 4-5 Yrs in Java, 2-3 exp Spark● Good to have● Unix Shell scriptingJD● Minimum of 8 years of experience in building complex Data Platforms and Data Engineering● Minimum of 6 years of hands on...
-
Data Engineer
3 months ago
Any Location/Mumbai/Bangalore/Delhi/Hyderabad, India WEN Full timeJob Summary:We are seeking an experienced Data Engineer with strong skills in Databricks, Python/PySpark, and Spark Streaming.Key Responsibilities:- Build and maintain data pipelines using Databricks and PySpark.- Implement and manage real-time data processing with Spark Streaming.- Collaborate with data teams to develop data solutions.- Optimize and...
-
Java + Spark
1 week ago
bangalore, India Impetus Full timeQualifications:Bigdata + Java: Java, Microservices, Spring boot, API, Bigdata, Python, PysparkExperience with design and coding across one or more platforms and languages (e.g. Java, Spark/SQL) as appropriateHands-on expertise with application design, software development and automated testing Proficient in Big Data technologies Designs, codes, tests,...
-
Senior Data Engineer
2 days ago
Bangalore, India Visa Full timeJob DescriptionTeam SummaryThe Risk and Identity Solutions (RaIS) team provides risk management services for banks, merchants, and other payment networks. Machine learning and AI models are the heart of the real-time insights used by our clients to manage risk. Created by the Visa Predictive Models (VPM) team, continual improvement and efficient deployment...
-
Technical Lead
3 months ago
bangalore, India Suitable.AI Full timeSkills required : - Minimum 2+ years in Data Engineering - Last 5 years of experience should be from consulting companies - Skillsets - (Java/Scala/Python) + Big Data stack+ DSA + cloud experience - Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as GCP/AWS preferred - Must...
-
Big Data Engineer
3 months ago
bangalore, India WEN Full timeRole : Big Data Engineer (Scala)Responsibilities :- Develop and maintain scalable data pipelines using Spark and Hive within the Hadoop ecosystem- Utilize Scala programming language to implement efficient data processing solutions- Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions- Implement best practices...
-
Senior Data Engineer
3 months ago
bangalore, India Zyoin group Full timeKey Accountabilities and Decision Ownership: - Data Pipeline Development: Develop and maintain robust data pipelines to ingest, transform, and deliver data from various sources to downstream systems, data lakes, and data warehouses. - Data Transformation: Perform data cleansing, enrichment, and transformation using Python, Spark, and SQL to ensure data...
-
Data Engineer
3 months ago
Hyderabad/Bangalore/Chennai, India SPG Consulting Solutions Pvt.Ltd Full timeJob Description: Senior Data EngineerLocation: Hyderabad, Chennai, BangaloreExperience: 4 to 10 YearsPrimary Skills:- Hadoop- Spark (Mandatory)- ScalaSecondary Skills:- Python- SQLRole Summary/Purpose:The Senior Data Engineer will join our dynamic scrum teams to perform functional and system development for Hadoop applications as part of our Enterprise Data...
-
Big Data Developer
4 months ago
bangalore, India Impetus Full timeLooking for #immediatejoiners preferredExperience - 2-6 yearsLocation - Gurgaon /BangaloreJob DescriptionExperience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriateHands-on expertise with application design, software development and automated testing Proficient in Big Data technologies Designs,...
-
Sr. Data Engineer
1 month ago
Bangalore, India Visa Full timeJob DescriptionTeam Summary The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing...
-
Senior Data Engineer
4 months ago
Bangalore, India GLAXOSMITHKLINE ASIA PVT. LTD Full timeA new world-leading consumer health company. Shaped by all who join us. Together, we're improving everyday health for billions of people. By growing and innovating our global portfolio of category-leading brands including Sensodyne, Panadol, Advil, Voltaren, Theraflu, Otrivin, and Centrum through a unique combination of deep human understanding and...
-
Bengaluru/ Bangalore, India timesjobs Full timeBig Data Engineers (Java/Scala/Hadoop/Spark/AWS) Bangalore, IndiaTechnology Engineering /Full Time/ HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when...
-
Saturam Inc
3 months ago
Bangalore, India f Full timeJob Responsibility :- Strong programming skills in Python and SQL.- Experience with data processing leveraging programming skills in Python and Spark- In-depth understanding of the Kafka platform for (real-time) data ingestion and processing of high-volume data.- Design and architect data flows, data management in Cloud environment which are scalable,...
-
Data Engineer
2 months ago
Bangalore, India Visa Full timeJob DescriptionTeam Summary The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing...
-
Nielsen - Big Data Engineers Airflow Python Spark
2 months ago
Bengaluru/ Bangalore, India timesjobs Full timeBig Data Engineers (Airflow, Python, Spark) Bangalore, IndiaTechnology Engineering /Full Time/ HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you...
-
Bengaluru/ Bangalore, India timesjobs Full timePosition: Senior Software Engineer - Bigdata (Java/Scala/Python & Spark, SQL, AWS)Location: Bengaluru, IndiaTechnology: Other / HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We...
-
Big Data Developer
4 months ago
Bangalore Urban, India Impetus Full timeLooking for #immediatejoiners preferred Experience - 2-6 years Location - Gurgaon /Bangalore Job Description Experience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriate Hands-on expertise with application design, software development and automated testing Proficient in Big Data technologies...