Big Data Engineer
1 week ago
Job Description:
• Experience in advanced Apache Spark processing framework, spark programming languages such as Scala/Python/Advanced Java with sound knowledge in shell scripting.
• Experience in working with Core Spark, Spark Streaming, Data Frame API, Data set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data. Specifically, this experience must be in writing "Big Data" data engineering jobs for large scale data integration in AWS.
• Advanced SQL experience using Hive/Impala framework including SQL performance tuning
• Experience in writing spark streaming jobs integrating with streaming frameworks such as Apache Kafka or AWS Kinesis.
• Experience working in Key/Value data store such as HBase
• Experience in AWS services such as EMR, Glue (server less architecture), S3, Athena, IAM, Lambda and Cloud watch is required.
-
Big Data Engineer
2 weeks ago
bangalore, India Tata Consultancy Services Full timeJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...
-
Big Data Engineer
1 day ago
Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesignation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...
-
Big Data Engineer
2 days ago
bangalore, India Talent Worx Full timeLocation – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...
-
Big Data Engineer
2 weeks ago
Pune, India Information Technology Full timeBig Data EngineerKey Responsibilities :- Build and manage highly scalable Big Data pipelines for large structured datasets.- Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.- Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.- Develop...
-
Big Data Engineer
3 weeks ago
Bengaluru, India Acme Services Full timeJob Description We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark, and SQL or other ETL tools, along with hands-on experience in...
-
Big Data Engineer
5 days ago
Bengaluru, Hyderabad, Pune, India Symphoni Hr Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole: Big Data Engineer / Spark DeveloperLocation: Pune, Chennai, Bangalore, Chandigarh, HyderabadExp: 615 yrs | NP: 030 daysSkills: Spark + Scala OR Spark + JavaJD: Build & optimize Spark pipelines using Scala/Java for large-scale data processing.Resume Summary: 6+ yrs in Spark + Scala/Java, skilled in big data pipelines & performance tuning.
-
Big Data Engineer
4 weeks ago
Pune, India Coforge Full timeCoforge Ltd is Hiring for Big Data Engineer - AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:- • Design, develop, and optimize Big Data architectures leveraging AWS services for...
-
Big Data Engineer
4 weeks ago
Pune, India Whatjobs IN C2 Full timeCoforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:- - Design, develop, and optimize Big Data architectures leveraging AWS services for...
-
Big Data Specialist
2 days ago
bangalore, India Atomic North Full timeBig Data Engineer Location: Pune/Nagpur (WFO) Experience Required: 8+ Years **Long term onsite to Abu Dhabi**Job Summary: We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...
-
Big Data Senior Developer
2 days ago
Pune, India NTT DATA Full timeJob Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Big Data Senior Developer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). • Bachelor...