Big Data Specialist
4 weeks ago
Big Data EngineerLocation: Pune/Nagpur (WFO)Experience Required: 8+ Years**Long term onsite to Abu Dhabi**Job Summary:- We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. - The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability.Key Responsibilities:• Design, develop, and maintain data pipelines using PySpark and related Big Data technologies.• Work with HDFS, Hive, Sqoop, and other tools in the Hadoop ecosystem.• Write efficient HiveQL and SQL queries to handle large-scale datasets.• Perform performance tuning and optimization of distributed data systems.• Collaborate with cross-functional teams in an Agile environment to deliver high-quality solutions. • Manage and schedule workflows using Apache Airflow or Oozie.• Troubleshoot and resolve issues in data pipelines to ensure reliability and accuracy.Required Skills:• Proven experience in Big Data Engineering with a focus on PySpark.• Strong knowledge of HDFS, Hive, Sqoop, and related tools.• Proficiency in SQL/HiveQL for large datasets.• Expertise in performance tuning and optimization of distributed systems.• Familiarity with Agile methodology and collaborative team practices.• Experience with workflow orchestration tools (Airflow/Oozie).• Strong problem-solving, analytical, and communication skills.Good to Have:• Knowledge of data modeling and data warehousing concepts.• Exposure to DevOps practices and CI/CD pipelines for data engineering.• Experience with other Big Data frameworks such as Spark Streaming or Kafka.
-
Big Data Specialist
2 weeks ago
New Delhi, India Emergys Full timeWork Location:Pune(Work-from-Office) ⏳Notice Period:Immediate to 30 Days Experience:8+ YearsMust Have Skills: Data Architecture & Design– Expertise in designing scalable and resilient data architectures for batch and streaming systems. Data Modeling & Integration– Strong ability to build efficient data models and integrate data from multiple sources....
-
Big Data Specialist
7 days ago
New Delhi, India Emergys Full timeWork Location:Pune(Work-from-Office) ⏳Notice Period:Immediate to 30 Days Experience:8+ YearsMust Have Skills: Data Architecture & Design– Expertise in designing scalable and resilient data architectures for batch and streaming systems. Data Modeling & Integration– Strong ability to build efficient data models and integrate data from multiple sources....
-
Big Data Developer
3 weeks ago
New Delhi, India airtel Full timeJob Title: Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...
-
Big Data Developer
3 weeks ago
New Delhi, India UST Full timeWe are seeking aBig Data Engineerwith strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization.Key Responsibilities: Design, develop, and optimize big...
-
Big Data Developer
2 weeks ago
New Delhi, India UST Full timeWe are seeking aBig Data Engineerwith strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization.Key Responsibilities: Design, develop, and optimize big...
-
Big Data Developer
7 days ago
New Delhi, India UST Full timeWe are seeking aBig Data Engineerwith strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization.Key Responsibilities: Design, develop, and optimize big...
-
Big Data Specialist
2 weeks ago
Delhi, India Emergys Full timeWork Location: Pune (Work-from-Office) ⏳ Notice Period: Immediate to 30 Days Experience: 8+ Years Must Have Skills: Data Architecture & Design – Expertise in designing scalable and resilient data architectures for batch and streaming systems. Data Modeling & Integration – Strong ability to build efficient data models and integrate data from multiple...
-
Big Data Developer
3 weeks ago
New Delhi, India Tata Consultancy Services Full timeJob Title :- Data Engineer - BigdataExperience: 4 to 8 YearsLocation: Hyderabad,Chennai, BangaloreJob DescriptionRequired Skills:4+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging...
-
Big Data Developer
2 weeks ago
New Delhi, India Tata Consultancy Services Full timeJob Title :- Data Engineer - Bigdata Experience: 4 to 8 Years Location: Hyderabad,Chennai, BangaloreJob DescriptionRequired Skills: 4+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark...
-
Big Data Developer
4 weeks ago
New Delhi, India airtel Full timeJob profiles- Big Data Developer (Senior Manager)Experience- 7-10 yrs Location- PuneJob DescriptionWe are seeking a highly skilledLead Big Data Developerto architect, drive, and optimize large-scale data engineering solutions in a modern, modular, and highly automated environment. The ideal candidate will have extensive experience in building and leading...
