Big Data Specialist
2 days ago
Big Data Engineer Location: Pune/Nagpur (WFO) Experience Required: 8+ Years **Long term onsite to Abu Dhabi**Job Summary: We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability. Key Responsibilities:• Design, develop, and maintain data pipelines using PySpark and related Big Data technologies. • Work with HDFS, Hive, Sqoop, and other tools in the Hadoop ecosystem. • Write efficient HiveQL and SQL queries to handle large-scale datasets. • Perform performance tuning and optimization of distributed data systems. • Collaborate with cross-functional teams in an Agile environment to deliver high-quality solutions. • Manage and schedule workflows using Apache Airflow or Oozie. • Troubleshoot and resolve issues in data pipelines to ensure reliability and accuracy. Required Skills:• Proven experience in Big Data Engineering with a focus on PySpark. • Strong knowledge of HDFS, Hive, Sqoop, and related tools. • Proficiency in SQL/HiveQL for large datasets. • Expertise in performance tuning and optimization of distributed systems. • Familiarity with Agile methodology and collaborative team practices. • Experience with workflow orchestration tools (Airflow/Oozie). • Strong problem-solving, analytical, and communication skills. Good to Have: • Knowledge of data modeling and data warehousing concepts. • Exposure to DevOps practices and CI/CD pipelines for data engineering. • Experience with other Big Data frameworks such as Spark Streaming or Kafka.
-
Big Data
10 hours ago
bangalore, India Tata Consultancy Services Full timeGreetings from TCS!TCS is hiring for Big Data Required Technical Skill Set -MS Azure Cloud Platform, Big Data with Hadoop, Python, Hive, Azure data and admin analysisLocation: - Chennai / BangaloreDesired Experience Range: 5 to 12 yearsMust to HaveHands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks...
-
Big Data Developer
1 week ago
bangalore, India UST Full timeWe are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...
-
Big Data
2 days ago
bangalore, India PradeepIT Consulting Services Full timeAbout the jobAccelerate your career with PradeepITPradeepIT is one of the largest, globally recognized IT Consulting firm to connect Indias deeply vetted talent team to global customer.Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500...
-
Big Data Engineer
2 weeks ago
bangalore, India Tata Consultancy Services Full timeJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...
-
Big Data Developer
6 days ago
bangalore, India Sourcebae Full time🚀 Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala 🚀Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to...
-
Big Data Developer
1 week ago
bangalore, India IntraEdge Full timeRole: Big Data + GCP Engineer.Location: Bengaluru, KA (Hybrid)Type: Fulltime We are looking for energetic, high-performing and highly skilled Big Data + GCP Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next generation global...
-
Big Data Developer
1 week ago
Bangalore, India IntraEdge Full timeRole: Big Data + GCP Engineer. Location: Bengaluru, KA (Hybrid) Type: Fulltime We are looking for energetic, high-performing and highly skilled Big Data + GCP Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next generation global...
-
Big Data Developer
6 days ago
Bangalore Division, India Sourcebae Full time🚀 Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala 🚀 Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions. This is a great opportunity...
-
Big Data Developer
6 days ago
bangalore district, India Sourcebae Full time🚀 Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala 🚀 Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions. This is a great opportunity...
-
Big Data Engineer
2 days ago
bangalore, India Talent Worx Full timeLocation – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...
