Big Data/Hadoop Engineer
2 days ago
We are hiring for Big Data / Hadoop Engineer
Exp - 3+yrs
Location - Bangalore ( 3days WFO)
Notice Period - Less than 30days only
. Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem.
. Programming & Scripting: Develop complex data processing applications using Spark (with Python/Scala/Java) and implement efficient jobs using Hive and Pig.
. Hadoop Ecosystem Mastery: Work extensively with core Hadoop components including HDFS, YARN, MapReduce, Hive, HBase, Pig, Sqoop, and Flume.
. Performance Tuning: Optimize large-scale data processing jobs for speed and efficiency, troubleshooting performance bottlenecks across the cluster.
. Data Modeling: Collaborate with data scientists and analysts to design and implement optimized data models for the data lake/warehouse (e.g., Hive schema, HBase column families).
. Workflow Management: Implement and manage job orchestration and scheduling using tools like Oozie or similar workflow managers.
. Operational Support: Monitor, manage, and provide L2/L3 support for production Big Data platforms, ensuring high availability and reliability.
-
Big Data/Hadoop Engineer
2 days ago
Bengaluru, Karnataka, India Rackspace Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are hiring for Big Data / Hadoop EngineerExp - 3+yrsLocation - Bangalore ( 3days WFO)Notice Period - Less than 30days only. Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem.. Programming & Scripting: Develop complex data processing applications using Spark...
-
Big data-Pyspark Developer-Hadoop
26 minutes ago
Bengaluru, Karnataka, India Infosys Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKey Responsibilities:Deploying a hadoop cluster maintaining a hadoop cluster adding and removing nodes using cluster monitoring tools like Cloudera Manager configuring the NameNode high availability and keeping a track of all the running hadoop jobsImplementing managing and administering the overall hadoop infrastructureKnowledge all the components in the...
-
Big Data Engineer
2 days ago
Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per yearProfile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...
-
Data Engineer – Hadoop
3 days ago
Bengaluru, Karnataka, India NAZZTEC Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearWe are seeking an experiencedData Engineerwith strong expertise in theHadoop ecosystemandPySpark. The ideal candidate should have a deep understanding of large-scale data processing, data pipelines, and automation using Python.Key ResponsibilitiesDesign, develop, and optimize data pipelines using Hadoop and PySpark.Work extensively on HDFS, Hive, and...
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per yearKey skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...
-
Big Data Engineer
4 hours ago
Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per yearResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...
-
Big Data Engineer
5 hours ago
Bengaluru, Karnataka, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per yearLocation – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAs a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India 3K Softech Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDeep Hadoop ecosystem knowledge: Spark, HDFS, Hive, IcebergBatch and streaming ETL pipeline designscalability and reliabilityPython & Unix proficiency, materialized views, data structures/algorithmsData warehouse security, compliance, and operational excellenceAutomated pipeline design & optimization, platform collaborationMonitoring and logging: Prometheus,...
-
Big Data Engineer
12 minutes ago
Bengaluru, Karnataka, India Coforge Full time ₹ 8,00,000 - ₹ 12,00,000 per yearHiring Now: Big Data Engineer Bangalore || Coforge LtdNote: This position requires 5 days mandatory - Work From Office.Send your updated CV to: For queries, reach out on WhatsApp: Job Location: BangaloreExperience Required: 6 YearsAvailability: Immediate Joiners PreferredKey Technologies & Skills Required:Big Data Tools: Hadoop, HiveProgramming Languages:...