Big Data Engineer(Iceberg)
2 days ago
Looking for - Hive, SQL, Python, Spark, Hadoop and kafka with Iceberg experience
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- Design, develop, and maintain data pipelines and ETL processes using Python, Hive, Spark, and other relevant technologies.
- Good Hands on Exp with java
- Minimum of 6+ years of experience as a Data Engineer, with proven expertise in Python, Hive, and Spark.
- Advance SQL experience and working experience with Big data Hadoop .
- Strong understanding of data engineering concepts, including data modelling, data integration, and data warehousing.
- Hands-on experience with tools such as Apache Airflow.
- Experience with Docker and containerization technologies is a plus.
- Strong SQL skills and experience with relational databases, such as PostgreSQL, MySQL, or similar.
- Familiarity with Apache Spark.
- Knowledge of data processing frameworks such as Apache Beam, Apache Flink, or similar.
- Strong problem-solving and troubleshooting skills, with attention to detail.
- Excellent communication and interpersonal skills, with the ability to work collaboratively in a team environment
-
Technical Lead- Data Engineer
4 days ago
Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...
-
Big Data Engineer
10 hours ago
Bengaluru, Karnataka, India Roku Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : Teamwork makes the stream work. Roku is changing how the world watches TV. Roku is the #1 TV streaming platform in the Canada, and Mexico, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India Mastek Full time ₹ 20,00,000 - ₹ 25,00,000 per yearData Engineer – NiFi / Cloudera / Iceberg / Snowflake / DatabricksOverviewWe are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have...
-
Big Data Engineer
4 days ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per yearProfile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...
-
Big Data Engineer
6 hours ago
Bengaluru, Karnataka, India Akshya Patra Services Full time ₹ 5,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled Big Data Engineer with expertise in various Big Data tools and ecosystems. The ideal candidate should have hands-on experience with technologies such as Hadoop, Spark, Hive, and Impala. A strong proficiency in programming languages like Scala, Java, and Python is essential for designing and implementing data processing...
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India, Karnataka Mastek Full timeData Engineer – NiFi / Cloudera / Iceberg / Snowflake / DatabricksOverviewWe are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Deqode Full time ₹ 5,00,000 - ₹ 25,00,000 per yearBig Data Engineer Tech Stack: Python, Hive & Apache Spark Java & Advanced SQL Hadoop & Big Data Ecosystem Apache Airflow & ETL Pipelines Docker & Containerization Data Modelling & Warehousing Experience- 5 years Share your updated resume now.
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per yearKey skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...