(High Salary) Data Engineer
6 days ago
Data Engineer – NiFi / Cloudera / Iceberg / Snowflake / Databricks Overview We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms. Key Responsibilities: - Data Ingestion & Pipeline Development - Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables. - Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed. - Optimize NiFi workflows for scalability, reliability, and monitoring. - Data Lakehouse Enablement - Build and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data. - Ensure schema evolution, partitioning, and metadata management in Iceberg. - Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. - Integration & Orchestration - Work with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights. - Collaborate with Databricks teams to enable advanced analytics and machine learning use cases. - Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). - Performance, Security & Governance - Tune NiFi flows and Snowflake/Databricks ingestion for performance and cost optimization. - Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable). - Work with governance teams to enable lineage, metadata tracking, and auditability. Qualifications: - Bachelor’s degree in Computer Science, Information Systems, or related field. - 5+ years of data engineering experience, with at least 2+ years working with Apache NiFi. - Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark). - Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction). - Working knowledge of Snowflake and Databricks integration patterns. - Proficiency in SQL and one programming language (Python, Java, or Scala). - Understanding of data lakehouse architectures and ETL/ELT best practices.
-
(High Salary) Data Engineer
2 weeks ago
Bengaluru, India GoodScore Full timeCompany Overview: GoodScore is on a mission to make financial literacy and credit access simple, actionable, and inclusive for over 150 million Indians who are credit-underserved. From starting personalized credit consulting in 2023 to now, empowering over 1 million users to take control of their credit health, we are one of India’s fastest-growing credit...
-
(High Salary) Business Consulting
4 days ago
Bengaluru, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting - Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Data Management ....
-
[High Salary] Senior Data Engineer
4 weeks ago
Bengaluru, India Persistent Systems Full timeAbout Position: Senior Data Engineer/ lead and coordinate a high-performing offshore squad of data engineering contractors for our higher education client. You will serve as the primary point of contact between the offshore team and U.S.-based leadership, ensuring seamless execution of data engineering projects. - Role: Senior Data Engineer - Location:...
-
▷ High Salary: Sr Data Engineer
2 weeks ago
Bengaluru, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: . At...
-
High Salary! Data Engineer
3 weeks ago
Bengaluru, India Mindera Full timeJob Description Job description - We are looking for an experienced Data Engineer to join our team. - Here at Mindera, we are continuously developing a fantastic team and would love for you to join us. - As a Data Engineer, you will be responsible for building, maintaining, scaling, and integrating big data-based platforms. you will also be engaged with...
-
(High Salary) Data Engineer
6 days ago
Bengaluru, India ACL Digital Full time🚀 We’re Hiring: Data Engineers – Bangalore 🚀 Are you passionate about building your career in Data Engineering? We’re looking for talented Data Engineers with 4+ years of experience to join our Bangalore team! Location: Bangalore Experience: 4+ Years Interview Mode: Face-to-Face ONLY JD: · Technical Skills and Platforms: Python, Hadoop, HIVE,...
-
(High Salary) Data Engineer
2 weeks ago
Bengaluru, India SatSure Full timeAs a Data Engineer specializing in geospatial data, your primary responsibility is to design, build, and maintain data infrastructure and systems that handle geospatial information effectively. You will work closely with cross-functional teams, including data scientists, geospatial analysts, and software engineers, to ensure that geospatial data is...
-
▷ High Salary! Gcp Data Engineer
4 days ago
Bengaluru, India Impetus Full timeAbout the Organization- Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth. Founded in 1991, we are cloud and data engineering leaders...
-
Data Engineer
4 weeks ago
Bengaluru, India Mindera Full timeJob Description Job description Requirements - Implement/support new data solutions in datalake/datawarehouse built on snowflake. - Develop and design data pipelines using python, spark and snowflake. - Implement infrastructure as code using cloudformation and terraform. - Design and Implement Continuous Integration/Continuous Deployments pipelines. -...
-
Data Governance
6 days ago
Bengaluru, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Governance & Stewardship Architect to join our team in bangalore, Karntaka (IN-KA), India (IN). Role: Data...
