(High Salary) Data Engineer

4 weeks ago

Bengaluru, India Mastek Full time

Data Engineer – NiFi / Cloudera / Iceberg / Snowflake / Databricks Overview We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms. Key Responsibilities: - Data Ingestion & Pipeline Development - Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables. - Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed. - Optimize NiFi workflows for scalability, reliability, and monitoring. - Data Lakehouse Enablement - Build and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data. - Ensure schema evolution, partitioning, and metadata management in Iceberg. - Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. - Integration & Orchestration - Work with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights. - Collaborate with Databricks teams to enable advanced analytics and machine learning use cases. - Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). - Performance, Security & Governance - Tune NiFi flows and Snowflake/Databricks ingestion for performance and cost optimization. - Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable). - Work with governance teams to enable lineage, metadata tracking, and auditability. Qualifications: - Bachelor’s degree in Computer Science, Information Systems, or related field. - 5+ years of data engineering experience, with at least 2+ years working with Apache NiFi. - Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark). - Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction). - Working knowledge of Snowflake and Databricks integration patterns. - Proficiency in SQL and one programming language (Python, Java, or Scala). - Understanding of data lakehouse architectures and ETL/ELT best practices.

  • (High Salary) Business Consulting

    4 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting - Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Data Management ....

  • High Salary! Data Engineer

    7 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: AWS Data EngineerRequired Skillset: AWS Data engineering, Python, Concepts and implementation experience of API, Problem-Solving and Analytical Skills Collaboration and CommunicationAgile Methodologies etc.Location: KolkataExperience Range: 4-8 yearsJob DescriptionMust-Have**- 3+ years of professional experience working with AWS...

  • (High Salary) Data Engineer

    2 weeks ago

    Bengaluru, India Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer (Python, Spark/Scala).Job Role: Data Engineer (Python, Spark/Scala)Job Location: BangaloreExperience-5 to 10 yearsNotice Period: Immediate joiner only.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India Zeta Full time

    About Zeta Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by Bhavin Turakhia and Ramki Gaddipati in 2015. Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing,...

  • ▷ High Salary! Data Engineer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    - Proven expertise in Google Cloud Data Engineering services like BigQuery, Dataproc, and more. - Strong programming skills in Python and PySpark for data manipulation and engineering. - Solid experience with SQL and NoSQL databases. - Deep understanding of data warehousing concepts and hands-on experience with modern data warehousing solutions. -...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    About the RoleThe Data Engineer (Pyspark) will play a crucial role in developing and maintaining data pipelines, ensuring data quality, and supporting data-driven decision-making across the organization.Required Skills- Pyspark - Airflow - DBT - SnowflakeResponsibilities- Understand existing ETL code or legacy code to identify source to target mappings -...

  • (High Salary) Data Engineer

    4 weeks ago

    Bengaluru, India ACL Digital Full time

    🚀 We’re Hiring: Data Engineers – Bangalore 🚀 Are you passionate about building your career in Data Engineering? We’re looking for talented Data Engineers with 4+ years of experience to join our Bangalore team! Location: Bangalore Experience: 4+ Years Interview Mode: Face-to-Face ONLY JD: · Technical Skills and Platforms: Python, Hadoop, HIVE,...

  • High Salary: Data Engineer

    3 days ago

    Bengaluru, India Networth Corp Full time

    Responsibilities: - Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services - End to end development lifecycle of complex large-scale and multi-user applications - Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios - Big Data ETL...

  • [High Salary] Data Engineer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Opening - PUNE/Bangalore/Hyd/ChennaiAbout the RoleRole - Data Engineer - Quantexa ,Big Data Hadoop, Spark and ScalaResponsibilities- Develop Spark and SCALA code as per requirement. - Build efficient and optimized ETLs for data ingestion/transformations. - Should be able to customize and update the Quantexa UI as per business requirement. - Documentation of...

  • ▷ High Salary! Gcp Data Engineer

    4 weeks ago

    Bengaluru, India Impetus Full time

    About the Organization- Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth. Founded in 1991, we are cloud and data engineering leaders...