Data engineer
3 weeks ago
We are seeking a Data Engineer with strong Apache Ni Fi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms. Key Responsibilities Data Ingestion & Pipeline Development=Design, configure, and maintain Ni Fi data flows to extract, transform, and load data from Cloudera into Iceberg tables.Implement streaming and batch ingestion pipelines with Ni Fi processors and custom scripting where needed.Optimize Ni Fi workflows for scalability, reliability, and monitoring. Data Lakehouse EnablementBuild and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data.Ensure schema evolution, partitioning, and metadata management in Iceberg.Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. Integration & OrchestrationWork with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights.Collaborate with Databricks teams to enable advanced analytics and machine learning use cases.Integrate Ni Fi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). Performance, Security & GovernanceTune Ni Fi flows and Snowflake/Databricks ingestion for performance and cost optimization.Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable).Work with governance teams to enable lineage, metadata tracking, and auditability. QualificationsBachelor’s degree in Computer Science, Information Systems, or related field.5+ years of data engineering experience, with at least 2+ years working with Apache Ni Fi.Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark).Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction).Working knowledge of Snowflake and Databricks integration patterns.Proficiency in SQL and one programming language (Python, Java, or Scala).Understanding of data lakehouse architectures and ETL/ELT best practices.
-
Data Engineer
2 weeks ago
Bhavnagar, India Response Informatics Full timeWe’re Hiring | Data Engineering Experts (Hyderabad / Remote) We’re looking for passionate and experiencedData Engineering professionalsto join our growing team. If you love building scalable data pipelines, optimizing cloud-based workflows, and leading innovation in data infrastructure — we’d love to meet you! Open Positions: Data Engineer– 8 to 10...
-
Data Engineer
2 weeks ago
Bhavnagar, India Aptologics Full timeCompany Description Aptologics is a global Data & AI company that simplifies complex data, builds scalable analytics platforms, and operationalizes AI to drive measurable outcomes. We deliver tailored solutions that help enterprises move faster, decide smarter, and grow with confidence. Role Description We are looking for an experienced Data Engineer to join...
-
Data Engineer
3 weeks ago
Bhavnagar, India Aptologics Full timeCompany Description Aptologics is a global Data & AI company that simplifies complex data, builds scalable analytics platforms, and operationalizes AI to drive measurable outcomes. We deliver tailored solutions that help enterprises move faster, decide smarter, and grow with confidence. Role Description We are looking for an experienced Data Engineer to join...
-
Data Engineer
2 days ago
Bhavnagar, India People Prime Worldwide Full timeAbout Client: Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...
-
Data engineer with databricks
3 weeks ago
Bhavnagar, India KPG99 INC Full timeJob Title: Databricks Engineer Location: RemoteDuration: 12 months Contract with extensions Job Description: REQUIRED SKILLS AND EXPERIENCE- 3–5 years of experience in data engineering roles - Strong hands-on experience with Databricks for data processing and pipeline development. - Proficiency in SQL for data querying, transformation, and troubleshooting....
-
Data Engineer
3 weeks ago
Bhavnagar, India Kanerika Inc Full timeWho we are: Kanerika Inc. is a premier global software products and services firm that specializes in providing innovative solutions and services for data-driven enterprises. Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge...
-
Cloud Data Engineer
2 weeks ago
Bhavnagar, India Lemongrass Full timeAbout LemongrassLemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.We are...
-
▷ [29/10/2025] Data Engineer
2 weeks ago
Bhavnagar, India Cephei Infotech Full timeData Engineer (SQL & Python Expertise Required)Experience: 0.5-2 YearsCompany: Cephei InfotechJob Type: Full-TimeAbout UsCephei Infotech is a leading Data & Analytics-focused IT company, delivering scalable data engineering, business intelligence, and AI-driven solutions. We help businesses unlock the power of data through robust pipelines, real-time...
-
Only 24h Left! Senior Data Engineer
4 weeks ago
Bhavnagar, India eInfochips (An Arrow Company) Full timeRole: Senior Data Engineer - (AWS, Opensearch) Years of Experience: 5-8 Years Location: Ahmedabad, Pune, Indore Notice Period: Immediate to 45 Days Max Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data...
-
Data architect
2 hours ago
Bhavnagar, India CareerUS Solutions Full timePosition Overview: The Data Architect is responsible for designing, implementing, and managing the data architecture of the organization. This includes ensuring that data is accurate, accessible, secure, and scalable across all systems. The role focuses on developing data models , database solutions , and integration frameworks that support business...