▷ (Urgent Search) Data Engineer

3 weeks ago

Rajahmundry, India Keasis Full time

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms. Key Responsibilities Data Ingestion & Pipeline Development= Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables. Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed. Optimize NiFi workflows for scalability, reliability, and monitoring. Data Lakehouse Enablement Build and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data. Ensure schema evolution, partitioning, and metadata management in Iceberg. Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. Integration & Orchestration Work with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights. Collaborate with Databricks teams to enable advanced analytics and machine learning use cases. Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). Performance, Security & Governance Tune NiFi flows and Snowflake/Databricks ingestion for performance and cost optimization. Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable). Work with governance teams to enable lineage, metadata tracking, and auditability. Qualifications Bachelor’s degree in Computer Science, Information Systems, or related field. 5+ years of data engineering experience, with at least 2+ years working with Apache NiFi. Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark). Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction). Working knowledge of Snowflake and Databricks integration patterns. Proficiency in SQL and one programming language (Python, Java, or Scala). Understanding of data lakehouse architectures and ETL/ELT best practices.

  • Senior DevOps Engineer

    2 days ago

    Rajahmundry, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Data Engineer

    3 weeks ago

    Rajahmundry, India Insight Global Full time

    Position: GCP Data Engineer Location: 100% Remote in India Duration: 12 month contract + extensions + conversions Package: 10 LPA- 26 LPA Interview Process: 2 Rounds REQUIRED SKILLS AND EXPERIENCE 6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience...

  • [Urgent Search] Python Facilitator

    2 weeks ago

    Rajahmundry, AP, IN GlobalOneServices Full time

    We are looking for a knowledgeable and enthusiastic DSA with Python Facilitator to train and mentor students or professionals in mastering data structures and algorithms using Python The facilitator will be responsible for delivering structured interactive sessions focused on problem-solving algorithmic thinking and coding interview preparation Key...

  • Associate director, search

    2 weeks ago

    Rajahmundry, India Atidiv Full time

    Title: Associate Director, Search & SocialLocation: Remote (India)Why Atidiv?Atidiv was built to ignite hyper growth. We are the solution for sustainable and scalable growth. Atidiv is a provider of data science, product development & offshoring solutions for internet and tech businesses. Today, we serve the movers and shakers of the tech ecosystem in over...

  • Senior Data Engineer- Data modelling experience required

    2 weeks ago

    Rajahmundry, India COREDATA CONSULTANCY Full time

    We're looking for an experienced and dynamic Data Lead to drive the full lifecycle of our data engineering solutions, from strategic design to hands-on implementation. In this key role, you will be a hands-on architect, building secure and scalable data platforms while mentoring our engineering teams.Responsibilities●    Design and develop robust,...

  • Senior Data Engineer- Data modelling experience required

    2 weeks ago

    Rajahmundry, India COREDATA CONSULTANCY Full time

    We're looking for an experienced and dynamic Data Lead to drive the full lifecycle of our data engineering solutions, from strategic design to hands-on implementation. In this key role, you will be a hands-on architect, building secure and scalable data platforms while mentoring our engineering teams.Responsibilities●    Design and develop robust,...

  • Senior Data Engineer

    2 weeks ago

    Rajahmundry, India SAIVA AI Full time

    We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production.This is a fully remote role, open to candidates based in Europe or India, with...

  • AI Web Scraping Engineer

    2 days ago

    Rajahmundry, India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinkingWeb Scraping Engineerwho leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development.The Role: Design and implement scalable data extraction solutions using AI to rapidly...

  • Urgent: Artificial Intelligence Engineer

    3 weeks ago

    Rajahmundry, India SystemBender Full time

    🚀 We’re Hiring – AWS Developer (AI & ML Focus) 📍 Location: Remote Experience-3-5 Years Mandate Skills- AWS Cloud Services, OpenAI, Yolo, AI Are you passionate about building intelligent, AI-powered applications? Join our innovative team and work on cutting-edge solutions leveraging to deliver next-gen automation, predictive insights, and AI-driven...

  • ▷ Urgent Search: Finance Manager

    2 weeks ago

    Rajahmundry, India Akarsh Design Full time

    Location: Rajahmundry, Andhra Pradesh Type: Full-time | On-site | Immediate Relocation Preferred About the Role We are seeking an experienced Finance Manager with a strong background in Public-Private Partnership (PPP) projects, infrastructure finance, and project strategy. The ideal candidate will bring both technical financial expertise and a strategic...