Data engineer

12 hours ago

Bhavnagar, India Keasis Full time

We are seeking a Data Engineer with strong Apache Ni Fi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms. Key Responsibilities Data Ingestion & Pipeline Development=Design, configure, and maintain Ni Fi data flows to extract, transform, and load data from Cloudera into Iceberg tables.Implement streaming and batch ingestion pipelines with Ni Fi processors and custom scripting where needed.Optimize Ni Fi workflows for scalability, reliability, and monitoring. Data Lakehouse EnablementBuild and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data.Ensure schema evolution, partitioning, and metadata management in Iceberg.Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. Integration & OrchestrationWork with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights.Collaborate with Databricks teams to enable advanced analytics and machine learning use cases.Integrate Ni Fi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). Performance, Security & GovernanceTune Ni Fi flows and Snowflake/Databricks ingestion for performance and cost optimization.Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable).Work with governance teams to enable lineage, metadata tracking, and auditability. QualificationsBachelor’s degree in Computer Science, Information Systems, or related field.5+ years of data engineering experience, with at least 2+ years working with Apache Ni Fi.Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark).Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction).Working knowledge of Snowflake and Databricks integration patterns.Proficiency in SQL and one programming language (Python, Java, or Scala).Understanding of data lakehouse architectures and ETL/ELT best practices.

  • Data engineer with databricks

    12 hours ago

    Bhavnagar, India KPG99 INC Full time

    Job Title: Databricks Engineer Location: RemoteDuration: 12 months Contract with extensions Job Description: REQUIRED SKILLS AND EXPERIENCE- 3–5 years of experience in data engineering roles - Strong hands-on experience with Databricks for data processing and pipeline development. - Proficiency in SQL for data querying, transformation, and troubleshooting....

  • Data Engineer

    3 weeks ago

    Bhavnagar, India INFEC Services Full time

    Key ResponsibilitiesDesign, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Implement and manage data warehouses, data lakes, or lakehouse architectures.Develop clean, efficient, and reusable Python scripts for automation,...

  • Only 24h Left! Senior Data Engineer

    4 days ago

    Bhavnagar, India eInfochips (An Arrow Company) Full time

    Role: Senior Data Engineer - (AWS, Opensearch) Years of Experience: 5-8 Years Location: Ahmedabad, Pune, Indore Notice Period: Immediate to 45 Days Max Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data...

  • Group Lead, It

    4 weeks ago

    Bhavnagar, India Kraft Heinz Full time

    Group Lead Data Engineering Position Summary The Kraft Heinz Information Technology organization is hiring a Group Lead for Data Engineering who will work closely with cross-functional teams to build high quality data analytic products These solutions will generate insights from the organization s connected data to advance data-driven decision-making...

  • Data Engineer – Pricing Systems

    1 week ago

    Bhavnagar, India EducoHire Full time

    Location Ichchhapor GIDC Surat Gujarat Industry Diamonds Experience 2-5 Years Salary Up to 35 000 Negotiable Role Summary We are seeking a skilled Data Engineer - Pricing Systems to develop and maintain data infrastructure supporting pricing automation The role involves building SQL views ETL pipelines and automation scripts to ensure smooth data flow...

  • Data Scientist

    3 days ago

    Bhavnagar, India SystemBender Full time

    Role: Data Scientist – AWS Location: Gurgaon/Pune/Bengaluru (Remote)Duration: 03-06 Months (Possibility of extension)Job Description: We are seeking a highly skilled and experienced Data Scientist for AWS to join our team and play a crucial role in designing and implementing data analytics solutions on the Amazon Web Services (AWS) platform. The ideal...

  • Learning support specialist

    3 weeks ago

    Bhavnagar, India Emeritus Full time

    About Emeritus:Emeritus is committed to teaching the skills of the future by making high-quality education accessible and affordable to individuals, companies, and governments around the world. It does this by collaborating with more than 50 top-tier universities across the United States, Europe, Latin America, Southeast Asia, India and China.Emeritus’...

  • Database Engineer

    4 weeks ago

    Bhavnagar, India Thinkwik Full time

    We are seeking a Database Engineer with 1 to 3 years of strong expertise in database design, optimization, and management. The ideal candidate will be skilled in architecting scalable, secure, and high-performance databases, ensuring data integrity, and supporting AI-driven applications. You will collaborate closely with our AI/Engineering teams to optimize...

  • Data Engineer

    3 days ago

    Bhavnagar, India Blue Cloud Softech Solutions Limited Full time

    Role- Data EngineerWork Mode- Remote Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.Profile SummaryData Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL...

  • ▷ Urgent! Production Engineer

    3 weeks ago

    Bhavnagar, India Dev HR Solutions Full time

    Job OverviewWe are seeking a dedicated and skilled Production Engineer to join our team in Ahmedabad The ideal candidate will have a minimum of 4 years to a maximum of 6 years of experience in production engineering This is a mid-level full-time position that requires strong knowledge of production processes quality control and safety compliance...