Data Engineer

10 hours ago

Kannur, India Pierag Consulting Full time

Job Responsibilities Design and Develop Data Pipelines: Develop and optimise scalable data pipelines using Microsoft Fabric, including Fabric Notebooks, Dataflows Gen2, Data Pipelines, and Lakehouse architecture. Work on both batch and real-time ingestion and transformation. Integrate with Azure Data Factory or Fabric-native orchestration for smooth data flow. Fabric Data Platform Implementation Collaborate with data architects and engineers to implement governed Lakehouse models in Microsoft Fabric (OneLake). Ensure data solutions are performant, reusable, and aligned with business needs and compliance standards. Data Pipeline Optimisation Monitor and improve performance of data pipelines and notebooks in Microsoft Fabric. Apply tuning strategies to reduce costs, improve scalability, and ensure reliable data delivery across domains. Collaboration With Cross-functional Teams Work closely with BI developers, analysts, and data scientists to gather requirements and build high-quality datasets. Support self-service BI initiatives by developing well-structured datasets and semantic models in Fabric.Documentation And Reusability Document pipeline logic, lakehouse architecture, and semantic layers clearly. Follow development standards and contribute to internal best practices for Microsoft Fabric-based solutions. Microsoft Fabric Platform Execution Use your experience with Lakehouses, Notebooks, Data Pipelines, and Direct Lake in Microsoft Fabric to deliver reliable, secure, and efficient data solutions that integrate with Power BI, Azure Synapse, and other Microsoft services. Required Skills And Qualifications 5+ years of experience in data engineering within the Azure ecosystem, with relevant hands-on experience in Microsoft Fabric, including Lakehouse, Dataflows Gen2, and Data Pipelines.Proficiency in building and orchestrating pipelines with Azure Data Factory and/or Microsoft Fabric Dataflows Gen2.Solid experience with data ingestion, ELT/ETL development, and data transformation across structured and semi-structured sources.Strong understanding of OneLake architecture and modern data lakehouse patterns.Strong command of SQL,Pyspark, Python applied to both data integration and analytical workloads.Ability to collaborate with cross-functional teams and translate data requirements into scalable engineering solutions.Experience in optimising pipelines and managing compute resources for cost-effective data processing in Azure/Fabric.Preferred Skills Experience working in the Microsoft Fabric ecosystem, including Direct Lake, BI integration, and Fabric-native orchestration features.Familiarity with OneLake, Delta Lake, and Lakehouse principles in the context of Microsoft’s modern data platform.expert knowledge of PySpark, strong SQL, and Python scripting within Microsoft Fabric or Databricks notebooks.Understanding of Microsoft Purview or Unity Catalog, or Fabric-native tools for metadata, lineage, and access control.Exposure to DevOps practices for Fabric and Power BI, including Git integration, deployment pipelines, and workspace governance. Knowledge of Azure Databricks for Spark-based transformations and Delta Lake pipelines is a plus. 

  • Data engineer

    4 weeks ago

    Kannur, India Synechron Full time

    We have immediate opportunity for AWS Data Engineer.Job Role: AWS Data EngineerJob Location: Bangalore and PuneExperience- 4-12 YearsAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions....

  • Data Engineer-

    10 hours ago

    Kannur, India MyRemoteTeam Inc Full time

    About UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Python Coder – Data Processing Client: Wipro (Google Project) Location: Remote –...

  • Data Engineer

    3 weeks ago

    Kannur, India ACL Digital Full time

    Hello Folks,Grab the excellent opportunity with our companyExperience: 5+yearsNotice Period: Immediate to 15daysLocation: Bangalore/Hyderabad/Pune/Chennai/Noida/AhmedabadJob Description:5+Years in Data Engineering with GCPDatabricks-Unity CatalogRest APIUnit TestingPython/PysparkCICD/Terraform(Optional)Interested people can send their resumes to...

  • Data Engineer

    1 week ago

    Kannur, India Canopus Infosystems - A CMMI Level 3 Company Full time

    Job Title: Data Engineer (Analyst) Experience: 2+ Years Location: Remote About the Role: We are looking for an experienced Data Engineer (Analyst) who can design, build, and optimize data models and pipelines to support business intelligence and performance analytics. The ideal candidate should have a strong understanding of SQL, cloud data...

  • Senior Data Engineer

    4 days ago

    Kannur, India American Inference Full time

    About the CompanyWe are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines:Consulting Services: AI Strategy, Automation, and Digital Transformation for enterprises.SaaS Platform Development: Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.Data...

  • Big data engineer

    7 days ago

    Kannur, India Alef Education Full time

    Who we are Alef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic Ed Tech companies—reshaping how millions of students engage with learning across the globe. Today, Alef is proudly...

  • Azure data engineer

    7 days ago

    Kannur, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to explore varied technologies and quench your techie soul. We are hiring Databricks Engineer role Role: Azure Data Engineer Required Skill: Azure Databricks using Scala, Py Spark, Azure cloud Platform. Experience: 5-10...

  • Data Scientist

    2 days ago

    kannur, India CodeVyasa Full time

    Looking for Data Scientist | Gurgaon to join a team of rockstar developers. The candidate should have a minimum of 8yrs of experience.About CodeVyasa:CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+ people strong and we cater to...

  • Data Analyst

    4 weeks ago

    Kannur, India Sympera AI Full time

    𝗔𝗯𝗼𝘂𝘁 𝗨𝘀Sympera is an AI-driven banking intelligence platform designed to scale relationship banking. We enable financial institutions to deliver personalized services at scale by empowering bankers to focus on customer needs, provide value, and drive growth through a state-of-the-art, agentic, verticalized AI platform.We are a...

  • Data Analyst

    4 weeks ago

    Kannur, India Sympera AI Full time

    𝗔𝗯𝗼𝘂𝘁 𝗨𝘀Sympera is an AI-driven banking intelligence platform designed to scale relationship banking. We enable financial institutions to deliver personalized services at scale by empowering bankers to focus on customer needs, provide value, and drive growth through a state-of-the-art, agentic, verticalized AI platform.We are a...