Data Engineer

4 weeks ago

Davangere, India Blue Cloud Softech Solutions Limited Full time

Role- Data EngineerWork Mode- Remote Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.Profile SummaryData Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams. Core SkillsMicrosoft Fabric• Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.• Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations. • Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports. • Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards. • Built and optimized Direct Lake models for low-latency Power BI reporting. • Developed advanced DAX measures and tabular models to support complex analytical dashboards. Google Cloud Platform (GCP) • Experience using BigQuery, improving performance and reducing query costs through partitioning and clustering. • Automated workflows using Cloud Functions to handle event-based data transformations and notifications. • Integrated real-time streaming data through Pub/Sub, enabling near real-time analytics pipelines. Technical Skills • Languages: Python, SQL, Spark SQL• Tools: Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc • Concepts: Data Modeling (Kimball, Data Vault), ETL/ELT, CI/CD, Data Governance, Security, Performance Optimization Experience Highlights • Led migration of on-prem ETL workflows to Microsoft Fabric • Built an end-to-end analytics solution combining BigQuery with Power BI • Designed a CI/CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation. • Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL. • Implemented Fabric security model to support row-level access and data masking across multiple business domains. • Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust. Education • Bachelor’s degree in Computer Science (or related field)

  • Senior data engineer

    2 days ago

    Davangere, India Atomic North Full time

    Position: Senior Data Engineer (Azure) Experience: 6+ years Skills: Azure Databricks, Py Spark, Python, SQL, Azure Data Factory, Data Modelling, Data Migration, Data Warehousing Location: India (Remote / Hybrid options available) Interview Mode: Virtual Notice Period: Immediate to 30 Days ???? Key Responsibilities Design and develop data pipelines and ETL...

  • Data/ML Engineer

    3 weeks ago

    Davangere, India Lilo Full time

    Lilo is revolutionizing procurement for Commercial Real Estate (CRE) businesses by providing a single platform to automate and optimize procurement processes using AI. From hotels to gyms, schools, and senior living homes, we streamline workflows like invoicing, vendor management, and price comparisons, saving our clients both time and money. We are already...

  • Backend engineer — data

    2 weeks ago

    Davangere, India Branch International Full time

    Branch OverviewImagine a world where every person has improved access to financial services. People could start new businesses, pay for their children’s education, cover their emergency medical bills – the possibilities to improve life are endless.Branch is a global technology company revolutionizing financial access for millions of underserved banking...

  • Senior Data Engineer

    3 weeks ago

    Davangere, India NOQ Full time

    Senior Data & Reporting Developer (Remote | India | Contract Role)Company: NOQ GroupLocation: RemoteContract Duration: 6 months (possibility of extension based on performance)Start Date: Immediate⸻About NOQ GroupNOQ Group is a technology-driven organization dedicated to delivering innovative data solutions for businesses in the food and beverage industry...

  • Data Architect

    2 days ago

    Davangere, India CareerUS Solutions Full time

    Position Overview: The Data Architect is responsible fordesigning, implementing, and managing the data architectureof the organization. This includes ensuring that data isaccurate, accessible, secure, and scalableacross all systems. The role focuses on developingdata models ,database solutions , andintegration frameworksthat support business intelligence,...

  • Data scientist

    3 weeks ago

    Davangere, India SystemBender Full time

    Role: Data Scientist – AWS Location: Gurgaon/Pune/Bengaluru (Remote)Duration: 03-06 Months (Possibility of extension)Job Description: We are seeking a highly skilled and experienced Data Scientist for AWS to join our team and play a crucial role in designing and implementing data analytics solutions on the Amazon Web Services (AWS) platform. The ideal...

  • Data Scientist

    2 weeks ago

    Davangere, India Live Connections Full time

    Role - AD Data Scientist Experience - 10+ years Budget - Up to 30 LPA max Required Notice Period - Immediate to 30 dats onlyMust Have 10+ years of hands-on experience in Machine Learning, Deep Learning, and Data Science. Strong programming skills in Python with frameworks like TensorFlow, PyTorch, Scikit-learn, LangChain, and Hugging Face Transformers....

  • Freelance data scientist

    2 days ago

    Davangere, India Leading MNC Full time

    Looking for a Freelance Data Scientist to join a team of rockstar developers. The candidate should have a minimum of 4+ yrs. of experience. There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...

  • Data test automation

    3 weeks ago

    Davangere, India RiDiK Full time

    We’re looking for a Data Test Automation to support our team in PAN India. This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you’re someone who takes initiative, values continuous learning, and thrives in a collaborative setting, we’d love to...

  • Solution & Data Architect - Azure Applications

    21 hours ago

    Davangere, India Infotechtion Full time

    Solution & Data Architect - Azure Applications Location: India (Remote) | Employment Type: Full-time | Senior - 8-11+ Years of experience About the Role We are seeking an accomplished Solution and Data Architect specializing in Azure-based applications. In this role, you will be responsible for designing secure, scalable, and robust...