Data Engineer

5 days ago

Jamnagar, India Ubique Systems Full time

Primary skills: Python, SQL, data lakes, azureExperience: 4+ yearsImmediate JoinerKey ResponsibilitiesPipeline Development & Automation· Design, build, and maintain CI/CD pipelines to automate deployment of DQ rules and data services across environments.· Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks.· Implement best practices in version control, testing, and automated deployments.Data Quality & Rule Development· Develop, optimize, and maintain DQ rules in PySpark/Python for self-serve capabilities.· Design and implement profiling frameworks for rule generation and automated remediation.· Ensure DQ frameworks align with enterprise standards, governance, and audit requirements.UI & Self-Serve Integration· Collaborate with front-end teams (Node.js/Angular) to enable rule configuration, validation, and monitoring via a low-code UI.· Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools.Collaboration & Governance· Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions.· Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines.· Provide inputs on governance, compliance, and change management processes.· Support periodic reviews and continuous improvements of pipelines, rules, and dashboards. Required Skills & QualificationsStrong programming skills in PySpark, Python, and SQL.Hands-on experience with Databricks (clusters, notebooks, Delta Lake).Experience designing and implementing CI/CD pipelines (Azure DevOps / GitHub Actions / Jenkins).Familiarity with Node.js & Angular for UI integration.Solid understanding of data governance, DQ frameworks, and MDM concepts.Strong analytical, problem-solving, and stakeholder engagement skills.Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse. Education & ExperienceBachelor’s or Master’s degree in Computer Science, Information Systems, or related field.4–8 years of relevant experience in data engineering, CI/CD, and DQ rule development.Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.

  • Software Engineer/Senior Software Engineer/Technical Lead

    4 weeks ago

    Jamnagar, India Crest Data Full time

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key Responsibilities -- Responsible for providing expertise in...

  • Sr. Site Reliability Engineer, L2(Network)

    4 weeks ago

    Jamnagar, India Crest Data Full time

    Hiring Sr. Site Reliability Engineer (Network) L2 | CCNA Certified Experience - 5+ Years Location - Ahmedabad Certifications Required - CCNA / CCNP Certified Network Engineering: - Complex Operations: Can manage and optimize complex network environments, including large-scale deployments and high-availability systems. - Advanced Troubleshooting: Proficient...

  • Senior Data Engineer

    3 weeks ago

    Jamnagar, India Egen Full time

    Senior Data Engineer – GCP Job Overview: We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data...

  • Data Engineer

    6 days ago

    Jamnagar, India Kanerika Inc Full time

    Who we are: Kanerika Inc. is a premier global software products and services firm that specializes in providing innovative solutions and services for data-driven enterprises. Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge...

  • Lead Data Engineer

    2 weeks ago

    Jamnagar, India Advantmed Full time

    Lead Data Engineer – Azure Cloud We are looking for an experienced Lead Data Engineer to build and manage a robust data platform on Azure Cloud. The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologies for efficient data processing. Key Responsibilities - Develop and maintain data...

  • Azure data engineer

    2 weeks ago

    Jamnagar, India SystemBender Full time

    *Role: Azure Data Engineer* • Advance SQL Azure Data Factory (ADF) Databricks with Py Spark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (Py Spark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...

  • Senior data engineer

    3 weeks ago

    Jamnagar, India TeamLease Edtech Full time

    Team Lease Ed Tech, part of Team Lease Services, focuses on making India employable through online, work-integrated, and distance learning programs. It partners with 50+ universities and 4,000+ corporates to deliver degree, diploma, and upskilling programs. Their “Digivarsity” platform enables students to study while gaining real-world work experience....

  • Director of data engineering – 100% remote

    5 days ago

    Jamnagar, India Hyly.AI Full time

    Company Description Hyly. AI is multifamily’s only Intelligence Fabric™, weaving Artificial, Business, and Human intelligence into one operating system for growth. The company connects raw data to decisions, decisions to actions, and actions to measurable outcomes, turning complexity into clarity. Founded in 2010, Hyly. AI has been helping multifamily...

  • Lead Data Engineer – Python

    2 weeks ago

    Jamnagar, India People Prime Worldwide Full time

    Job Title: Lead Data Engineer – Python & GCPExperience: 10+ YearsLocation: HyderabadInterview Mode: Face-to-FaceAbout the RoleWe are seeking an experienced Lead Data Engineer with deep expertise in Python and Google Cloud Platform (GCP). This role involves designing and building scalable data solutions, developing ETL/ELT pipelines, and leading the...

  • Project Manager – Data Engineering

    2 weeks ago

    Jamnagar, India Brillio Full time

    About the Company: We are looking for a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics. You will manage cross-functional teams to execute data platform, pipeline, and analytics initiatives, ensuring alignment with business goals and timely delivery.About the Role: A short paragraph summarizing the key role...