Data engineer

4 days ago

Vijayawada, India Ubique Systems Full time

Primary skills: Python, SQL, data lakes, azure Experience: 4+ years Immediate Joiner Key Responsibilities Pipeline Development & Automation · Design, build, and maintain CI/CD pipelines to automate deployment of DQ rules and data services across environments. · Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks. · Implement best practices in version control, testing, and automated deployments. Data Quality & Rule Development · Develop, optimize, and maintain DQ rules in Py Spark/Python for self-serve capabilities. · Design and implement profiling frameworks for rule generation and automated remediation. · Ensure DQ frameworks align with enterprise standards, governance, and audit requirements. UI & Self-Serve Integration · Collaborate with front-end teams (Node.js/Angular) to enable rule configuration, validation, and monitoring via a low-code UI. · Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools. Collaboration & Governance · Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions. · Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines. · Provide inputs on governance, compliance, and change management processes. · Support periodic reviews and continuous improvements of pipelines, rules, and dashboards. Required Skills & Qualifications Strong programming skills in Py Spark, Python, and SQL. Hands-on experience with Databricks (clusters, notebooks, Delta Lake). Experience designing and implementing CI/CD pipelines (Azure Dev Ops / Git Hub Actions / Jenkins). Familiarity with Node.js & Angular for UI integration. Solid understanding of data governance, DQ frameworks, and MDM concepts. Strong analytical, problem-solving, and stakeholder engagement skills. Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse. Education & Experience Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field. 4–8 years of relevant experience in data engineering, CI/CD, and DQ rule development. Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.

  • Senior DevOps Engineer

    3 weeks ago

    Vijayawada, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : http://www.crestdata.ai Job Location-...

  • Data engineer

    4 days ago

    Vijayawada, India BayOne Solutions Full time

    The Opportunity: We are seeking a highly experienced Data Engineer to join our Mar Tech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and...

  • Data engineer

    3 weeks ago

    Vijayawada, India Insight Global Full time

    GCP DATA ENGINEER - Contract (Long term) 4–5+ years of experience as a Data Engineer with hands-on support for Google Looker. Strong experience in data modeling and building data marts. Proficiency in ETL/ELT pipeline development and SQL performance tuning. Experience with Look ML and semantic layer design in Looker. Familiarity with healthcare data and...

  • Data Engineer

    1 week ago

    Vijayawada, Andhra Pradesh, India Bonbloc Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    We are looking for a Data Engineer to design, build, and automate data pipelines and ML workflows that support AI-driven analytics and predictive insights. The ideal candidate will have hands-on experience with Python, ML frameworks, and real time data streaming platforms, enabling seamless integration of AI models with backend systems.Key...

  • Data Engineer Lead

    6 days ago

    Vijayawada, India JRD Systems Full time

    About the RoleWe are seeking an experienced Data Engineer Lead to design, develop, and maintain scalable data solutions on Azure and Databricks as part of our enterprise data modernization initiatives. The ideal candidate will have a strong background in data pipeline development, data integration frameworks , and cloud-based data engineering , with...

  • Data Engineer Lead

    5 days ago

    Vijayawada, India JRD Systems Full time

    About the RoleWe are seeking an experienced Data Engineer Lead to design, develop, and maintain scalable data solutions on Azure and Databricks as part of our enterprise data modernization initiatives. The ideal candidate will have a strong background in data pipeline development, data integration frameworks , and cloud-based data engineering , with...

  • Senior data engineer

    11 hours ago

    Vijayawada, India Live Connections Full time

    ???? Hiring: Data Engineer | 9-12 Years Experience | Remote (India) ???? Salary: Up to 26 LPA ????️ Skills: Python, SQL, Big Data, Cloud, Snowflake Job Description: We are looking for an experienced Data Engineer with strong hands-on expertise in designing and building scalable data pipelines and cloud-based data solutions. The ideal candidate will have...

  • Data Quality Engineer

    2 days ago

    Vijayawada, India CodeVyasa Full time

    Jole OverviewWe are seeking a highly skilled and motivated Data Quality Engineer || Remote with 8+ years of experience. If you're passionate about coding, problem-solving, and innovation, we'd love to hear from you!About UsCodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart,...

  • Data & analytics engineer

    2 weeks ago

    Vijayawada, India APPIT Software Inc Full time

    Data & Analytic Engineer Data Engineer : Snowflake -Mandatory – Hands -on Experience ETL Tool -Informatica (IVS version), BDT GCP : Big query – Mandatory -handson experience Data Modelling & Data Warehouse -Mandatory -Hands on Experience Analytic: Domo -High priority alternative experience in Power BI ,looker Should have good communication ,logical...

  • AWS Data Engineer

    2 weeks ago

    Vijayawada, India Coforge Full time

    We are seeking a highly skilled and experienced AWS Data Engineer with strong expertise in Streaming Data and Big Data Technologies, AWS, Python, & Spark. The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks.Key Responsibilities:Architect and implement...