Lead Data Engineer

3 days ago


Any Location, IN TIU Consulting Full time

Job Description :


- Design, build and maintain highly scalable and available big data solutions on AWS cloud


- Develop and manage AWS Glue data catalog, crawlers, and ETL jobs

- Design and implement data synchronization solutions using AWS Datasync

- Manage and optimize S3 data storage and access patterns

- Develop and maintain Infrastructure as Code (IaC) using Terraform

- Develop and maintain AWS Lambda functions to automate data workflows

- Develop and optimize PySpark and Databricks-based data pipelines and analytics solutions

- Implement and manage Delta tables for data versioning, schema management, and performance optimization

- Understanding of Lakehouse architecture

- Knowledge on Databricks - Unity Catalog, data governance, AWS Tagging

- Write efficient SQL queries to extract insights from big data

- Implement basic DevOps practices, including CI/CD pipelines and Github workflows

- Collaborate with data scientists, data analysts, and other engineers to deliver data-driven solutions

- Keep up-to-date with the latest big data and cloud technologies and proactively apply them to improve our solutions

(ref:hirist.tech)

  • Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...


  • Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • MLOps Developer

    2 months ago


    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Developer

    4 weeks ago


    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Lead Data Scientist

    2 weeks ago


    Any Location, IN Multplyr Full time

    Key Responsibilities :Leadership & Strategy :- Lead the data science team in the research and development of innovative ML, NLP, LLM, and DL solutions.- Develop and execute a strategic roadmap for AI initiatives in alignment with business goals.- Mentor and guide junior data scientists and engineers, fostering a culture of continuous learning and...

  • Senior Data Engineer

    1 month ago


    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Senior Data Engineer

    4 weeks ago


    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Data Engineer

    2 months ago


    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    4 weeks ago


    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    1 month ago


    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    4 weeks ago


    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Big Data Engineer

    2 weeks ago


    Any Location, IN Programming.com Full time

    Job Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...

  • Senior Data Engineer

    4 weeks ago


    Any Location, IN UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...

  • AWS Data Engineer

    3 days ago


    Any Location, IN Vision Excel Career Solutions Full time

    Role : Data Engineer (AWS)Mandatory :- Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, preferably on AWS.- Experience in ingesting batch and streaming data from various data sources.- Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)- Experience in developing...


  • Any Location, IN Velotio Full time

    Description :Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT &...


  • Any Location, IN Velotio Full time

    Description :Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT &...

  • Data Engineer

    3 weeks ago


    Any Location, IN Infometry Full time

    Job Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...


  • Any Location, IN Victrix Systems & Labs Full time

    Job Title : GCP Cloud Data EngineerLocation : RemoteExperience : 2 to 7 yearsJob Description :We are seeking a talented Cloud Data Engineer to join our team on a remote basis.The ideal candidate will have a strong background in cloud migration, building ETL pipelines, data integrations, and the development of Operational Data Stores (ODS) and Data Warehouses...


  • Any Location, IN Victrix Systems & Labs Full time

    Job Title : GCP Cloud Data EngineerLocation : RemoteExperience : 2 to 7 yearsJob Description :We are seeking a talented Cloud Data Engineer to join our team on a remote basis.The ideal candidate will have a strong background in cloud migration, building ETL pipelines, data integrations, and the development of Operational Data Stores (ODS) and Data Warehouses...

  • Data Engineer

    3 days ago


    Any Location, IN Quantumbricks Full time

    About the Role :We are seeking a highly skilled and experienced Snowflake Data Engineer to join our team and play a crucial role in building and maintaining our data pipelines within the Snowflake cloud data warehouse. You will leverage your in-depth knowledge of Snowflake architecture and strong data engineering skills to design, develop, and optimize...