Data Engineer

2 weeks ago

Any Location, India Infometry Full time

Job Description :

We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design efficient data solutions, and ensure data integrity and quality. The ideal candidate should have expertise in using databricks and Snowflake for ETL processes, proficiency in Python programming for scripting and automation, and a solid understanding of data warehousing concepts and SQL.

Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark to process large volumes of data efficiently.

- Architect and implement data storage solutions on Snowflake, ensuring optimal performance, reliability, and scalability.

- Develop and optimize SQL queries for data extraction, transformation, and analysis, ensuring adherence to best practices and performance optimization techniques.

- Collaborate with cross-functional teams to gather data requirements and translate business needs into technical solutions.

- Design and implement data models and schemas to support reporting, visualization, and business intelligence initiatives.

- Monitor and troubleshoot data pipelines and processes, identifying and resolving issues to ensure uninterrupted data flow and availability.

- Stay up-to-date with emerging technologies and industry trends in data engineering and analytics, contributing to continuous improvement and innovation within the team.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred.

- Proven experience in data engineering, with expertise in Databricks and Apache Spark for large-scale data processing and analytics.

- Strong proficiency in SQL, with the ability to write complex queries and optimize performance for various database platforms, including Snowflake.

- Hands-on experience with Snowflake for cloud-based data warehousing, including data modeling, storage, and querying.

- Solid understanding of data warehousing concepts, dimensional modeling, and data governance principles.

- Experience with version control systems (e.g., Git) and CI/CD pipelines for code deployment and automation.

- Excellent problem-solving skills and attention to detail, with the ability to troubleshoot and debug complex data issues.

- Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

(ref:hirist.tech)

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Data Engineer

    6 days ago

    Any Location, India Infometry Full time

    Job Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...

  • MLOps Developer

    1 month ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Developer

    3 weeks ago

    Any Location, India GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description : - Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring. - Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and...

  • MLOps Developer

    1 month ago

    Any Location, India GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description : - Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring. - Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and...

  • MLOps Developer

    3 weeks ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Senior Data Engineer

    6 days ago

    Any Location, India Staffington Consulting Pvt Ltd Full time

    Mandatory Skills : Data engineer , AWS Athena, AWS Glue, Redshift, Datalake, Lakehouse, Python, SQL ServerMust Have Experience: 6+ years of hands-on data engineering experience Expertise with AWS services: S3, Redshift, EMR, Glue, Kinesis, DynamoDB Building batch and real-time data pipelines Python, SQL coding for data processing and analysis Data modeling...

  • Senior Data Engineer

    6 days ago

    Any Location, India SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning applications.Position Overview :As a Senior Data Engineer, you will be responsible for architecting,...

  • Data Engineer

    2 months ago

    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    3 weeks ago

    Any Location, India Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage...

  • Data Engineer

    2 months ago

    Any Location, India Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage...

  • Data Engineer

    3 weeks ago

    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    4 weeks ago

    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    4 weeks ago

    Any Location, India Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    3 weeks ago

    Any Location, India Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    3 weeks ago

    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Senior Data Engineer

    3 weeks ago

    Any Location, India UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...