Data Engineer

1 month ago


Any Location, India Infometry Full time
Job Title: Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team at Infometry. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives.

Key Responsibilities:
  • Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark to process large volumes of data efficiently.
  • Architect and implement data storage solutions on Snowflake, ensuring optimal performance, reliability, and scalability.
  • Develop and optimize SQL queries for data extraction, transformation, and analysis, ensuring adherence to best practices and performance optimization techniques.
  • Collaborate with cross-functional teams to gather data requirements and translate business needs into technical solutions.
  • Design and implement data models and schemas to support reporting, visualization, and business intelligence initiatives.
  • Monitor and troubleshoot data pipelines and processes, identifying and resolving issues to ensure uninterrupted data flow and availability.
  • Stay up-to-date with emerging technologies and industry trends in data engineering and analytics, contributing to continuous improvement and innovation within the team.
Requirements:
  • Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred.
  • Proven experience in data engineering, with expertise in Databricks and Apache Spark for large-scale data processing and analytics.
  • Strong proficiency in SQL, with the ability to write complex queries and optimize performance for various database platforms, including Snowflake.
  • Hands-on experience with Snowflake for cloud-based data warehousing, including data modeling, storage, and querying.
  • Solid understanding of data warehousing concepts, dimensional modeling, and data governance principles.
  • Experience with version control systems (e.g., Git) and CI/CD pipelines for code deployment and automation.
  • Excellent problem-solving skills and attention to detail, with the ability to troubleshoot and debug complex data issues.
  • Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

  • Data Engineer

    2 months ago


    Any Location, IN Blueridge Global Full time

    Are you passionate about building state-of-the-art data platforms and powering the next generation of compute and AI applications, we'd love to hear from you. This is an exciting opportunity to leverage your expertise in distributed computing frameworks to make a significant impact as we push the boundaries of supply chain planning and eventually...


  • Any Location, India First Phoenics Solutions Full time

    Job DescriptionAt First Phoenics Solutions, we are seeking a highly skilled Data Engineering Specialist to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems and pipelines using programming languages such as Java, Scala, Python, C#, and SQL.Key Responsibilities:•​ Design and build...

  • Azure Data Engineer

    4 weeks ago


    Any Location, India Salorix Consulting Full time

    Data Engineer - Azure Data ServicesWe are seeking an experienced Data Engineer to join our team at Salorix Consulting. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Data Factory, Azure Databricks, and Azure Data Lake. You will work closely with data scientists and analysts to develop...


  • Any Location, IN Frontline Data Solutions Full time

    Who We Are :Frontline Data Solutions provides web-based (SaaS) environmental, health, and safety software to some of the world's leading chemical, oil & gas, and manufacturing companies. Frontline's work culture combines the fast-paced, entrepreneurial culture of a startup software company with the stability and professionalism that reflects our...

  • Data Engineer

    6 months ago


    Any Location, IN Infometry Full time

    Job Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...

  • Data Engineer

    6 months ago


    Any Location, India Infometry Full time

    Job Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...

  • Data Engineer

    1 month ago


    Any Location, India tlnt Full time

    Job Description : - Design, build, and maintain data pipelines in the Azure environment, ensuring smooth operation in both batch and real-time processing.- Optimize Azure data infrastructure to facilitate accurate data extraction, transformation, and loading from a variety of data sources.- Develop and automate ETL processes using tools like Pyspark, Azure...


  • Any Location, India Employee Hub LLP Full time

    Job Description :At Employee Hub LLP, we're seeking a skilled Data Warehousing and Processing Specialist to design, implement, and manage data integration processes. As a key member of our team, you'll be responsible for consolidating data from various sources into our data warehouse, utilizing Snowflake for data storage and processing.We're looking for...

  • Principal Data

    1 month ago


    Any Location, India Employee Hub LLP Full time

    Position Overview : We are seeking an experienced and highly skilled Data and AI Principal Software Engineer to lead the design, development, and deployment of innovative data-driven and AI solutions. The ideal candidate will have a strong background in software engineering, data management, machine learning, and generative AI, with the ability to architect...


  • Any Location, India Employee Hub LLP Full time

    Job Description : - Design, implement, and manage data integration processes to consolidate data from various sources into our data warehouse. - Ensure seamless data flow and integration across systems.- Utilize Snowflake for data storage and processing, optimizing data architecture, and improving query performance. - Configure and manage Snowflake...

  • Data Engineer

    4 weeks ago


    Any Location, India Catalyst IQ Full time

    Job Description:As a Data Engineer at Catalyst IQ, we are seeking a highly skilled professional to design, build, and maintain efficient ETL pipelines using Azure data services. The ideal candidate will have a strong proficiency in Python programming for data manipulation, transformation, and automation.Key Responsibilities:Design and develop scalable ETL...

  • Lead Data Engineer

    2 months ago


    Any Location, IN Zorba Consulting India Pvt. Ltd. Full time

    Job Description :As a Lead Data Engineer, you will play a crucial role in driving data-driven initiatives within our organization. You will be responsible for designing, developing, and implementing scalable data solutions that support our business objectives. You will work closely with data scientists, analysts, and business stakeholders to ensure data...

  • Azure Data Engineer

    1 month ago


    Any Location, India Salorix Consulting Full time

    Job Description : Key Responsibilities :- Design, build, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and Azure Data Lake.- Develop and optimize data processing workflows using Pyspark and Python, ensuring high performance and reliability.- Implement streaming data solutions using Azure Event Hub or Apache Kafka to manage...

  • AI Automation Engineer

    2 months ago


    Any Location, IN Ermin Systems Private Limited Full time

    Role Description : This is a remote contract role for an AI Automation Engineer at Ermin Systems. The AI Automation Engineer will be responsible for troubleshooting, process control, electrical engineering, automation, and robotics tasks on a day-to-day basis. Qualifications : Experience :- 8+ years of experience in analytics engineering, with a strong...


  • Any Location, India Ermin Systems Private Limited Full time

    Role Description : This is a remote contract role for an AI Automation Engineer at Ermin Systems. The AI Automation Engineer will be responsible for troubleshooting, process control, electrical engineering, automation, and robotics tasks on a day-to-day basis. Qualifications : Experience :- 8+ years of experience in analytics engineering, with a strong...


  • Any Location, India Employee Hub LLP Full time

    Job DescriptionWe are seeking an exceptional Data and AI Principal Software Engineer to lead the development and deployment of innovative data-driven and AI solutions for smart manufacturing and Industry 4.0 applications. The ideal candidate will have a strong background in software engineering, data management, machine learning, and generative AI, with a...

  • Azure Data Engineer

    1 month ago


    Any Location, India Catalyst IQ Full time

    Job Description : - Proven experience in designing, building, and maintaining ETL pipelines. - Strong proficiency in Python programming for data manipulation, transformation, and automation.Nice to Have :- Experience with Azure data services, including Azure Data Factory, Azure Databricks, and Azure SQL Database.- Knowledge of Terraform for infrastructure...


  • Any Location, India Freelancer Recruiter Full time

    Key Responsibilities:As a Big Data DevOps Engineer, you will be responsible for managing the Big Data application stack, including HDFS, YARN, Spark, Hive, and HBase. Your tasks will involve configuring resource allocation, setting up high availability, and handling data recovery tasks. Additionally, you will work with middle-layer technologies such as web...

  • Data Architect

    4 weeks ago


    Any Location, India Blueridge Global Full time

    We are seeking a seasoned Data Engineer to drive the development of a cutting-edge data platform at Blueridge Global. This exciting opportunity involves leveraging distributed computing frameworks like Apache Spark, Databricks, and Snowflake to create a highly scalable, fault-tolerant data platform optimized for large-scale data processing and near real-time...

  • Data Scientist

    4 weeks ago


    Any Location, India Infometry Full time

    Job Title: Data Engineer At Infometry, we are seeking a skilled Data Engineer to design, develop, and maintain data pipelines and infrastructure to support our data warehousing and analytics initiatives. Main Responsibilities: • Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark to process large...