Data Engineer
1 month ago
We are seeking a skilled Data Engineer to join our dynamic team at Infometry. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives.
Key Responsibilities:- Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark to process large volumes of data efficiently.
- Architect and implement data storage solutions on Snowflake, ensuring optimal performance, reliability, and scalability.
- Develop and optimize SQL queries for data extraction, transformation, and analysis, ensuring adherence to best practices and performance optimization techniques.
- Collaborate with cross-functional teams to gather data requirements and translate business needs into technical solutions.
- Design and implement data models and schemas to support reporting, visualization, and business intelligence initiatives.
- Monitor and troubleshoot data pipelines and processes, identifying and resolving issues to ensure uninterrupted data flow and availability.
- Stay up-to-date with emerging technologies and industry trends in data engineering and analytics, contributing to continuous improvement and innovation within the team.
- Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred.
- Proven experience in data engineering, with expertise in Databricks and Apache Spark for large-scale data processing and analytics.
- Strong proficiency in SQL, with the ability to write complex queries and optimize performance for various database platforms, including Snowflake.
- Hands-on experience with Snowflake for cloud-based data warehousing, including data modeling, storage, and querying.
- Solid understanding of data warehousing concepts, dimensional modeling, and data governance principles.
- Experience with version control systems (e.g., Git) and CI/CD pipelines for code deployment and automation.
- Excellent problem-solving skills and attention to detail, with the ability to troubleshoot and debug complex data issues.
- Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
-
Data Engineer
2 months ago
Any Location, IN Blueridge Global Full timeAre you passionate about building state-of-the-art data platforms and powering the next generation of compute and AI applications, we'd love to hear from you. This is an exciting opportunity to leverage your expertise in distributed computing frameworks to make a significant impact as we push the boundaries of supply chain planning and eventually...
-
Data Engineering Specialist
4 weeks ago
Any Location, India First Phoenics Solutions Full timeJob DescriptionAt First Phoenics Solutions, we are seeking a highly skilled Data Engineering Specialist to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems and pipelines using programming languages such as Java, Scala, Python, C#, and SQL.Key Responsibilities:• Design and build...
-
Azure Data Engineer
4 weeks ago
Any Location, India Salorix Consulting Full timeData Engineer - Azure Data ServicesWe are seeking an experienced Data Engineer to join our team at Salorix Consulting. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Data Factory, Azure Databricks, and Azure Data Lake. You will work closely with data scientists and analysts to develop...
-
Senior Network Engineer
2 months ago
Any Location, IN Frontline Data Solutions Full timeWho We Are :Frontline Data Solutions provides web-based (SaaS) environmental, health, and safety software to some of the world's leading chemical, oil & gas, and manufacturing companies. Frontline's work culture combines the fast-paced, entrepreneurial culture of a startup software company with the stability and professionalism that reflects our...
-
Data Engineer
6 months ago
Any Location, IN Infometry Full timeJob Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...
-
Data Engineer
6 months ago
Any Location, India Infometry Full timeJob Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...
-
Data Engineer
1 month ago
Any Location, India tlnt Full timeJob Description : - Design, build, and maintain data pipelines in the Azure environment, ensuring smooth operation in both batch and real-time processing.- Optimize Azure data infrastructure to facilitate accurate data extraction, transformation, and loading from a variety of data sources.- Develop and automate ETL processes using tools like Pyspark, Azure...
-
Senior Data Integration Engineer
4 weeks ago
Any Location, India Employee Hub LLP Full timeJob Description :At Employee Hub LLP, we're seeking a skilled Data Warehousing and Processing Specialist to design, implement, and manage data integration processes. As a key member of our team, you'll be responsible for consolidating data from various sources into our data warehouse, utilizing Snowflake for data storage and processing.We're looking for...
-
Principal Data
1 month ago
Any Location, India Employee Hub LLP Full timePosition Overview : We are seeking an experienced and highly skilled Data and AI Principal Software Engineer to lead the design, development, and deployment of innovative data-driven and AI solutions. The ideal candidate will have a strong background in software engineering, data management, machine learning, and generative AI, with the ability to architect...
-
Senior Data Integration Engineer
1 month ago
Any Location, India Employee Hub LLP Full timeJob Description : - Design, implement, and manage data integration processes to consolidate data from various sources into our data warehouse. - Ensure seamless data flow and integration across systems.- Utilize Snowflake for data storage and processing, optimizing data architecture, and improving query performance. - Configure and manage Snowflake...
-
Data Engineer
4 weeks ago
Any Location, India Catalyst IQ Full timeJob Description:As a Data Engineer at Catalyst IQ, we are seeking a highly skilled professional to design, build, and maintain efficient ETL pipelines using Azure data services. The ideal candidate will have a strong proficiency in Python programming for data manipulation, transformation, and automation.Key Responsibilities:Design and develop scalable ETL...
-
Lead Data Engineer
2 months ago
Any Location, IN Zorba Consulting India Pvt. Ltd. Full timeJob Description :As a Lead Data Engineer, you will play a crucial role in driving data-driven initiatives within our organization. You will be responsible for designing, developing, and implementing scalable data solutions that support our business objectives. You will work closely with data scientists, analysts, and business stakeholders to ensure data...
-
Azure Data Engineer
1 month ago
Any Location, India Salorix Consulting Full timeJob Description : Key Responsibilities :- Design, build, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and Azure Data Lake.- Develop and optimize data processing workflows using Pyspark and Python, ensuring high performance and reliability.- Implement streaming data solutions using Azure Event Hub or Apache Kafka to manage...
-
AI Automation Engineer
2 months ago
Any Location, IN Ermin Systems Private Limited Full timeRole Description : This is a remote contract role for an AI Automation Engineer at Ermin Systems. The AI Automation Engineer will be responsible for troubleshooting, process control, electrical engineering, automation, and robotics tasks on a day-to-day basis. Qualifications : Experience :- 8+ years of experience in analytics engineering, with a strong...
-
AI Automation Engineer
4 weeks ago
Any Location, India Ermin Systems Private Limited Full timeRole Description : This is a remote contract role for an AI Automation Engineer at Ermin Systems. The AI Automation Engineer will be responsible for troubleshooting, process control, electrical engineering, automation, and robotics tasks on a day-to-day basis. Qualifications : Experience :- 8+ years of experience in analytics engineering, with a strong...
-
Senior Data and AI Principal Software Engineer
4 weeks ago
Any Location, India Employee Hub LLP Full timeJob DescriptionWe are seeking an exceptional Data and AI Principal Software Engineer to lead the development and deployment of innovative data-driven and AI solutions for smart manufacturing and Industry 4.0 applications. The ideal candidate will have a strong background in software engineering, data management, machine learning, and generative AI, with a...
-
Azure Data Engineer
1 month ago
Any Location, India Catalyst IQ Full timeJob Description : - Proven experience in designing, building, and maintaining ETL pipelines. - Strong proficiency in Python programming for data manipulation, transformation, and automation.Nice to Have :- Experience with Azure data services, including Azure Data Factory, Azure Databricks, and Azure SQL Database.- Knowledge of Terraform for infrastructure...
-
Senior Big Data Engineer
4 weeks ago
Any Location, India Freelancer Recruiter Full timeKey Responsibilities:As a Big Data DevOps Engineer, you will be responsible for managing the Big Data application stack, including HDFS, YARN, Spark, Hive, and HBase. Your tasks will involve configuring resource allocation, setting up high availability, and handling data recovery tasks. Additionally, you will work with middle-layer technologies such as web...
-
Data Architect
4 weeks ago
Any Location, India Blueridge Global Full timeWe are seeking a seasoned Data Engineer to drive the development of a cutting-edge data platform at Blueridge Global. This exciting opportunity involves leveraging distributed computing frameworks like Apache Spark, Databricks, and Snowflake to create a highly scalable, fault-tolerant data platform optimized for large-scale data processing and near real-time...
-
Data Scientist
4 weeks ago
Any Location, India Infometry Full timeJob Title: Data Engineer At Infometry, we are seeking a skilled Data Engineer to design, develop, and maintain data pipelines and infrastructure to support our data warehousing and analytics initiatives. Main Responsibilities: • Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark to process large...