Data Engineer
2 weeks ago
Overview :
The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and unstructured data.
Key Responsibilities :
- Design and develop data pipelines using Snowflake, Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.
- Implement, maintain, and optimize data infrastructure on AWS, including Redshift, EMR, and Glue.
- Collaborate with data scientists and analysts to understand data requirements and implement the necessary data transformations and integrations.
- Ensure data quality and reliability by designing and implementing data cleansing and validation processes.
- Develop and maintain ETL processes using Informatica and DataStage to extract, transform, and load data from various sources.
- Optimize query performance and data distribution on Snowflake to ensure efficient data access and processing.
- Implement best practices for data security, encryption, and access control on Azure and AWS platforms.
- Participate in the evaluation and selection of new data management and analytics technologies to meet evolving business needs.
- Document data architecture, data flows, and data processes to facilitate knowledge sharing and collaboration.
- Provide technical guidance and support to junior data engineering team members.
Required Qualifications :
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience in designing and implementing data solutions on Snowflake, Azure, and AWS platforms.
- Expertise in using Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics for data management and analytics.
- Demonstrated proficiency in working with AWS Redshift, EMR, and Glue for data warehousing and ETL processes.
- Strong understanding of data integration and transformation using Informatica and DataStage.
- In-depth knowledge of SQL and programming languages such as Python or Java for data manipulation and automation.
- Experience in optimizing Snowflake data warehouse performance and scalability.
- Familiarity with data modeling, schema design, and data governance best practices.
- Ability to collaborate effectively with cross-functional teams and communicate complex technical concepts to non-technical stakeholders.
- Strong problem-solving skills and the ability to troubleshoot and optimize complex data pipelines.
- Experience with version control systems and continuous integration/continuous deployment (CI/CD) processes for data engineering projects.
- Certifications in relevant cloud platforms (e.g., Microsoft Azure, Amazon Web Services) and data engineering tools.
- Excellent written and verbal communication skills.
- Ability to adapt to new technologies and learn continuously in a fast-paced, dynamic environment.
-
Data Engineer
8 hours ago
Anywhere in India/Multiple Locations MWIDM Staffing Services Full timeResponsibilities :- Design, develop, and maintain efficient and reliable data pipelines using PySpark.- Implement ETL processes to ingest, transform, and load data from various sources.- Optimize PySpark code for performance and scalability.- Work with large datasets and distributed computing frameworks.- Develop and maintain data quality checks and...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Sureminds Full timeAs a Senior Data Engineer, you will be responsible for building and supporting large-scale data architectures that provide information to downstream systems and business users. We are seeking an innovative and experienced individual who can aggregate and organize data from multiple sources to streamline business decision-making. In your role, you will...
-
Data Engineer
3 days ago
Anywhere in India/Multiple Locations Insight Global Full timePosition : Data Engineer. Location : 100% Remote in India.Shift : Must be able to overlap with US team working 8 : 00am-5 : 00pm EST (Eastern Standard Time). Required Skills & Qualifications : .- 5-7+ years of experience as a Data Engineer.- Proficient in Apache Airflow and Google Cloud Platform (GCP).- Experience creating DAGs and workflows, monitoring...
-
Data Engineer
8 hours ago
Anywhere in India/Multiple Locations Screatives Software Services Pvt Ltd Full timeJob Title : Data EngineerExperience : 5 to 8 YearsLocation : RemoteContract : 6 months to 1 yearJob Description :We are seeking a skilled Data Engineer to assist in designing and implementing Snowflake-based analytics solutions on AWS. The ideal candidate will have experience in data lake and data warehouse architecture, data integration, and pipeline...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Patch Infotech Private Limited Full timeKey Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations CA-One Tech Cloud Full timeJob Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...
-
Data Engineer
3 days ago
Anywhere in India/Multiple Locations Uncap Research Labs Full timeKey Responsibilities :- Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.- Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.- Develop and implement data validation and testing processes to ensure that data is processed accurately and...
-
Data Engineer
1 week ago
Anywhere in India/Multiple Locations MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Title : Data Engineer - DBTExperience : 5 - 8 YearsLocation : GurgaonNotice period : 15 DaysJob Type : FTE/C2HWork Mode : RemoteJob Responsibilities : - Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS- Requirements definition, source data analysis and profiling, the logical...
-
Senior Data Engineer
3 days ago
Anywhere in India/Multiple Locations Appizion Consulting And Solutions Full timeAbout the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our data engineering team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines to support critical business decisions. You will work closely with data scientists, analysts, and engineers to build and...
-
Data Engineer Lead
6 days ago
Anywhere in India/Multiple Locations BLJ TECH GEEKS Full timeOverview of BLJ TECH GEEKS: A leading organization in the field of data engineering, seeking a skilled professional to join our team. We are looking for an experienced Data Engineer Lead who can lead complex projects from start to finish, ensuring timely delivery and high-quality results.Job Description:Beyond the core responsibilities of a Data Engineer,...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations Stratsol Software Systems Pvt Ltd Full timeJob Summary : We are looking for a skilled Data Engineer with expertise in Snowflake to join our team. As a Data Engineer, you will be responsible for building and managing scalable data pipelines, integrating data from various sources, and optimizing our data warehouse infrastructure. Skills Required : - Data Engineering : Snowflake, SQL, ETL- Data...
-
Data Engineer Innovator
6 days ago
Anywhere in India/Multiple Locations Sureminds Full time**Job Overview**We are seeking a highly skilled Senior Data Engineer to join our team at Sureminds. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data architectures that provide critical insights to our business stakeholders.In this role, you will collaborate closely with...
-
Data Engineering Specialist
1 week ago
Anywhere in India/Multiple Locations MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Description:MLOPS SOLUTIONS PRIVATE LIMITED is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing Snowflake-based analytics solutions on AWS. Your expertise in data engineering, architecture, and development will help us build efficient data pipelines and data management...
-
Data Engineering Specialist
6 hours ago
Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full timeCompany Overview:Resurgent Enterprise Solutions Private Limited is a leading provider of cutting-edge data engineering solutions.Job Description:We are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will design, build, and manage data pipelines using Azure Data Factory, Azure Databricks, and Azure...
-
Senior Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations RLS Associates Full timeSenior Data Engineer No. of Years : 12 - 15 yearsWork location : Anywhere in IndiaWork Mode : RemoteWork Type : Full time to Divit Technology Solutions Pvt. Ltd.Job Description :A software engineer in the role of data engineering role must be : - Proficient in designing, developing and testing code to build data infrastructure and pipeline processes for...
-
Data Engineering Specialist
22 hours ago
Anywhere in India/Multiple Locations Cybyrotek Solutions Full timeJob Title: Senior Data EngineerCompany Overview: Cybyrotek Solutions is a leading technology company that specializes in providing innovative data engineering solutions to its clients.Job Description: We are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations/India Techiebutler Full timeJob Title : Senior Data Engineer. Employment Type : Full-Time. Experience Required : 5+ Years. About Us : At Techiebutler, we pride ourselves on creating impactful data solutions that power innovative businesses. We are searching for a highly-skilled Senior Data Engineer who thrives in a collaborative environment and brings expertise from working in...
-
Data Engineer Specialist
7 hours ago
Anywhere in India/Multiple Locations MWIDM Staffing Services Full timeAbout MWIDM Staffing ServicesWe are a leading provider of staffing services, specializing in placing talented professionals in top data engineering roles.Job Description:The ideal candidate will have 5+ years of experience in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing...
-
Data Science Engineer
6 days ago
Anywhere in India/Multiple Locations Valiance Analytics Pvt. Ltd. Full timeAbout UsValiance Analytics Pvt. Ltd. is a global leader in AI & Data analytics, empowering clients to build cutting-edge technology solutions for digital transformation.We work with top brands across industries to deliver transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IoT analytics, and more. Our team...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Coders Brain Technology & Private Limited Full timeAbout the role :- As a Data Engineer Specialist, you will be a subject matter expert responsible for developing and maintaining data pipelines to assist us aggregate number of client data sources into a single view for our teams to utilize. The data is often incomplete, inconsistent and stored in silos with access primarily through APIs and FTPs. We are...