Data Engineer
1 week ago
Overview :
The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and unstructured data.
Key Responsibilities :
- Design and develop data pipelines using Snowflake, Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.
- Implement, maintain, and optimize data infrastructure on AWS, including Redshift, EMR, and Glue.
- Collaborate with data scientists and analysts to understand data requirements and implement the necessary data transformations and integrations.
- Ensure data quality and reliability by designing and implementing data cleansing and validation processes.
- Develop and maintain ETL processes using Informatica and DataStage to extract, transform, and load data from various sources.
- Optimize query performance and data distribution on Snowflake to ensure efficient data access and processing.
- Implement best practices for data security, encryption, and access control on Azure and AWS platforms.
- Participate in the evaluation and selection of new data management and analytics technologies to meet evolving business needs.
- Document data architecture, data flows, and data processes to facilitate knowledge sharing and collaboration.
- Provide technical guidance and support to junior data engineering team members.
Required Qualifications :
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience in designing and implementing data solutions on Snowflake, Azure, and AWS platforms.
- Expertise in using Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics for data management and analytics.
- Demonstrated proficiency in working with AWS Redshift, EMR, and Glue for data warehousing and ETL processes.
- Strong understanding of data integration and transformation using Informatica and DataStage.
- In-depth knowledge of SQL and programming languages such as Python or Java for data manipulation and automation.
- Experience in optimizing Snowflake data warehouse performance and scalability.
- Familiarity with data modeling, schema design, and data governance best practices.
- Ability to collaborate effectively with cross-functional teams and communicate complex technical concepts to non-technical stakeholders.
- Strong problem-solving skills and the ability to troubleshoot and optimize complex data pipelines.
- Experience with version control systems and continuous integration/continuous deployment (CI/CD) processes for data engineering projects.
- Certifications in relevant cloud platforms (e.g., Microsoft Azure, Amazon Web Services) and data engineering tools.
- Excellent written and verbal communication skills.
- Ability to adapt to new technologies and learn continuously in a fast-paced, dynamic environment.
-
india Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
1 week ago
India Data Warehouse Engineer Full timeExperience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Expert for Analytics Projects
1 week ago
India Data Warehouse Engineer Full timeAbout the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.
-
Data Engineer
1 week ago
Anywhere in India/Multiple Locations Orangeskill Technologies Pvt Ltd Full timeJob Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...
-
Data Engineer
1 week ago
Anywhere in India/Multiple Locations PureSoftware Pvt Ltd. Full timeWe are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer, Mandatory Skills : - Databricks(PySpark, Scala) - Data Factory/Synapse - SQL DB and DW - Working knowledge on Git Roles and Responsibilities : Requirements : - 4+ years of experience working as a Data Engineer, with a focus on Azure cloud...
-
Data Engineering Lead
2 days ago
Anywhere in India/Multiple Locations RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full timeUnlock Your Potential as a Data Engineering Lead at RAPINNO TECH SOLUTIONS PRIVATE LIMITEDRAPINNO TECH SOLUTIONS PRIVATE LIMITED is seeking an exceptional Data Engineering Lead to spearhead the development of our data-driven initiatives. As a key member of our team, you will be responsible for designing and implementing robust data architectures that drive...
-
Anywhere in India/Multiple Locations Orangeskill Technologies Pvt Ltd Full timeJob Description:We are looking for an experienced Data Engineer to design, build, and maintain large-scale data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have expertise in workflow orchestration tools, database management, data streaming platforms, and cloud-based data engineering...
-
Data Engineer
3 days ago
Anywhere in India/Multiple Locations Machine Minds Full timeJob Description : Data EngineerThe Position : We are seeking an experienced Data Engineer to join our team of passionate professionals working on cutting-edge technology. In this role, you will be responsible for the ELT of Canibuild data using Python, Airflow, and SQL within an AWS environment. Additionally, you will create and maintain data...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
Data Engineer
1 week ago
Anywhere in India/Multiple Locations Crescendo Global Full timeJob Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...
-
Cloud Data Solutions Engineer
1 week ago
Anywhere in India/Multiple Locations Naukari Wale Full timeNaukari Wale is seeking a skilled Cloud Data Solutions Engineer to join our team.Job DescriptionWe are looking for an experienced professional to design, build, and maintain large-scale data engineering platforms on Azure. The ideal candidate will have strong expertise in cloud computing, data architecture, and software development using Python and SQL.The...
-
Lead Data Engineer
1 month ago
Anywhere in India/Multiple Locations ARR Recruitment Solutions Full timeJob Description :Required skills & experience :- Proficiency in data modeling and database management.- Strong programming skills in Pyspark, Python and SQL.- Experience with ETL (Extract, Transform, Load) processes.- Familiarity with strong data warehousing and Azure cloud platform with immense working knowledge in Databricks. - Knowledge of data governance...
-
Senior Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations Racrosoft Technologies Full timeAbout the Opportunity:We are seeking a skilled Azure Data Engineer to join our team at Racrosoft Technologies. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Cloud platforms.Responsibilities:Design, develop, and maintain data pipelines using Azure Data Factory...
-
Data Engineer
26 minutes ago
Anywhere in India/Multiple Locations Apidel Technologies Full timeData Engineer | 100% Remote | 12-Month Contract. We are looking for an experienced Data Engineer to join our team on a 12-month remote contract. This role offers a great opportunity to work with Azure services, including Azure Databricks, Azure DataFactory, and Azure DevOps, to build secure, scalable data pipelines. What You'll Do :- Develop data...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Aricent Full timeJob Profile : Data EngineerLocation : WFO/WFH (Both Available)Specialization : Cloud/Data ManagementJob Description :- Hold a Bachelor’s degree or diploma in Computer Science, Software Engineering, or Software Architecture; candidates with substantial industry experience are also eligible.- 2+ years of relevant engineering experience in Cloud/IT field.-...
-
Lead Data Engineer
18 hours ago
Anywhere in India/Multiple Locations Talentoj Full timeRequirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write...
-
Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations Prep Full timeJob Description : The ideal candidate will design, architect, and develop end-to-end data solutions on the Azure Stack platform. They will implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services. Collaboration with...
-
Data Engineer
18 hours ago
Anywhere in India/Multiple Locations DoublU Pty Ltd Full timeJob Overview :We are seeking a skilled GCP Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible,...