Data Engineer

8 hours ago

Anywhere in IndiaMultiple Locations Risk Resources LLP Full time ₹ 10,00,000 - ₹ 15,00,000 per year

Overview :

The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and unstructured data.

Key Responsibilities :

- Design and develop data pipelines using Snowflake, Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.

- Implement, maintain, and optimize data infrastructure on AWS, including Redshift, EMR, and Glue.

- Collaborate with data scientists and analysts to understand data requirements and implement the necessary data transformations and integrations.

- Ensure data quality and reliability by designing and implementing data cleansing and validation processes.

- Develop and maintain ETL processes using Informatica and DataStage to extract, transform, and load data from various sources.

- Optimize query performance and data distribution on Snowflake to ensure efficient data access and processing.

- Implement best practices for data security, encryption, and access control on Azure and AWS platforms.

- Participate in the evaluation and selection of new data management and analytics technologies to meet evolving business needs.

- Document data architecture, data flows, and data processes to facilitate knowledge sharing and collaboration.

- Provide technical guidance and support to junior data engineering team members.

Required Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Proven experience in designing and implementing data solutions on Snowflake, Azure, and AWS platforms.

- Expertise in using Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics for data management and analytics.

- Demonstrated proficiency in working with AWS Redshift, EMR, and Glue for data warehousing and ETL processes.

- Strong understanding of data integration and transformation using Informatica and DataStage.

- In-depth knowledge of SQL and programming languages such as Python or Java for data manipulation and automation.

- Experience in optimizing Snowflake data warehouse performance and scalability.

- Familiarity with data modeling, schema design, and data governance best practices.

- Ability to collaborate effectively with cross-functional teams and communicate complex technical concepts to non-technical stakeholders.

- Strong problem-solving skills and the ability to troubleshoot and optimize complex data pipelines.

- Experience with version control systems and continuous integration/continuous deployment (CI/CD) processes for data engineering projects.

- Certifications in relevant cloud platforms (e.g., Microsoft Azure, Amazon Web Services) and data engineering tools.

- Excellent written and verbal communication skills.

- Ability to adapt to new technologies and learn continuously in a fast-paced, dynamic environment.

  • Data Engineer

    2 days ago

    Anywhere in India/Multiple Locations Firstcareercentre Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Essential Duties & Responsibilities : - Design, develop, and optimize scalable data pipelines for ETL/ELT processes. - Develop and maintain Python-based data processing scripts and automation tools. - Write and optimize complex SQL queries (preferably in Snowflake) for data transformation and analytics. - Work with Jenkins or other CI/CD tools to...

  • Data Engineer

    2 days ago

    Anywhere in India/Multiple Locations Techno Wise Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Data Engineer (SAS DQ Conversion) Location : PAN INDIA (Preferred Hyderabad) - Hybrid Experience : 4+ YearsAbout the Role : We are seeking a motivated and detail-oriented Data Engineer to join our team. The ideal candidate will have hands-on experience with SQL, particularly translating between different SQL dialects, and a strong background or...

  • Data Engineering Manager

    9 hours ago

    Anywhere in India/Multiple Locations YipitData Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Us : YipitData is the leading market research and analytics firm for the disruptive economy and most recently raised $475M from The Carlyle Group at a valuation of over $1B. Every day, our proprietary technology analyzes billions of alternative data points to uncover actionable insights across sectors like software, AI, cloud, e-commerce,...

  • Senior Data Engineer

    8 hours ago

    Anywhere in India/Multiple Locations Techno Wise Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    The Senior Data Engineer will be responsible for building new segments in a Customer Data Platform (CDP), maintaining the segments, understanding the data requirements for use cases, data integrity, data quality and data sources involved to build the specific use cases. The resource should also have an understanding of ETL processes. This position will...

  • Senior Lead Data Engineer

    11 hours ago

    Anywhere in India/Multiple Locations People Prime Worldwide Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    About Client : Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000 associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • NucleusTeq - Big Data Engineer - Spark/Scala

    2 days ago

    Anywhere in India/Multiple Locations NucleusTeq Consulting Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role : Big Data Engineer Responsibilities : - Big Data Engineer with 5-6 years of experience - Experience in leading a team of engineers and a good attitude toward learning the domain and implementation - Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS. - Finalizing the scope of the...

  • Data Engineer

    2 days ago

    Multiple Locations, India InCommon Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking hands-on Data Engineers with strong data migration experience and exposure to diverse database systems.Responsibilities : - Migrate ETL pipelines and plugins from Fivetran into Nexla/Snowflake. - Build automation for ingestion, transformation, and observability. - Deliver under tight deadlines in a fast-paced environment. - This is a...

  • Data Engineer

    2 days ago

    Multiple Locations, India Kane Solutions Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Job Description : This is a full-time remote role for a Data Engineer at Kane Solutions. We are seeking a detail-oriented and analytical professional with strong command over Python, SQL, and data analysis to join our growing teamRole and Responsibilities : - Write efficient and clean Python scripts for data extraction, transformation, and processing ...

  • Data Engineer III

    6 hours ago

    Multiple Locations, India YO IT CONSULTING Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Profile - Data EngineerExperience - 5-8 yearsLocation - HyderabadWork Mode - Contractual (Remote)Duration - 3 monthsMust Have - Python, Databricks, Pyspark. Roles & Responsibilities : We are currently seeking a highly motivated Data Engineer III with experience in Healthcare Domain This role collaborate closely with product teams, software engineers...

  • Snowflake Data Architect

    10 hours ago

    Anywhere in India/Multiple Locations Vision Excel Career Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title : Snowflake Data ArchitectLocation : Pune / Hyderabad / Gr. Noida (Hybrid - 3 days from office in a week)Employment Type : Full-TimeExperience Level : 1218 YearsRole Overview : We are seeking a highly experienced and visionary Snowflake Data Architect to lead the design, development, and optimization of our cloud data platform. This role...