Data Engineer

6 days ago

india Risk Resources LLP Full time

Overview :

The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and unstructured data.

Key Responsibilities :

- Design and develop data pipelines using Snowflake, Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.

- Implement, maintain, and optimize data infrastructure on AWS, including Redshift, EMR, and Glue.

- Collaborate with data scientists and analysts to understand data requirements and implement the necessary data transformations and integrations.

- Ensure data quality and reliability by designing and implementing data cleansing and validation processes.

- Develop and maintain ETL processes using Informatica and DataStage to extract, transform, and load data from various sources.

- Optimize query performance and data distribution on Snowflake to ensure efficient data access and processing.

- Implement best practices for data security, encryption, and access control on Azure and AWS platforms.

- Participate in the evaluation and selection of new data management and analytics technologies to meet evolving business needs.

- Document data architecture, data flows, and data processes to facilitate knowledge sharing and collaboration.

- Provide technical guidance and support to junior data engineering team members.

Required Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Proven experience in designing and implementing data solutions on Snowflake, Azure, and AWS platforms.

- Expertise in using Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics for data management and analytics.

- Demonstrated proficiency in working with AWS Redshift, EMR, and Glue for data warehousing and ETL processes.

- Strong understanding of data integration and transformation using Informatica and DataStage.

- In-depth knowledge of SQL and programming languages such as Python or Java for data manipulation and automation.

- Experience in optimizing Snowflake data warehouse performance and scalability.

- Familiarity with data modeling, schema design, and data governance best practices.

- Ability to collaborate effectively with cross-functional teams and communicate complex technical concepts to non-technical stakeholders.

- Strong problem-solving skills and the ability to troubleshoot and optimize complex data pipelines.

- Experience with version control systems and continuous integration/continuous deployment (CI/CD) processes for data engineering projects.

- Certifications in relevant cloud platforms (e.g., Microsoft Azure, Amazon Web Services) and data engineering tools.

- Excellent written and verbal communication skills.

- Ability to adapt to new technologies and learn continuously in a fast-paced, dynamic environment.

(ref:hirist.tech)

  • Lead Data Engineer

    1 week ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    1 week ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    1 week ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    1 week ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Data Engineer

    2 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: ....

  • Azure Data Engineer

    21 hours ago

    Hyderabad, India Fragma Data Systems Full time

    Job Description Must-Have Skills - Good experience in Pyspark - Including Dataframe core functions and Spark SQL - Good experience in SQL DBs - Be able to write queries including fair complexity. - Should have excellent experience in Big Data programming for data transformation and aggregations - Good at ELT architecture. Business rules processing and data...

  • Data Engineer

    1 week ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). - 6+ years of experience in Data...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - ETL (BODS) to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: . Migrate ETL...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA North America Full time

    Job Description Req ID: 340517 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). - Hands-on experience in...