Senior Data Engineer

1 week ago

Greater Noida, Uttar Pradesh, India Coforge Full time

Job Description

? Must be extremely proficient in Data Warehouse ETL Design/Architecture, dimensional/relational data modelling. ? Experience in atleast one ETL development project, writing/analyzing complex stored procedures. ? Should have entry level/intermediate experience in Python/PySpark ? working knowledge on spark/pandas dataframe, spark multi-threading, exception handling, familiarity with different boto3 libraries, data transformation and ingestion methods, ability to write UDF. ? Snowflake ? Familiarity with stages and external tables, commands in snowflake like copy, unload data to/from S3, working knowledge of variant data type, flattening nested structure thru SQL, familiarity with marketplace integrations, role-based masking, pipes, data cloning, logs, user and role management is nice to have. ? Familiarity with Coalesce/dbt is an added advantage for this job. ? Collibra integration experience for Data Quality and Governance in ETL pipeline development is nice to have. ? AWS ? Should have hands-on experience with S3, Glue (jobs, triggers, workflow, catalog, connectors, crawlers), CloudWatch, RDS and secrets manager. ? AWS - VPC, IAM, Lambda, SNS, SQS, MWAA is nice to have. ? Should have hands-on experience with version controlling tools like github, working knowledge on configuring, setting up CI/CD pipelines using yaml, pip files. ? Streaming Services ? Familiarity with Confluent Kafka or spark streaming, or Kinesis (or equivalent) is nice to have. ? Data Vault 2.0 (hubs satellite links) experience will be a PLUS. Interpersonal ? Highly proficient in Publisher, PowerPoint, SharePoint, Visio, Confluence and Azure DevOps ? Working knowledge of best practices in value-driven development (requirements management, prototyping, hypothesis-driven development, usability testing) ? Good communicator with problem solving mindset and focus on process improvement ? Consistently demonstrates clear and concise written and verbal communication skills ? Good interpersonal skills, ability to interact with Senior Management ? Highly self-motivated with a strong sense of initiative ? Excellent multitasking skills and task management strategies ? Ability to work well in a team environment, meet deadlines, demonstrate good time management, and multi-task in a fast-paced project environment. Responsibilities ? Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (onshore and of

Posted On

? Must be extremely proficient in Data Warehouse ETL Design/Architecture, dimensional/relational data modelling. ? Experience in atleast one ETL development project, writing/analyzing complex stored procedures. ? Should have entry level/intermediate experience in Python/PySpark ? working knowledge on spark/pandas dataframe, spark multi-threading, exception handling, familiarity with different boto3 libraries, data transformation and ingestion methods, ability to write UDF. ? Snowflake ? Familiarity with stages and external tables, commands in snowflake like copy, unload data to/from S3, working knowledge of variant data type, flattening nested structure thru SQL, familiarity with marketplace integrations, role-based masking, pipes, data cloning, logs, user and role management is nice to have. ? Familiarity with Coalesce/dbt is an added advantage for this job. ? Collibra integration experience for Data Quality and Governance in ETL pipeline development is nice to have. ? AWS ? Should have hands-on experience with S3, Glue (jobs, triggers, workflow, catalog, connectors, crawlers), CloudWatch, RDS and secrets manager. ? AWS - VPC, IAM, Lambda, SNS, SQS, MWAA is nice to have. ? Should have hands-on experience with version controlling tools like github, working knowledge on configuring, setting up CI/CD pipelines using yaml, pip files. ? Streaming Services ? Familiarity with Confluent Kafka or spark streaming, or Kinesis (or equivalent) is nice to have. ? Data Vault 2.0 (hubs satellite links) experience will be a PLUS. Interpersonal ? Highly proficient in Publisher, PowerPoint, SharePoint, Visio, Confluence and Azure DevOps ? Working knowledge of best practices in value-driven development (requirements management, prototyping, hypothesis-driven development, usability testing) ? Good communicator with problem solving mindset and focus on process improvement ? Consistently demonstrates clear and concise written and verbal communication skills ? Good interpersonal skills, ability to interact with Senior Management ? Highly self-motivated with a strong sense of initiative ? Excellent multitasking skills and task management strategies ? Ability to work well in a team environment, meet deadlines, demonstrate good time management, and multi-task in a fast-paced project environment. Responsibilities ? Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (onshore and of

Skills Required

AZURE DATA FACTORY

Posted On AZURE DATA FACTORY Location

Greater Noida

Posted On Greater Noida Desirable Skills

PYTHON, AZURE DATA FACTORY, SNOWFLAKE

Posted On PYTHON, AZURE DATA FACTORY, SNOWFLAKE

  • Senior Data Engineer

    1 week ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) is nice to have RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data sources and...

  • Senior Data Engineer

    1 week ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats. Implement...

  • Senior QA Engineer

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job DescriptionWe are looking for a Senior QA Engineer to join our team in Noida, Uttar Pradesh, India. If you're into creating test plans, executing test cases, and reporting test status, this might just be the role for you.Responsibilities:Create test plans and test cases based on business requirementsExecute and record test resultsReport test status and...

  • Senior Data Enginer

    1 week ago

    Noida, Uttar Pradesh, India The Judge Group Full time

    Position : Senior/Data Engineer - Snowflake & AWSRelevant Exp : 8+ yearsLocation : Noida, Hyderabad, Bangalore/WFHRoles & Responsibilities : The ability to design, implement, and optimize largescale data and analytics solutions on Snowflake Cloud Data Warehouse is essential.A Data Engineer at Snowflake is responsible for :Implementing ETL pipelines within...

  • senior data engineer/ technical analyst

    1 week ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description Responsibilities • Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats. • Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability. • Collaborate with data scientists, machine learning engineers, and product managers...

  • Network Engineering Senior Specialist

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Infogain Full time

    Experience : 6 to 9 years Requirement : Immediate Joiner or one month notice period only. Location : Bangalore Work Mode : Hybrid Title: Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their...

  • senior data engineer/ technical analyst

    1 week ago

    Greater Noida, Uttar Pradesh, India Coforge Ltd. Full time

    Responsibilities Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats. Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability. Collaborate with data scientists, machine learning engineers, and product managers to understand data...

  • Senior Data Engineer/Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India RateGain Full time

    About the Organization: RateGain is a leading provider of SaaS products, which help travel and hospitality companies with cognitive revenue management, smart e-distribution, and brand engagement to make more revenue every day. RateGain is proud to support 250,000+ hotel properties globally by providing 240 billion rate and availability updates & powering...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Genpact Full time

    Genpact (NYSE:G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Data Engineer

    1 week ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description Position: Data Engineer (6-8 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Azure DataBricks (ADB) 2: Python 3: Pyspark 4: ETL and SQL Queries JOB RESPONSIBILITIES: Design, develop, and implement data pipelines using Azure Databricks and Python for data ingestion, transformation, and loading (ETL). ...

  • Data Engineer

    1 week ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description Position: Data Engineer (Snowflake Developer) Location: Greater Noida & Bangalore Duration: Full Time Experience: 4-6 Years MUST HAVE SKILLS: 1: Snowflake 3: Data Pipelines and DWH Concepts 4: AZURE Cloud Ecosystem 5: Python Programming JOB DESCRIPTION: Data Solution Design and Implementation. ...

  • Senior Lead Engineer

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN).Once You Are Here, You Will: Work on...

  • Data Engineer

    1 week ago

    Greater Noida, Uttar Pradesh, India Coforge Ltd. Full time

    Position: Data Engineer (Snowflake Developer)Location: Greater Noida & BangaloreDuration: Full TimeExperience: 4-6 Years MUST HAVE SKILLS:1: Snowflake3: Data Pipelines and DWH Concepts4: AZURE Cloud Ecosystem5: Python Programming JOB DESCRIPTION: Data Solution Design and Implementation.Understanding of design concepts for Data Lakes, Data Warehouses, and...

  • Network Engineering Senior Specialist

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). Network DC Build...

  • Senior QA Engineer

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QA Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). Once You Are Here, You Will: •...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Infostride Technologies Pvt Ltd Full time

    As a Senior Data Platform Engineer, you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving data requirements of our products and services. You will work closely with...

  • Data Engineer

    1 week ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description Position: Data Engineer (HVR/Fivetran) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: HVR/ Fivetran (Data Replication tools) 2: HVR HUB configuration 3: Snowflake or AWS (Cloud) are nice to have 4: SQL 5: Insurance Domain would be good to have JOB DESCRIPTION: Having 4-6 years of IT experience with an...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Tech Mahindra Full time

    Job Role: Senior Data EngineerExperience: 6+ yearsLocation" PAN IndiaMust Have:Celonis Process Mining / UI Path Process Mining/ Signavio Process Mining/Minit Process mining or any other process mining toolRoles And Responsibilities:Hands-on experience on Celonis Process Mining/UI Path Process Mining/ Signavio Process Mining/Minit Process mining or any other...