Infogain looking for AWS Data Engineer Senior Gurugram India 6-8 Years Experience in Data Engineering

1 month ago

Mumbai, Maharashtra, India timesjobs Full time
#

## AWS Data Engineer (Senior)

Location: Gurugram, India

Posted on: July 27, 2024

Key Skills: Data Engineering, Kafka, Python, Scala, postgreSQL Development, AWS - EKS, AWS - CloudFormation, Data Modeling, ETL, Apache Hive, AWS-Apps, AWS-Infra, Apache Airflow, SQL, Datadog, Splunk, Apache Spark, AWS DBA

### ROLES & RESPONSIBILITIES

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in ETL, Data Modelling, and Data Architecture.

Proficiency in ETL optimization, designing, coding, and tuning big data processes using Scala is essential, along with hands-on experience in stream data processing using Spark, Kafka, and Spark Structured Streaming.


Additionally, the candidate should have extensive experience in building data platforms using a variety of technologies, including Scala, SQL/PLSQL, PostgreSQL, SQL Server, Teradata, Spark, Spark Structured Streaming, Kafka, Parquet/ORC, Data Modelling (Relational Dimensional E-R Modelling), ETL, RDS (PostgreSQL, MySQL), Splunk, DataDog, Airflow, Git, CI/CD Jenkins, JIRA, Confluence, IntelliJ Idea, Agile - Scrum/Kanban, On Call & Operations, Code Review, RCP Framework, Query book, Build, Deployment CI/CD & Release Process, Backstage, PagerDuty, and Spinnaker.

#### Key Responsibilities:

  • Handson experience on developing Data platform and its components Data Lake, cloud Datawarehouse, APIs, Batch and streaming data pipeline Experience with building data pipelines and applications to stream and process large datasets at low latency.
  • Develop and maintain batch and stream processing data solutions using Apache Spark, Kafka, and Spark Structured Streaming.
  • Work on orchestration using Airflow to automate and manage data workflows.
  • Utilize project management tools like JIRA and Confluence to track progress and collaborate with the team.
  • Develop data processing workflows utilizing Spark, SQL/PLSQL, and Scala to transform and cleanse raw data into a usable format.
  • Implement data storage solutions leveraging Parquet/ORC formats on platforms such as PostgreSQL, SQL Server, Teradata, and RDS (PostgreSQL, MySQL).
  • Optimize data storage and retrieval performance through efficient data modelling techniques, including Relational, Dimensional, and E-R modelling.
  • Maintain data integrity and quality by implementing robust validation and error handling mechanisms within ETL processes.
  • Automate deployment processes using CI/CD tools like Jenkins and Spinnaker to ensure reliable and consistent releases.
  • Monitor and troubleshoot data pipelines using monitoring tools like DataDog and Splunk to identify performance bottlenecks and ensure system reliability.
  • Participate in Agile development methodologies such as Scrum/Kanban, including sprint planning, daily standups, and retrospective meetings.
  • Conduct code reviews to ensure adherence to coding standards, best practices, and scalability considerations.
  • Manage and maintain documentation using tools like Confluence to ensure clear and uptodate documentation of data pipelines, schemas, and processes.
  • Provide oncall support for production data pipelines, responding to incidents and resolving issues in a timely manner.
  • Collaborate with crossfunctional teams including developers, data scientists, and operations teams to address complex data engineering challenges.
  • Stay updated on emerging technologies and industry trends to continuously improve data engineering processes and tools.
  • Contribute to the development of reusable components and frameworks to streamline data engineering tasks across projects.
  • Utilize version control systems like Git to manage codebase and collaborate effectively with team members.
  • Leverage IDEs like IntelliJ IDEA for efficient development and debugging of data engineering code.
  • Adhere to security best practices in handling sensitive data and implementing access controls within the data lake environment.
#### Good-to-Know Skills:

  • Programming Languages: Python, Bash/Unix/Linux
  • Big Data Technologies: Hive, Avro, Apache Iceberg, Delta Format
  • Cloud Services: EC2, ECS, S3, SNS, SQS, CloudWatch
  • Databases: DynamoDB, Redis
  • Containerization and Orchestration: Docker, Kubernetes
  • CI/CD Tools: Github Copilot
  • Additional Skills: Maven, CLI/SDK
#### Nice-to-Have Skills:

  • Networking: Subnets, Routes
  • Big Data Technologies: Flink
### EXPERIENCE

  • 68 Years
### ABOUT THE COMPANY

Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley.

We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence.

We accelerate experience-led transformation in the delivery of digital platforms.

Infogain is also a Microsoft (NASDAQ:
MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).


Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Krakw, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.

  • Infogain looking for DevOps Engineer Senior Bangalore India 6-8 Years Experience in DevOps Engineering

    2 months ago

    Mumbai, Maharashtra, India Infogain Corporation Full time

    Apply for Infogain Looking For DevOps Engineer Senior , Bangalore, India 6 8 Years Experience In DevOps Engineering, Career Progress Consultants in Mumbai ,Bengaluru/ Bangalore ,Pune ,Noida/ Greater Noida ,Gurgaon for - 8 Year of Experience on

  • Infogain looking for Core Java Developer Senior Gurugram India 8-11 Years Experience in Core Java

    2 months ago

    Mumbai, Maharashtra, India Infogain Corporation Full time

    Apply for Infogain Looking For Core Java Developer Senior , Gurugram, India 8 11 Years Experience In Core Java, Career Progress Consultants in Mumbai ,Bengaluru/ Bangalore ,Pune ,Noida/ Greater Noida ,Gurgaon for Year of Experience on

  • Infogain looking for Big Data Engineer Standard Bangalore India 4 5-6 Years Experience in Big Data

    2 months ago

    Mumbai, Maharashtra, India Infogain Corporation Full time

    Apply for Infogain Looking For Big Data Engineer Standard , Bangalore, India 4.5 6 Years Experience In Big Data, Career Progress Consultants in Mumbai ,Bengaluru/ Bangalore ,Pune ,Noida/ Greater Noida ,Gurgaon for - 6 Year of Experience on

  • Infogain looking for SRE

    1 month ago

    Mumbai, Maharashtra, India Infogain Corporation Full time

    Apply for Infogain Looking For SRE / Reliability Engineer Senior , Noida, India 8 11 Years Experience In SRE Engineering, Career Progress Consultants in Mumbai ,Bengaluru/ Bangalore ,Pune ,Noida/ Greater Noida ,Gurgaon for Year of Experience on

  • Infogain looking for Data Science Analyst Senior Bangalore India 6-8 Years Experience in Data Science

    2 months ago

    Mumbai, Maharashtra, India timesjobs Full time

    Role: Data Science Analyst (Senior)Location: Bangalore, IndiaPosted on: July 14, 2024ROLES & RESPONSIBILITIESCore Skills:Expert knowledge of statistics and probability theoryProficiency in at least one programming language such as Python, R, or SQLAdvanced experience with data visualization tools such as Tableau or PowerBIExpert understanding of machine...

  • Infogain looking for Big Data Engineer Senior Bangalore India 6-8 Years Experience in Data Engineering

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    Position: Big Data Engineer (Senior)Location: Bangalore, IndiaPosted on: August 16, 2024ROLES & RESPONSIBILITIESMandatory Skill 1: Cloudera Manager (CDH)Mandatory Skill 2: TableauMandatory Skill 3: HDFS, Spark, Impala, Kudu, ParquetMandatory Skill 4: Sqoop (connectors multiple Kafka)Detailed Roles & ResponsibilitiesCandidate should have development...

  • Infogain looking for Data Science Analyst Lead Gurugram India 8-11 Years Experience in Data Science

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    Position: Data Science Analyst (Lead)Skills: Data Science, Python, Data ModelingLocation: Gurugram, IndiaPosted on: May 31, 2024Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESKey Responsibilities:Lead and manage data science projects from ideation through to deployment, ensuring they meet business requirements and are delivered...

  • Infogain looking for Core Java Developer Senior Gurugram India 6-8 Years Experience in Java Development

    2 months ago

    Mumbai, Maharashtra, India timesjobs Full time

    Role: Core Java Developer (Senior)Skills: Java Development, Core JavaLocation: Gurugram, IndiaPosted on: August 01, 2024ROLES & RESPONSIBILITIESCore SkillsExpert in Java programming, including Java SE and Java EEExtensive experience in Java-related frameworks and libraries (e.g., Spring, Hibernate, JavaFX)Proficiency in writing clean, maintainable, and...

  • Infogain looking for MFC

    2 months ago

    Mumbai, Maharashtra, India Infogain Corporation Full time

    Apply for Infogain Looking For MFC / Visual C Developer Senior , Bangalore, India 6 8 Years Experience In Visual C, Career Progress Consultants in Mumbai ,Bengaluru/ Bangalore ,Pune ,Noida/ Greater Noida ,Gurgaon for - 8 Year of Experience on

  • Infogain looking for AI

    2 months ago

    Mumbai, Maharashtra, India timesjobs Full time

    Position: AI / ML Developer (Senior)Skills: AI/ML Development, TensorFlow, NLP, Pytorch, Python (Data Science)Location: Gurugram, IndiaPosted on: August 01, 2024Share on: Linkedin | Twitter | FacebookROLES & RESPONSIBILITIESCore Skills6-8 years experience on Python & Market Mix Modelling6-8 years experience on Python & Market Mix ModellingEXPERIENCE6-8...

  • Infogain looking for Core Java Developer Senior Gurugram India 6-8 Years Experience in Java Development

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    # Position: Core Java Developer (Senior) Skills: Java Development, Core Java Location: Gurugram, India Posted on: August 16, 2024 ROLES & RESPONSIBILITIESCore Skills Expert in Java programming, including Java SE and Java EE Extensive experience in Javarelated frameworks and libraries (e.g., Spring, Hibernate, JavaFX) Proficiency in writing clean,...

  • Infogain looking for QA Automation Engineer Standard Bangalore India 4 5-6 Years Experience in Selenium

    3 months ago

    Mumbai, Maharashtra, India Infogain Corporation Full time

    Apply for Infogain Looking For QA Automation Engineer Standard , Bangalore, India 4.5 6 Years Experience In Selenium, Career Progress Consultants in Mumbai ,Bengaluru/ Bangalore ,Pune ,Noida/ Greater Noida ,Gurgaon for - 6 Year of Experience on

  • Infogain looking for Frontend React Developer Senior Gurugram India 6-8 Years Experience in Frontend Development

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    Position: Frontend React Developer (Senior)Skills: Frontend Development, BootStrap, ReactJS, React NativeLocation: Gurugram, IndiaPosted on: August 16, 2024ROLES & RESPONSIBILITIESCore SkillsAn experienced ReactJS Developer with a strong background in building scalable web applications using ReactJS, Spring Boot, and GraphQL. Proficient in designing and...

  • Infogain looking for Core Java Developer Senior Gurugram India 6-8 Years Experience in Java Development

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    Position: Core Java Developer (Senior)Skills: Java Development, Kafka, .NET Web API (restful APIs), Core JavaLocation: Gurugram, IndiaPosted on: August 16, 2024Share on: Linkedin Twitter FacebookROLES & RESPONSIBILITIES Core SkillsJD: OperationAs a Camunda 8 Operations Specialist, you will be responsible for the day-to-day operation, monitoring, and...

  • Infogain looking for Data Science Architect Standard Gurugram India 12-14 Years Experience in Data Science

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    Position: Data Science Architect (Standard)Skills: Data Science, Python, Data Modeling, Data Science, SQLLocation: Gurugram, IndiaPosted on: August 16, 2024Share on: Linkedin | Twitter | FacebookROLES & RESPONSIBILITIESCore Skills:Telecom CVM domain experience is mandatoryExpert knowledge of statistics and probability theoryProficiency in at least one...

  • Infogain looking for QA Automation Engineer Senior Bangalore India 6-8 Years Experience in SDET

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    Position: QA Automation Engineer (Senior)Skills:SDET, Automated TestingLocation: Bangalore, IndiaPosted on: August 16, 2024Share on: Linkedin | Twitter | FacebookROLES & RESPONSIBILITIESCore SkillsIt should be simple and regular tester,One should be able to test SOAP API, REST APIOne should be familiar with terminologies written in Java JD for testing...

  • Infogain looking for QA Automation Engineer Senior Noida India 6-8 Years Experience in SDET

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    Job Title: QA Automation Engineer (Senior)Skills:SDET, Automated Testing, SeleniumLocation: Noida, IndiaPosted on: August 04, 2024Share on Linkedin | Share on Twitter | Share on FacebookROLES & RESPONSIBILITIESCore SkillsDeep understanding of software testing methodologiesExtensive experience with test automation tools and frameworks (e.g., Selenium, JUnit,...

  • Infogain looking for Middleware Developer Senior Bangalore India 6-8 Years Experience in Middleware Development

    4 weeks ago

    Mumbai, Maharashtra, India timesjobs Full time

    Middleware Developer (Senior)Location: Bangalore, IndiaPosted on: August 16, 2024Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIES APP Connect:More than 7 years of hands-on experience in configuring App Connect Enterprise Server and on designing and developing integration interfacesKnowledge on Integration Design guidelines,...

  • Infogain looking for QA Automation Engineer Senior Noida India 6-8 Years Experience in SDET

    1 month ago

    Mumbai, Maharashtra, India timesjobs Full time

    Position: QA Automation Engineer (Senior)Skills:SDET, Python, Automated Testing, JavaScript Development, CypressLocation: Noida, IndiaPosted on: August 16, 2024ROLES & RESPONSIBILITIES:Exp: 6-8 yearsTools: Cypress, Python, Javascript, BD6 years of experience IT especially in Software testing with strong Automation Testing BackgroundStrong Experience in...

  • Infogain looking for QA Automation Engineer Senior Bangalore India 6-8 Years Experience in SDET

    2 months ago

    Mumbai, Maharashtra, India timesjobs Full time

    Role: QA Automation Engineer (Senior)Location: Bangalore, IndiaPosted on: August 01, 2024Share on Linkedin | Twitter | FacebookROLES & RESPONSIBILITIES:The Crew Manager team is focused on developing and maintaining the CrewManager Application that manages the Crew (Cockpit and Cabin Crew). The team is looking for a Senior Software Developer, who will support...