Senior Data Engineer

1 month ago

Greater Noida, India Publicis Sapient Full time

Publicis Sapient Overview :

We at Publicis Sapient, enable our clients to thrive in Next and to create business value through expert strategies, customer-centric experience design, and world-class product engineering.

The future of business is disruptive, transformative and becoming digital to the core.

In our 20 + years in IT, never before have we seen such a dire need for transformation in every major industry - from financial services to automotive, consumer products, retail, energy, and travel.

To make this transformative journey a reality in these exciting times, we seek thought leaders and rock stars who will :

- Reimagine the way the world works to help businesses improve the daily lives of people and the world.

Our people thrive because of the belief that it is both our privilege and responsibility to usher our clients and the world into Next.

Job Summary :

As Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution

The role requires a hands-on technologist who has strong programming background like Java / Scala / Python, should have experience in Data Ingestion, Integration and data Wrangling, Computation, Analytics pipelines and exposure to Hadoop ecosystem components. You are also required to have hands-on knowledge on at least one of AWS, GCP, Azure cloud platforms.

Role & Responsibilities :

Your role is focused on Design, Development and delivery of solutions involving :

- Data Integration, Processing & Governance

- Data Storage and Computation Frameworks, Performance Optimizations

- Analytics & Visualizations

- Infrastructure & Cloud Computing

- Data Management Platforms

- Implement scalable architectural models for data processing and storage

- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time mode

- Build functionality for data analytics, search and aggregation

Experience Guidelines :

Mandatory Experience and Competencies :

Competency :

1. Overall 6+ years of IT experience with 4+ years in Data related technologies

2. Minimum 4+ years of experience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP)

3. Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline.

4. Strong experience in at least of the programming language Java, Scala, Python. Java preferable

5. Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc

6. Well-versed and working knowledge with data platform related services on at least 1 cloud platform, IAM and data security

Preferred Experience and Knowledge (Good to Have) :

Competency :

1. Good knowledge of traditional ETL tools (Informatica, Talend, etc) and database technologies (Oracle, MySQL, SQL Server, Postgres) with hands on experience

2. Knowledge on data governance processes (security, lineage, catalog) and tools like Collibra, Alation etc

3. Knowledge on distributed messaging frameworks like ActiveMQ / RabbiMQ / Solace, search & indexing and Micro services architectures

4. Performance tuning and optimization of data pipelines

5. CI/CD - Infra provisioning on cloud, auto build & deployment pipelines, code quality

6. Cloud data specialty and other related Big data technology certifications

Personal Attributes :

- Strong written and verbal communication skills

- Articulation skills

- Good team player

- Self-starter who requires minimal oversight

- Ability to prioritize and manage multiple tasks

- Process orientation and the ability to define and set up processes

(ref:hirist.tech)

  • Senior Data Engineer

    6 days ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) is nice to have RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data sources and...

  • Senior Data Engineer

    6 days ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats. Implement...

  • Senior Data Engineer

    1 month ago

    Greater Noida, India Coforge Full time

    Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data sources and...

  • Senior Data Engineer

    4 weeks ago

    Greater Noida, India Coforge Full time

    Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) is nice to have RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data...

  • Senior Data Engineer

    3 weeks ago

    Greater Noida, India Coforge Full time

    Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data sources and...

  • Senior Data Engineer

    3 weeks ago

    Greater Noida, India Coforge Full time

    Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data sources and...

  • Senior Data Engineer

    3 weeks ago

    Greater Noida, India Coforge Full time

    Job Description ? Must be extremely proficient in Data Warehouse ETL Design/Architecture, dimensional/relational data modelling. ? Experience in atleast one ETL development project, writing/analyzing complex stored procedures. ? Should have entry level/intermediate experience in Python/PySpark ? working knowledge on spark/pandas dataframe, spark...

  • Senior Data Engineer

    6 days ago

    Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description ? Must be extremely proficient in Data Warehouse ETL Design/Architecture, dimensional/relational data modelling. ? Experience in atleast one ETL development project, writing/analyzing complex stored procedures. ? Should have entry level/intermediate experience in Python/PySpark ? working knowledge on spark/pandas dataframe, spark...

  • Senior Data Engineer

    1 week ago

    Greater Noida, India Coforge Ltd. Full time

    ? Must be extremely proficient in Data Warehouse ETL Design/Architecture, dimensional/relational data modelling. ? Experience in atleast one ETL development project, writing/analyzing complex stored procedures. ? Should have entry level/intermediate experience in Python/PySpark ? working knowledge on spark/pandas dataframe, spark multi-threading, exception...

  • Senior QA Engineer

    7 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job DescriptionWe are looking for a Senior QA Engineer to join our team in Noida, Uttar Pradesh, India. If you're into creating test plans, executing test cases, and reporting test status, this might just be the role for you.Responsibilities:Create test plans and test cases based on business requirementsExecute and record test resultsReport test status and...

  • Data Engineer

    1 month ago

    Noida, India Infogain Full time

    Experience : 6 to 9 years Requirement : Immediate Joiner or one month notice period only. Location : Bangalore Work Mode : Hybrid Title: Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their...

  • Network Engineering Senior Specialist

    4 weeks ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 282407 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Senior Specialist

    6 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Senior Specialist

    3 weeks ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 282407 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Senior Specialist

    4 weeks ago

    noida, India NTT DATA Full time

    Job Description Req ID:  282407  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh...

  • Network Engineering Senior Specialist

    3 weeks ago

    noida, India NTT DATA Full time

    Job Description Req ID:  282407  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh...

  • Network Engineering Senior Specialist

    4 weeks ago

    noida, India NTT DATA Full time

    Job Description Req ID:  282407  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh...

  • Senior QA Engineer

    4 weeks ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 283833 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QA Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Once You Are...

  • Senior QA Engineer

    3 weeks ago

    noida, India NTT DATA Full time

    Job Description Req ID:  283833  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QA Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). Once...

  • Senior QA Engineer

    4 weeks ago

    noida, India NTT DATA Full time

    Job Description Req ID:  283833  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QA Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). Once...