Big Data- AWS

2 weeks ago

noida, India Coforge Ltd. Full time

Job description Role and responsibilities : - Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for development and testing using (AWS Dynamo DB, EKS, Kafka) to enable seamless data ingestion process on to the Hadoop platform. - Enabling Data Governance and Data Discovery on Hadoop Platform - Building data processing framework using Spark, HQL - Exposure of Security Framework with Kerberos, Ranger, Atlas - Exposure of Data Pipeline Automation using DevOps tools - Exposure of Job Monitoring framework along validations automation - Exposure of handling structured, Un Structured and Streaming data Technical skills requirements : - Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS preferred) - Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMR - Hands-on experience of programming language like Scala with Spark. - Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases - Hands on working experience on any of the data engineering analytics platform (Hortonworks Cloudera MapR AWS), AWS preferred - Hands-on experience on Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and Oozie - Hands on working experience of data processing at scale with event driven systems, message queues (Kafka FlinkSpark Streaming) - Hands on working Experience with AWS Services like EMR, Kinesis, S3, CloudFormation, Glue, API Gateway, Lake Foundation - Hands on working Experience with AWS Athena - Data Warehouse exposure on Apache Nifi, Apache Airflow, Kylo - Operationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.) - Feature Engineering Data Processing to be used for Model development - Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.) - Experience building data pipelines for structured unstructured, real-time batch, events synchronous asynchronous using MQ, Kafka, Steam processing - Hands-on working experience in analysing source system data and data flows, working with structured and unstructured data - Must be very strong in writing SQL queries - Strengthen the Data engineering team with Big Data solutions - Strong technical, analytical, and problem-solving skills

  • Big Data- AWS

    3 weeks ago

    noida, India Coforge Full time

    Job Description Job description Role and responsibilities : - Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for development and testing using (AWS Dynamo DB,...

  • Big Data- AWS

    4 weeks ago

    noida, India Coforge Full time

    Job Description Job description Role and responsibilities : - Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for development and testing using (AWS Dynamo DB,...

  • Big Data- AWS

    7 days ago

    Noida, Uttar Pradesh, India Coforge Ltd. Full time

    Job description Role and responsibilities : Creating Project Technical DocumentationDesigning Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. Developing efficient frameworks for development and testing using (AWS Dynamo DB, EKS, Kafka) to enable seamless data...

  • Big Data- AWS

    4 weeks ago

    Greater Noida, India Coforge Full time

    Job Description Job description Role and responsibilities : - Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for development and testing using (AWS Dynamo DB, EKS,...

  • Big Data- AWS

    3 weeks ago

    Greater Noida, India Coforge Full time

    Job Description Job description Role and responsibilities : - Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for development and testing using (AWS Dynamo DB, EKS,...

  • Big Data- AWS

    2 weeks ago

    Greater Noida, India Coforge Ltd. Full time

    Job description Role and responsibilities : - Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for development and testing using (AWS Dynamo DB, EKS, Kafka) to enable seamless...

  • Big Data Architect

    2 months ago

    Noida, India Skillety Technologies Full time

    **MapReduce.** **experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, Google BigQuery,** **Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters)** **exp in writing Advanced SQLs** **exp with building dimensional data models to improve accessibility, efficiency and quality of data** **exp in custom...

  • Big Data Architect

    7 days ago

    Noida, Uttar Pradesh, India Skillety Technologies Full time

    MapReduce.experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, Google BigQuery,Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters)exp in writing Advanced SQLsexp with building dimensional data models to improve accessibility, efficiency and quality of dataexp in custom ETL design,...

  • Aws Data Architect

    3 weeks ago

    Noida, India Skillety Technologies Full time

    **Overall 9+ years of exp in software industry** **5+ years of experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, Google** **BigQuery, Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters)** **3+ years of exp in writing Advanced SQLs** **3+ years of exp with building dimensional data models to...

  • Big Data

    2 months ago

    Noida, India Iris software Full time

    JD: - Minimum EAP experience - 7 years.- Responsibilities for Big Data Engineer- Perform data cleaning, integration, validation and analysis - Extensive experience of developing(must), deploying (must) and maintaining(must) the Big Data Ecosystem - Create and maintain optimal data pipeline architecture - Assemble large, complex data sets that meet...

  • Aws Data Architect

    7 days ago

    Noida, Uttar Pradesh, India Skillety Technologies Full time

    Overall 9+ years of exp in software industry5+ years of experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, GoogleBigQuery, Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters)3+ years of exp in writing Advanced SQLs3+ years of exp with building dimensional data models to improve accessibility,...

  • Impetus - Databricks Architect - Big Data

    7 days ago

    Noida, Uttar Pradesh, India Impetus Technologies India Pvt. Ltd Full time

    As a Resident Solutions Architect in our Professional Services team, you will work with customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help customers to get most...

  • Impetus - Databricks Architect - Big Data

    1 week ago

    noida, India Impetus Technologies India Pvt. Ltd Full time

    As a Resident Solutions Architect in our Professional Services team, you will work with customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help customers to get most...

  • AWS Data Engineer

    7 days ago

    Noida, Uttar Pradesh, India Infogain Full time

    AWS Data Engineer (Lead) with skills AWS - EKS, AWS - CloudFormation, AWS-Apps, AWS-Infra, AWS DBA, Python, Apache Hive, SQL for location Noida, India Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Job description Responsibilities · Provide consultation on appropriate use of AWS for Data...

  • Axtria - Technical Architect - Big Data/AWS/SQL

    3 days ago

    noida, India Axtria India Pvt. Ltd. Full time

    Job Position : Technical Architect - BigData / Cloud Job Location : Noida/Gurgaon/Bangalore Your Mission :As an experienced Architect, you should be able to provide architectural & design leadership to the product engineering teams so that they can ensure powerful delivery of shippable product features every sprint. You should be able to :- Apply creative...

  • Axtria - Technical Architect - Big Data/AWS/SQL

    6 days ago

    Noida, India Axtria India Pvt. Ltd. Full time

    Job Position : Technical Architect - BigData / Cloud Job Location : Noida/Gurgaon/Bangalore Your Mission :As an experienced Architect, you should be able to provide architectural & design leadership to the product engineering teams so that they can ensure powerful delivery of shippable product features every sprint. You should be able to :- Apply creative...

  • Cloud Engineer/Architect with Big Data Experience

    2 months ago

    Noida, India Transaction Network Services Full time

    An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives.Come join the excellence! Overview A Cloud Architect is responsible for designing and implementing cloud-based infrastructure and applications. This includes tasks such as designing, and implementing security...

  • Cloud Engineer/Architect with Big Data Experience

    7 days ago

    Noida, Uttar Pradesh, India Transaction Network Services Full time

    An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives.Come join the excellence Overview A Cloud Architect is responsible for designing and implementing cloud-based infrastructure and applications. This includes tasks such as designing, and implementing security and...

  • Cloud Engineer/Architect with Big Data Experience

    2 months ago

    noida, India Transaction Network Services Full time

    An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives.Come join the excellence! Overview A Cloud Architect is responsible for designing and implementing cloud-based infrastructure and applications. This includes tasks such as designing, and implementing...

  • Cloud Engineer/Architect with Big Data Experience

    3 weeks ago

    Noida, India Transaction Network Services Full time

    An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives.Come join the excellence! Overview A Cloud Architect is responsible for designing and implementing cloud-based infrastructure and applications. This includes tasks such as designing, and implementing security...