Manager - Big Data (AWS/Scripting (Java, Python)

1 month ago


Bengaluru, India The Nielsen Company Full time
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.

About the Role

- This position is responsible for working independently and possibly leading a team to analyze, develop, test, and support highly complex application software. Some systems will be in legacy technology and require the ability to interpret code and process flows. The Manager Software Engineer Developer will provide technical expertise and guidance to project team members and help develop strategies for developing complex applications. Ability to plan tasks and project phases as well as review, comment and approve the analysis and design submitted by the team.- Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with the Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.Responsibilities

Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises.Write technical documentation to support analysis and design recommendations and drafts.Build platform reusable code and components that could be used by multiple project teams.Provide cloud integration development support to various project teams.Rapidly identify and resolve technical incidents as they emerge.Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines.Stay informed about the latest technology and methodology by participating in industry forums, having an active peer network, and engaging actively with customers.Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through collaborative effort.

Key Skills (Domain Expertise)

5-7 years of related experience with a Bachelor’s degree.2-3 years experience in managing people and leading teams.Experience in software development using programming languages & tools/services: Java, Python and strong in SQL.

Technical Skills

Frontend Technology Skills Set: JavaScript, Grails, SQL and shell scripting experience.Backend Technology Skills Set: AWS and/or Oracle Cloud experience, Java, ETL Tools (Informatica, Talend, ODI), Strong SQL knowledge, Python, Scripting.Big Data Skills Set (3-5 years): Spark Scala, Spark SQL, AWS Cloud (EC2, S3).Other desired skill sets: Airflow, Gitlab, Parquet File processing.Strong knowledge on Unix/Linux OS, commands, shell scripting, python.Agile scrum experience in application development is required.Strong knowledge in AWS S3, PostgreSQL, Oracle or SQL server.Deployment and automation: Terraform, Cloud Formation would be a plus.Strong knowledge in Gitlab /Bitbucket.Legacy technology such as: FoxPro, COBOL, Struts) is a plus.Strong knowledge in Compute: EC2, EMR, AWS Lambda.AWS Certification is a plus.

Mindset and Attributes

Strong verbal/written communication and interpersonal skills.Strong leadership qualities and the ability to inspire and motivate a team.Strong ability to translate business requirements into technical solutions and guide the team in execution.

  • Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, India randstad Full time

    Primary Responsibilities :- Design, develop, and implement big data solutions using Java, Python, or Scala.- Utilize SQL and Spark Scala for data processing and analysis.- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and...


  • Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...


  • Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • AWS Data Engineer

    4 weeks ago


    Bengaluru, India TalentPulse Consultant Full time

    Overview :- The AWS Data Engineer plays a crucial role in our organization by designing and implementing scalable, reliable, and secure data solutions in the AWS cloud environment.- They are responsible for developing and maintaining data pipelines, optimizing data workflows, and ensuring the quality and integrity of our data.- This position is essential for...


  • Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Senior Data Engineer

    1 month ago


    Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Big data architect

    2 months ago


    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...

  • Big data developer

    2 months ago


    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Aws big data engineer

    1 month ago


    Bengaluru, India Global Pharma Tek Full time

    ob DescriptionTechnical skills. Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...

  • Big Data Engineers

    1 month ago


    Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Aws big data engineer

    2 months ago


    Bengaluru, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...

  • Big Data Architect

    1 month ago


    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big Data Engineers

    2 months ago


    Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • AWS Data Engineer

    3 weeks ago


    Bengaluru, India Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • Big Data Engineer

    4 days ago


    Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...


  • Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Big data architect

    1 month ago


    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 DescriptionPosition: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala....

  • Big Data

    1 month ago


    Bengaluru, India Riverforest Connections Full time

    **Job Description**: **Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)** Database experience preferably with DB2, Sybase, or Oracle - Complete SDLC process and Agile Methodology (Scrum) - Version control - Git - Spring Skill Desired: - Previous experience in Trade Surveillance or working with data from the order lifecycle - High quality...

  • Big data developer

    1 month ago


    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 DescriptionPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka....