Manager - Big Data (AWS/Scripting (Java, Python)

1 week ago


Bengaluru, Karnataka, India The Nielsen Company Full time
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. About the Role - This position is responsible for working independently and possibly leading a team to analyze, develop, test, and support highly complex application software. Some systems will be in legacy technology and require the ability to interpret code and process flows. The Manager Software Engineer Developer will provide technical expertise and guidance to project team members and help develop strategies for developing complex applications. Ability to plan tasks and project phases as well as review, comment and approve the analysis and design submitted by the team.- Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with the Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.

Responsibilities

Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises. Write technical documentation to support analysis and design recommendations and drafts. Build platform reusable code and components that could be used by multiple project teams. Provide cloud integration development support to various project teams. Rapidly identify and resolve technical incidents as they emerge. Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines. Stay informed about the latest technology and methodology by participating in industry forums, having an active peer network, and engaging actively with customers. Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through collaborative effort.

Key Skills (Domain Expertise)

5-7 years of related experience with a Bachelor's degree. 2-3 years experience in managing people and leading teams. Experience in software development using programming languages & tools/services: Java, Python and strong in SQL.

Technical Skills

Frontend Technology Skills Set: JavaScript, Grails, SQL and shell scripting experience. Backend Technology Skills Set: AWS and/or Oracle Cloud experience, Java, ETL Tools (Informatica, Talend, ODI), Strong SQL knowledge, Python, Scripting. Big Data Skills Set (3-5 years): Spark Scala, Spark SQL, AWS Cloud (EC2, S3). Other desired skill sets: Airflow, Gitlab, Parquet File processing. Strong knowledge on Unix/Linux OS, commands, shell scripting, python. Agile scrum experience in application development is required. Strong knowledge in AWS S3, PostgreSQL, Oracle or SQL server. Deployment and automation: Terraform, Cloud Formation would be a plus. Strong knowledge in Gitlab /Bitbucket. Legacy technology such as: FoxPro, COBOL, Struts) is a plus. Strong knowledge in Compute: EC2, EMR, AWS Lambda. AWS Certification is a plus.

Mindset and Attributes

Strong verbal/written communication and interpersonal skills. Strong leadership qualities and the ability to inspire and motivate a team. Strong ability to translate business requirements into technical solutions and guide the team in execution.

  • Bengaluru, Karnataka, India Nielsen Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India randstad Full time

    Primary Responsibilities : Design, develop, and implement big data solutions using Java, Python, or Scala. Utilize SQL and Spark Scala for data processing and analysis. Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda. Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and retrieval....


  • Bengaluru, Karnataka, India Ziniosedge Full time

    9 yrs to 12 yrsPython, Java, SQL, BIG Data, Hadoop, Oracle DBPython, Java, SQL, BIG Data, Hadoop, Oracle DB

  • Big data architect

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...

  • Big data developer

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    ob DescriptionTechnical skills. Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...


  • Bengaluru, Karnataka, India Jobs for Humanity Full time

    About The Role :- This position is responsible for working independently and possibly leading a team to analyze, develop, test, and support highly complex application software.- Some systems will be in legacy technology and require the ability to interpret code and process flows.- The Manager will provide technical expertise and guidance to project team...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

  • Big Data Architect

    1 week ago


    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big data developer

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Big data developer - CREQ185815 DescriptionPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka....

  • Big Data Architect

    1 week ago


    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Tata Elxsi Full time

    Job Description :At least 4+ years of experience pyspark framework. Good experience writing complex SQL and No SQL databases. Excellent coding and design skills, particularly in Pyspark and Python. Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh). Experience in AWS technologies...

  • Big data architect

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Big data architect - CREQ185795 DescriptionPosition: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala....

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Big Data Engineer - CREQ190570 DescriptionQualifications Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)...

  • Big Data

    1 week ago


    Bengaluru, Karnataka, India Riverforest Connections Full time

    Job Description:Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)Database experience preferably with DB2, Sybase, or Oracle Complete SDLC process and Agile Methodology (Scrum) Version control Git SpringSkill Desired: Previous experience in Trade Surveillance or working with data from the order lifecycle High quality software architecture and...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Create and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and fintech ka experience MUST.Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and...


  • Bengaluru, Karnataka, India SavvyR Solutions Private Limited Full time

    Your primary focus will be writing clean, maintainable, and efficient Java code to extract, transform, and load massive datasets. You will also collaborate closely with data scientists, analysts, and other engineers to ensure our solutions meet business needs and deliver real value.Responsibilities : Design, develop, test, and deploy robust, scalable Java...


  • Bengaluru, Karnataka, India Impetus Technologies Full time

    Cloud Data ArchitectDo you want to work with the best minds in the industry, create high-performance scalable solutions? Do you want to be part of the team that is solutioning next-gen data platforms? Then this is the place for you.You want to architect and deliver solutions involving data engineering on Petabyte scale of data, that solve complex business...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India The Nielsen Company Full time

    ResponsibilitiesWork closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needsWrite both unit and integration tests, and develop automation tools for daily tasksDevelop high quality, well documented, and efficient code Manage and optimize scalable pipelines in the cloudOptimize...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description : Spark, SCALA, AWS OR Spark, python with AWS lambda exposure. Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...