![The Nielsen Company](https://media.trabajo.org/img/noimg.jpg)
Manager - Big Data (AWS/Scripting (Java, Python)
1 week ago
Responsibilities
Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises. Write technical documentation to support analysis and design recommendations and drafts. Build platform reusable code and components that could be used by multiple project teams. Provide cloud integration development support to various project teams. Rapidly identify and resolve technical incidents as they emerge. Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines. Stay informed about the latest technology and methodology by participating in industry forums, having an active peer network, and engaging actively with customers. Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through collaborative effort.Key Skills (Domain Expertise)
5-7 years of related experience with a Bachelor's degree. 2-3 years experience in managing people and leading teams. Experience in software development using programming languages & tools/services: Java, Python and strong in SQL.Technical Skills
Frontend Technology Skills Set: JavaScript, Grails, SQL and shell scripting experience. Backend Technology Skills Set: AWS and/or Oracle Cloud experience, Java, ETL Tools (Informatica, Talend, ODI), Strong SQL knowledge, Python, Scripting. Big Data Skills Set (3-5 years): Spark Scala, Spark SQL, AWS Cloud (EC2, S3). Other desired skill sets: Airflow, Gitlab, Parquet File processing. Strong knowledge on Unix/Linux OS, commands, shell scripting, python. Agile scrum experience in application development is required. Strong knowledge in AWS S3, PostgreSQL, Oracle or SQL server. Deployment and automation: Terraform, Cloud Formation would be a plus. Strong knowledge in Gitlab /Bitbucket. Legacy technology such as: FoxPro, COBOL, Struts) is a plus. Strong knowledge in Compute: EC2, EMR, AWS Lambda. AWS Certification is a plus.Mindset and Attributes
Strong verbal/written communication and interpersonal skills. Strong leadership qualities and the ability to inspire and motivate a team. Strong ability to translate business requirements into technical solutions and guide the team in execution.-
Bengaluru, Karnataka, India Nielsen Full timeAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India randstad Full timePrimary Responsibilities : Design, develop, and implement big data solutions using Java, Python, or Scala. Utilize SQL and Spark Scala for data processing and analysis. Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda. Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and retrieval....
-
442144 - Python, Java, SQL, Big Data, Hadoop
1 week ago
Bengaluru, Karnataka, India Ziniosedge Full time9 yrs to 12 yrsPython, Java, SQL, BIG Data, Hadoop, Oracle DBPython, Java, SQL, BIG Data, Hadoop, Oracle DB
-
Big data architect
1 week ago
Bengaluru, Karnataka, India Virtusa Full timeBig data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...
-
Big data developer
1 week ago
Bengaluru, Karnataka, India Virtusa Full timeBig data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...
-
Aws big data engineer
1 week ago
Bengaluru, Karnataka, India Global Pharma Tek Full timeob DescriptionTechnical skills. Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...
-
Manager - Big Data Tools
1 week ago
Bengaluru, Karnataka, India Jobs for Humanity Full timeAbout The Role :- This position is responsible for working independently and possibly leading a team to analyze, develop, test, and support highly complex application software.- Some systems will be in legacy technology and require the ability to interpret code and process flows.- The Manager will provide technical expertise and guidance to project team...
-
Aws big data engineer
1 week ago
Bengaluru, Karnataka, India Global Pharma Tek Full timeob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...
-
Big Data Architect
1 week ago
Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full timeResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...
-
Big data developer
1 week ago
Bengaluru, Karnataka, India Virtusa Full timeBig data developer - CREQ185815 DescriptionPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka....
-
Big Data Architect
1 week ago
Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Tata Elxsi Full timeJob Description :At least 4+ years of experience pyspark framework. Good experience writing complex SQL and No SQL databases. Excellent coding and design skills, particularly in Pyspark and Python. Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh). Experience in AWS technologies...
-
Big data architect
1 week ago
Bengaluru, Karnataka, India Virtusa Full timeBig data architect - CREQ185795 DescriptionPosition: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala....
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Virtusa Full timeBig Data Engineer - CREQ190570 DescriptionQualifications Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)...
-
Big Data
1 week ago
Bengaluru, Karnataka, India Riverforest Connections Full timeJob Description:Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)Database experience preferably with DB2, Sybase, or Oracle Complete SDLC process and Agile Methodology (Scrum) Version control Git SpringSkill Desired: Previous experience in Trade Surveillance or working with data from the order lifecycle High quality software architecture and...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Evnek Technologies Pvt Ltd Full timeJob DescriptionThis is a remote position.Create and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and fintech ka experience MUST.Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and...
-
Senior Java Big Data Engineer
1 week ago
Bengaluru, Karnataka, India SavvyR Solutions Private Limited Full timeYour primary focus will be writing clean, maintainable, and efficient Java code to extract, transform, and load massive datasets. You will also collaborate closely with data scientists, analysts, and other engineers to ensure our solutions meet business needs and deliver real value.Responsibilities : Design, develop, test, and deploy robust, scalable Java...
-
Cloud Big Data Architect
1 week ago
Bengaluru, Karnataka, India Impetus Technologies Full timeCloud Data ArchitectDo you want to work with the best minds in the industry, create high-performance scalable solutions? Do you want to be part of the team that is solutioning next-gen data platforms? Then this is the place for you.You want to architect and deliver solutions involving data engineering on Petabyte scale of data, that solve complex business...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India The Nielsen Company Full timeResponsibilitiesWork closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needsWrite both unit and integration tests, and develop automation tools for daily tasksDevelop high quality, well documented, and efficient code Manage and optimize scalable pipelines in the cloudOptimize...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India ATech Full timeHiring For Big Data Engineer (Spark, Scala, AWS)Job description : Spark, SCALA, AWS OR Spark, python with AWS lambda exposure. Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...