Nielsen - Associate Big Data Engineer Airflow/Python/Spark

4 weeks ago

Bengaluru, Karnataka, India timesjobs Full time
Associate Big Data Engineer (Airflow/Python/Spark)
Bangalore, India
Technology - Engineering
Full Time / Hybrid
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey.

By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed.

We champion you because when you succeed, we do too.

Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve.

We enable your best to power our future.
About the role

As an Associate Data Engineer you will be responsible for data pipelines to work on both scheduled and real time use cases.

Schedule pipelines run typically in Airflow and real time processing could be airflow or integrated querying in backend services.

Responsibilities:
Work closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needs
Write both unit and integration tests, and develop automation tools for daily tasks
Develop high quality, well documented, and efficient code
Manage and optimize scalable pipelines in the cloud
Optimize internal and external applications for performance and scalability
Develop automated tests to ensure business needs are met, and write unit, integration, or data quality tests
Communicate regularly with stakeholders, project managers, quality assurance teams, and other developers regarding progress on long-term technology roadmap
Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives

Key Skills (Domain Expertise):
0-2 years of experience as a software/data engineer
Bachelor's degree in Computer Science, MIS, or Engineering

Technical Skills Preferred:
Experience with database systems, with knowledge of SQL and NoSQL stores (e.g. MySQL, Oracle, MongoDB, Couchbase, etc.)
Experience on a team developing sophisticated data driven software platforms
Experience with relational databases and/or analytical data stores (e.g., Spark, Presto, Pandas)
Contributing to delivery and support of enterprise software
Experience with cloud service technologies, ex: AWS

Experience with container technologies, ex:
Docker
Experience with source control systems, ex: GIT
Information visualization
"Big data" systems and analysis
Experience with data warehouses or data lakes

Mindset and Attributes:
Strong communication skills with ability to communicate complex technical concepts and align organization on decisions
Sound problem-solving skills with the ability to quickly process complex information and present it clearly and simply
Utilizes team collaboration to create innovative solutions efficiently

#LI-DD1

  • Nielsen - Big Data Engineers Airflow Python Spark

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Big Data Engineers (Airflow, Python, Spark) Bangalore, IndiaTechnology Engineering /Full Time/ HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you...

  • Nielsen - Manager Data Engineering - Big Data Spark Scala Python Cassandra Elasticserach AWS Airflow SQL

    1 month ago

    Bengaluru, Karnataka, India timesjobs Full time

    Job Title: Manager, Data Engineering - (Big Data, Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)Location: Bangalore, IndiaTechnology: OtherEmployment Type: Full TimeWork Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000...

  • Nielsen - Big Data Engineers Java/Scala/Hadoop/Spark/AWS

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Big Data Engineers (Java/Scala/Hadoop/Spark/AWS) Bangalore, IndiaTechnology Engineering /Full Time/ HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you...

  • Nielsen - Data Architect

    1 month ago

    Bengaluru, Karnataka, India timesjobs Full time

    Data ArchitectLocation: Bengaluru, IndiaEmployment Type: Full Time / HybridTechnology: EngineeringAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you...

  • Nielsen - Big Data Engineer Java/Python/Scala/SQL

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Big Data Engineer (Java/Python/Scala/SQL) Bangalore, IndiaTechnology Engineering /Full Time/ HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you...

  • Nielsen - Lead Data Scientist - Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India timesjobs Full time

    ## Position: Lead Data Scientist - Data Engineer Location: Bangalore, India Technology: Data Science Employment Type: Full Time Work Environment: Hybrid At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel, and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help...

  • Nielsen - Software Engineer - Big Data Engineer Java/Python

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Software Engineer - Big Data Engineer (Java/Python)Location: Bangalore, IndiaTechnology: Data & AnalyticsEmployment: Full TimeWork Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel, and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you...

  • Nielsen - Software Engineer - Data Engineering

    1 month ago

    Bengaluru, Karnataka, India timesjobs Full time

    Position: Software Engineer - Data EngineeringLocation: Bangalore, IndiaTechnology: OtherEmployment Type: Full TimeWork Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel, and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you succeed....

  • Nielsen - Software Engineer - Platform

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Position: Software Engineer - PlatformLocation: Bangalore, IndiaEmployment Type: Full TimeWork Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because...

  • Nielsen - Data Engineer - LM

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Data Engineer - LM Bangalore, IndiaTechnology: EngineeringEmployment Type: Full TimeWork Mode: HybridResponsibilitiesWork closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needsWrite both unit and integration tests, and develop automation tools for daily tasksDevelop high...

  • Nielsen - Data Engineer

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Data EngineerLocation: Bangalore, IndiaTechnology Data & AnalyticsFull TimeHybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too....

  • Nielsen - Manager Technology Big Data

    4 weeks ago

    Bengaluru, Karnataka, India timesjobs Full time

    Position: Manager, Technology (Big Data)Location: Bangalore, IndiaDepartment: Technology EngineeringEmployment Type: Full TimeWork Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel, and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you...

  • Nielsen - Senior/Lead Software Engineer - Data Engineering

    1 month ago

    Bengaluru, Karnataka, India timesjobs Full time

    # ### Senior/Lead Software Engineer - Data Engineering#### Location: Bangalore, India- Technology: Other- Employment Type: Full Time- Work Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will...

  • Nielsen - Senior Software Engineer - Bigdata Java/Scala Spark SQL AWS

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Job Title: Senior Software Engineer - Bigdata (Java/Scala, Spark, SQL, AWS)Location: Bangalore, IndiaTechnology: OtherEmployment Type: Full TimeWork Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community...

  • Nielsen - Senior Data Engineer-R

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    # : Senior Data Engineer-RLocation: Bengaluru, India### Technology:Engineering ### Job Type:Full Time### Work Arrangement:HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We...

  • Nielsen - Senior Data Engineer - Spark Presto Pandas RDS EC2 S3 Athena Lambda

    1 month ago

    Bengaluru, Karnataka, India timesjobs Full time

    Senior Data Engineer - (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda)Bangalore, IndiaTechnology: OtherEmployment Type: Full TimeWork Arrangement: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will...

  • Nielsen - Data Engineer - Machine learning Algorithms

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    Position: Data Engineer - Machine learning, AlgorithmsLocation: Bengaluru, IndiaTechnology: Data ScienceEmployment Type: Full Time / HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed....

  • Nielsen - Data Scientist Manager

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    : Data Scientist ManagerLocation:Bangalore, IndiaTechnology:Data ScienceEmployment Type:Full TimeWork Arrangement:HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel, and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you...

  • Nielsen - DevOps Engineer

    4 weeks ago

    Bengaluru, Karnataka, India timesjobs Full time

    Position: DevOps EngineerLocation: Bengaluru, IndiaType: Full TimeWork Environment: On-siteAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do...

  • Nielsen - Software Engineer - Full-stack

    1 month ago

    Bengaluru, Karnataka, India timesjobs Full time

    ### Position: Software Engineer - Full-stack Location: Bangalore, India Technology: Other Employment Type: Full Time Work Arrangement: Hybrid Nielsen Global Media uses cutting edge technology and industry leading data science to tackle some of the hardest problems in marketing science. Were automating our models with artificial intelligence and machine...