Big Data Engineers

1 month ago

Bengaluru, India The Nielsen Company Full time
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.

About the role

Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.Responsibilities

Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises with an emphasis on quality, best-practice coding standards, and cost-effectivenessBuild and test Cloud-based applications for new and existing backend systems to help facilitate development teams to migrate to the cloud.Build platform reusable code and components that could be used by multiple project teams.Understand the enterprise architecture within the context of existing platforms, services and strategic direction.Implement end-to-end solutions with sound technical architecture, in Big Data analytics framework along with customized solutions that are scalable, with primary focus on performance, quality, maintainability, cost and testability.Drive innovative solutions within the platform to establish common components, while allowing customization of solutions for different products.Develop design specifications, continuous build and deployment strategy to drive Agile methodologySetup and manage expectations with consultants engaged in the projects.Provide cloud integration development support to various project teams.Build rapid technical prototypes for early customer validation of new technologiesCollaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelinesCollaborate with product owners to translate complex business requirements into technical solutions, providing leadership in the design and architecture processes.Provide expert apprenticeship to project teams on technology strategy, cultivating advanced skill sets in application engineering and implementing modern software engineering practicesMentor junior team members, providing guidance and support in their professional developmentStay informed about the latest technology and methodology by participating in industry forums, having an active peer network, and engaging actively with customersCultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through collaborative effort

Key Skills (Domain Expertise)

Bachelor’s degree in computer science, engineering plus 4-8 years of experience in information technology solutions development.Must have strong cloud Implementation expertise in cloud architecture.Must have strong analytical and technical skills in troubleshooting and problem resolution.Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security.3+ years of experience: big data using Apache Spark in developing distributed processing. applications; building applications with immutable infrastructure in the AWS Cloud with automation technologies like Terraform or Ansible or Cloud Formation.

Technical Skills

Experience in Service-oriented architecture, Spark Streaming, and Git.Experience in software development using programming languages & tools/services: Java or Scala, Big Data, Hadoop, Spark, Spark SQL, Presto \ Hive,Cloud (preferably AWS), Docker, RDBMS (such as Postgres and/or Oracle), Linux, Shell scripting, GitLab, Airflow.Experience in big data processing tools/languages using Apache Spark Scala.Experience with orchestration tools: Apache Airflow or similar tools.Strong knowledge on Unix/Linux OS, commands, shell scripting, python, JSON, YAML.Agile scrum experience in application development is required.Strong knowledge in AWS S3, PostgreSQL or MySQL.Strong knowledge in AWS Compute: EC2, EMR, AWS Lambda.Strong knowledge in Gitlab /Bitbucket .AWS Certification is a plus.

Mindset and attributes

Very strong verbal and written communication skillsAdvanced analytical and technical skills in troubleshooting and problem resolutionAbility to coach, mentor and provide guidance to junior colleagues#LI-DD1

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 DescriptionLooking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible.Bachelor's...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible....

  • Big Data Engineer

    1 month ago

    Bengaluru, India Adobe Full time

    Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Adobe Full time

    JOB LEVELMid-level roleEMPLOYEE ROLEIndividual ContributorResponsibilities:Build and maintain cutting-edge data platform and data processing pipelines.Challenge the status quo by innovating and creating a cost-effective big data platform.Collaborate across teams to develop AI-based experiences.Establish a culture of scientific processes and customer...

  • Big Data Engineer

    4 days ago

    Bengaluru, India Global Pharma Tek Full time

    Auto req IDBRTitleBig Data EngineerYour Role and ResponsibilitiesUnderstand a data warehousing solution and able to work independently in such an environmentResponsible in Project development and delivery experience of a few good size projectsPosting CountryIndiaState / ProvinceHaryānaCity / Township / VillageGurgaonTravel RequiredUp to % or day a...

  • Big Data Engineer

    1 month ago

    Bengaluru, India Hexaware Technologies Full time

    DescriptionData Engineer:Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryptionResponsibilities:•Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned.•Provide support in defining the scope and sizing of the work.•Working closely with various enterprise architects,...

  • Big Data Engineer

    2 months ago

    Bengaluru, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various...

  • Big Data Engineer

    2 months ago

    Bengaluru, Karnataka, India Adobe Full time

    JOB LEVELP50EMPLOYEE ROLEIndividual ContributorP50 (ESDEP50) Big Data Engineer What You'll Do Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 22, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    7 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 23, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    6 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    5 days ago

    Bengaluru, India Global Pharma Tek Full time

    Auto req ID BR Title Big Data Engineer Your Role and Responsibilities Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Posting Country India State / Province Haryāna City / Township / Village Gurgaon Travel...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 19, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 20, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 22, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 23, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    7 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    5 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    3 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    4 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 28, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...