SR. Data Engineer

3 months ago

bangalore, India Nielsen Full time

Role : Software Engineer - Bigdata ( Scala or Python, Spark, SQL, AWS )

Location Type: Hybrid (Mumbai/Bangalore/Gurgaon)

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey.

By joining our team of nearly 14,000 associates, you will become part of a community that will help you to

succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore

a fresh approach, and take license to think big, so we can all continuously improve. We enable your best

to power our future.

As a Software Developer, you will be a contributor of a Scrum/DevOps team focusing on analyzing,

developing, testing, and supporting highly complex application software build on Big Data Your primary

objective is to ensure project goals are achieved and are aligned with business objectives. You will also

work closely with your Scrum team and program team to test, develop, refine and implement quality

software in production via standard Agile methodologies.

Responsibilities

Build and test Cloud-based applications for new and existing backend systems to help facilitate

development teams to migrate to the cloud with an emphasis on quality, best-practice coding standards,

and cost-effectiveness

Build platform reusable code and components that could be used by multiple project teams.

Provide cloud integration development support to various project teams.

Leverage modern design patterns and architectural principles to build platform reusable code and

components that can be used across projects and teams

Write both unit and integration tests, and develop automation tools for daily tasks

Support product owner in defining future stories and tech lead in defining technical requirements for new

initiatives

Build rapid technical prototypes for early customer validation of new technologies

Collaborate effectively with Data Science to understand, translate, and integrate methodologies into

engineering build pipelines

Collaborate with cross-functional teams and stakeholders to align development objectives with broaderbusiness goals


Key Skills

Domain Expertise

  • 3-8 years of hands-on software development with a bachelor’s degree in computer

science, engineering

  • Must have strong cloud Implementation expertise in cloud architecture.
  • Must have very good knowledge of storage, network, compute services. Have sound

knowledge in multi-zone, region-based designs.

  • Must have the ability to provide solutions utilizing best practices for resilience, scalability,

cloud optimization and security.

  • A quick learner, who can pick up new technologies, program languages and frameworks

in a short span of time


Technical Skills

  • Experience in software development using programming languages & tools/services:
  • Python or Scala and strong in SQL.
  • Experience in big data processing tools/languages and distributed computing using
  • Spark Scala or similar.
  • Experience with orchestration tools: Apache Airflow or similar tools.
  • Strong knowledge on Unix/Linux OS, commands, shell scripting, python, JSON, YAML.
  • Agile scrum experience in application development is required.
  • Strong knowledge in AWS S3, PostgreSQL or MySQL.
  • Deployment and automation: Terraform, Cloud Formation would be a plus.
  • Strong knowledge in Compute: EC2, EMR, AWS Lambda.
  • Strong knowledge in GitLab /Bitbucket.
  • Mindset and attributes
  • Strong verbal/written communication and interpersonal skills.
  • Must have strong analytical and technical skills in troubleshooting and problem resolution.
  • Ability to coach, mentor and provide guidance to junior colleagues

  • Sr. Data Engineer

    4 weeks ago

    Bangalore, India Ness Digital Engineering Full time

    Description Sr. Data EngineerJob Overview:We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in data integration and pipeline development using Snowflake. The ideal candidate will manage data ingestion and transformation, working with an offshore team to deliver efficient and scalable data solutions that align with business...

  • Sr. Data Engineer

    2 months ago

    Bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full time Skills Required: T-SQL, SSIS, SSRS Preferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark. Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both...

  • Sr. Data Engineer

    2 months ago

    bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full timeSkills Required: T-SQL, SSIS, SSRSPreferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark.Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both Structured...

  • Sr. Data Engineer/Lead

    1 month ago

    bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full time Skills Required: T-SQL, SSIS, SSRS Preferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark. Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both...

  • Sr. Data Engineer

    3 months ago

    bangalore, India Stellantis Full time

    Sr. Data EngineerMobilisights: enabling a smarter worldExponential growth in adoption and deployment of connected cars and devices is bringing previously unavailable datasets to market – at scale and in real-time.Our vision is a ‘smarter’ world where innovative applications and services leverage connected vehicle datasets, and the insights they...

  • Azure data engineer

    2 days ago

    Bangalore, India JRD Systems Full time

    Sr. Data Engineer – Azure Job Summary: Sr Cloud Data Engineer will be a senior level engineer who is able to lead the development effort/team and will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling, SQL knowledge is a must with Python programming background. The Data...

  • Senior Engineering Manager

    2 months ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    7 months ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Sr. Data Engineer

    3 months ago

    bangalore, India Stellantis Full time

    Sr. Data Engineer Mobilisights: enabling a smarter world Exponential growth in adoption and deployment of connected cars and devices is bringing previously unavailable datasets to market – at scale and in real-time. Our vision is a ‘smarter’ world where innovative applications and services leverage connected vehicle datasets, and the insights...

  • Data engineer

    2 days ago

    Bangalore, India Wall Street Consulting Services LLC Full time

    Job Title: Azure Data Engineer Location: PAN India Duration: Long-term Job Description: Azure data engineer ADF Databricks Python 8-10 years of experience with ADF Spark Databricks 8 -10 years of experience with Azure DP200 and or DP201 certification would be a plus Good knowledge of SQL and excellent coding skills Python, Py Spark Maintain...

  • Sr Test automation engineer

    1 month ago

    bangalore, India Tata Consultancy Servicess Full time

    Role-Sr Test automation engineer Bangalore/Kochi/Pune 4 to 10 Sr T est automation engineer having hands-on experience in Selenium , C# and Java. Must have knowledge in CI / CD, POM framework and API Automation Knowledge on Python, Cloud basics API and functional testing, Azure DevOps tool and MS SQL is good to have Should be able to manage a QA team as...

  • SR Azure data engineer

    4 weeks ago

    Bengaluru / Bangalore, India Charakala Amala (Proprietor of Expert HR Solutions) Full time

    SR. Azure Data EngineerLocation: Bharteeya City, BangaloreMode: HybridExperience: 8-9+ YearsSummaryA purposeful Azure Data Engineer with over 5-7 years of experience in designing, developing, implementing, and optimizing data solutions on Microsoft Azure. Proven expertise in leveraging Azure services for ETL processes, data warehousing and analytics,...

  • Senior Engineering Manager

    3 months ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    3 months ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Sr Test automation engineer

    1 month ago

    Bangalore, India Tata Consultancy Servicess Full time

    Role-Sr Test automation engineer Bangalore/Kochi/Pune 4 to 10 Sr T est automation engineer having hands-on experience in Selenium , C# and Java. Must have knowledge in CI / CD, POM framework and API Automation Knowledge on Python, Cloud basics API and functional testing, Azure DevOps tool and MS SQL is good to have Should be able to manage a QA...

  • Sr Test automation engineer

    1 month ago

    Bangalore, India Tata Consultancy Servicess Full time

    Role-Sr Test automation engineer Bangalore/Kochi/Pune 4 to 10 Sr T est automation engineer having hands-on experience in Selenium , C# and Java. Must have knowledge in CI / CD, POM framework and API Automation Knowledge on Python, Cloud basics API and functional testing, Azure DevOps tool and MS SQL is good to have Should be able to manage a QA...

  • Azure Data Engineer

    3 days ago

    Bangalore, India JRD Systems Full time

    Sr. Data Engineer – Azure Job Summary: Sr Cloud Data Engineer will be a senior level engineer who is able to lead the development effort/team and will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling, SQL knowledge is a must with Python programming background. The Data...

  • Sr. DFT Engineer

    4 weeks ago

    Bangalore, India Tech Mahindra Full time

    We are currently seeking below positions for Sr DFT Engineers with 5+ Scan & MBIST exp for Bangalore location. Interested can share profile at Required skills:- Proficient in DFT architectures & methodologies that includes Scan, ATPG, MBIST, JTAG, etc.

  • Sr. java developer

    2 days ago

    Bangalore, India Redolent, Inc Full time

    We are looking for Sr. Java Developer to join the team immediately TITLE: Sr. Java Developer LOCATION: India ( Bangalore ) - twice a week onsite hybrid model ( MUST ) Compensation: Competitive RESPONSIBILITIES Develops innovation strategies, processes, and best practices. Drives the execution of multiple business plans and projects. Supports...

  • Sr. data engineer

    1 month ago

    Bangalore, India Birlasoft Full time

    Position Summary: The purpose of the Senior Data Engineer is to support and improve business processes by delivering IT solutions within Investment Management The Senior Data Engineer will develop, design, and analyze applications and programs of moderate scope and complexity The Senior Data Engineer will use analytical skills to help develop complex...