Senior Data Engineer

2 months ago

bangalore, India The Nielsen Company Full time
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. As a Software Data Engineer you will be responsible for data pipelines to work on both scheduled and real time use cases. Schedule pipelines run typically in Airflow and real time processing could be airflow or integrated querying in backend services.

Responsibilities

Work closely with team leads and backend developers to design and develop functional, robust data pipelines to support internal and customer needs Write unit, integration, and DQA tests, and develop automation tools for daily tasks Develop high quality, well documented and efficient code  Manage and optimize scalable pipelines in the cloud Optimize internal and external applications for performance and scalability Communicate regularly with project managers, quality engineers, and other developers regarding progress on long-term technology roadmap Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives

Key Skills

Domain Expertise 4-8 years of experience as a software/data engineer  Bachelor’s degree in Computer Science, MIS, or Engineering Technical Skills Advanced experience with relational database systems (RDBMS), with advanced proficiency in SQL for data querying, manipulation. Additionally complex data analysis, optimization, and performance tuning (MySQL, PostgresSQL, Amazon RDS). Advanced proficiency with data integration and ETL (Extract, Transform, Load) processes to move and transform data between systems. Experience (2+ years) with data pipeline orchestration tools like Apache Airflow for workflow management and automation. In-depth knowledge of data warehouse design principles and best practices, including schema design, indexing strategies, and partitioning techniques. Experience with analytical data stores and strong understanding of distributed computing principles (, Spark, Presto, Pandas) Advanced proficiency with cloud service technologies, ex: AWS (RDS, EC2, S3, Athena, Lambda) Expertise in designing and optimizing data architectures for scalability, performance, and cost efficiency in cloud environments. Experience with Docker container technology, familiar with kubernetes. Experience with GIT (Gitlab preferred) source control systems Familiarity with data governance, security, and compliance standards in cloud environments. Experience with data visualization tools such as Tableau, Power BI, or Looker for creating interactive dashboards and reports Mindset and attributes Leadership and Mentoring skills to assist junior members of the data engineering team. Proven track record of successfully completing end-to-end data projects from conception to implementation, including requirements gathering, design, development, testing, and deployment. Strong problem-solving abilities to identify and resolve complex technical challenges in data processing and analytics. Excellent project management skills to prioritize tasks, manage timelines, and deliver results within scope and budget constraints. Effective communication skills to collaborate with stakeholders across different departments and levels of the organization. Strategic thinking and ability to align data engineering initiatives with business objectives and organizational goals. Continuous learning mindset to stay updated with emerging technologies, industry trends, and best practices in data engineering and analytics.

  • Senior Mechanical Engineer

    4 weeks ago

    bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Data Engineer

    3 days ago

    bangalore, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services,  Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...

  • Senior Data Engineer

    2 days ago

    bangalore, India Giant Eagle GCC Full time

    Senior Software Engineer - Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...

  • Senior Data Engineer

    3 days ago

    bangalore, India Giant Eagle GCC Full time

    Senior Software Engineer - Data Analytics Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India Giant Eagle GCC Full time

    Sr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...

  • Senior Data Engineer

    6 days ago

    bangalore, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India Huron Full time

    The Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Huron Full time

    The Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create sustainable...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    6 days ago

    bangalore, India New Relic, Inc. Full time

    Senior Data Engineer Senior Data Engineer Senior Data Engineer Req ID FY|S&M|#8 Location(s) Bangalore, India; Work arrangement(s) Hybrid (works from home and New Relic office throughout the week), Office (works primarily in a New Relic office) Your opportunity Do you love the transformative impact data can have on a business? Are you motivated to push for...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India Dexian India Full time

    Job Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, ETL processes, dashboarding, and data warehousing, with a focus on building high-quality, high-volume data pipelines. If you are passionate about leveraging data to drive...

  • Senior Engineer, Data

    4 weeks ago

    bangalore, India News Corp Full time

    Job Description : Senior Engineer, Data One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement,...

  • Senior Data Engineer

    2 months ago

    bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    1 month ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    2 months ago

    bangalore, India JLL Full time

    Job Description Senior Data Engineer About JLL and JLL Technologies JLL is a leading professional services firm that specializes in real estate and investment management. Our vision is to reimagine the world of real estate, creating rewarding opportunities and amazing spaces where people can achieve their ambitions. In doing so, we will build a...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Lead Engineer

    5 days ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  272900  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....

  • Senior Lead Engineer

    4 days ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  272900  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....

  • Senior Data Engineer

    2 months ago

    Bangalore, India Trueblue HR Consultants Full time

    Role and Responsibilities :- The Senior Data Engineer will be responsible for delivering high-quality modern data solutions through collaboration with the team and customers. - Projects may range from short-term client assessments to multi-year delivery engagements with large, blended teams.Candidate Qualifications :The ideal candidate should possess a...

  • Senior Data Engineer

    2 months ago

    bangalore, India News Corp Full time

    Job Description : Senior Data Engineer About the Role We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, DataFusion, SQL , GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the...