Senior Engineer, Data

4 weeks ago

Bengaluru, India News Corp Full time

Job Description

:

Senior Engineer, Data

One of the most innovative and high-profile teams in News Corp is looking for a

seasoned data engineer to help accelerate its vision. The role will involve combining all

of News Corp’s data across categories, countries and organizations into a singular view

of a customer enabling engagement, measurement and targeting. The NewsIQ Senior

Data Engineer will partner closely with product, data & engineering teams to help make

this data available and accessible to our businesses, teams and partners in order to

drive revenue and improve the customer experience.

Responsibilities

• Design, implement and maintain high performance big data

infrastructure/systems & big data processing pipelines scaling to billions of

structured and unstructured events daily

• Design, implement and maintain deep integration with up-stream systems

• Monitor performance of the data platform and optimize as needed

• Monitor and provide transparency into data quality across systems (accuracy,

consistency, completeness, etc)

 Support product with the overall roadmap and ensure updates to senior

leadership are 100% technically correct.

 Data analysis, understanding of business requirements and translation into

logical pipelines & processes

 Conduct timely and effective research in response to specific requests ( data

collection, summarization, analysis, and synthesis of relevant data and

information)

 Evaluate and prototype new technologies in the area of data processing

 Think quickly, communicate clearly and work collaboratively with product, data,

engineering, QA and operations teams

 High energy level, strong team player and good work ethic

Technologies we use

 Google Cloud Platform (GCS, Dataflow, BigQuery, DataStudio)

 Amazon Web Services (S3, EMR, Athena, Glue, Kinesis, Lambda)

 Google Cloud Platform (GCS, Dataflow, BigQuery)

 Python, R, Spark (PySpark)

 Kubernetes

 Airflow

 TableauGit for source code management

 Jira

Qualifications

• BS in Computer Science or other technical discipline

• 5+ years of experience designing and developing big data processing systems

using distributed computing

• Fluency in Python, Experience in Scala/Java is a huge plus

• Expert knowledge in optimizing complex SQL queries

• Experience with job orchestration tools

• An affinity for automation

• Experience working with cloud platforms such as AWS & GCP

• Familiarity with networking and network application programming, including

HTTP/HTTPS, JSON, and REST APIs

• Experience with at least one object oriented language (ex: Java)

• Strong OO design, data structure, and algorithm design skills

• Strong interest in emerging technologies: Spark, Hadoop, Hive, ElasticSearch,

NoSQL

Nice to Have

• Experience in the digital advertising and marketing industry

• Experience in Scala and Spark

• Experience with data science / modelling (TensorFlow and/or MXNet)

• Familiarity with API development and design

• Contribution to Open Source projects

This job is posted with NTS Technology Services Pvt. Ltd.

Job Category:

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Giant Eagle GCC Full time

    Sr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Capleo Global Full time

    Senior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:1. Spark2. Databricks3. PySpark or Scala4. SQL & Python5. Github6. DWH (Snowflake or Presto or Hive or Hadoop)7. Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Giant Eagle GCC Full time

    Sr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Giant Eagle GCC Full time

    Sr Data Engineer Data Analytics Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Giant Eagle GCC Full time

    Sr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION The client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers. The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Capleo Global Full time

    Senior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:SparkDatabricksPySpark or ScalaSQL & PythonGithubDWH (Snowflake or Presto or Hive or Hadoop)Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about shaping the...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Capleo Global Full time

    Senior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:SparkDatabricksPySpark or ScalaSQL & PythonGithubDWH (Snowflake or Presto or Hive or Hadoop)Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about shaping the...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Capleo Global Full time

    Senior Data Engineer Experience: 7-9 years Location: Bengaluru Availability: Immediate to 30 days Mandatory Skills: Spark Databricks PySpark or Scala SQL & Python Github DWH (Snowflake or Presto or Hive or Hadoop) Data Pipeline & Data Model We are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India ZoomInfo Full time

    Senior Data EngineerPosition: Senior Data EngineerLocation: BangaloreExperience : 7-10 YearsAbout the Role:Join our Product Data Monitoring team as a Data Engineer, where you play a pivotal role in enhancing and architecting the strategy behind our data monitoring and quality assurance systems. In this dynamic position, you'll serve as both a developer and...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India JLL Full time

    Job Description Senior Data Engineer About JLL and JLL Technologies JLL is a leading professional services firm that specializes in real estate and investment management. Our vision is to reimagine the world of real estate, creating rewarding opportunities and amazing spaces where people can achieve their ambitions. In doing so, we will build a...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India News Corp Full time

    Job Description: Senior Data EngineerAbout the RoleWe are looking for aSenior Data Engineerwith experience in excellent analytical abilities inGCP BigQuery, ETL/BI, Python,Composer/Airflow,DataFusion, SQL,GCP Services- with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.Skills & CompetenciesA...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    2 days ago

    Bengaluru, India Recro Full time

    Position: Senior Data EngineerLocation: BangaloreType: Full-TimeExperience Level: 4.5+ yearsJob Description:We're building a high-performing data team and searching for a skilled and passionate Data Engineer to join us! You'll be responsible for designing, developing, and maintaining our data infrastructure, ensuring a steady flow of clean, high-quality data...

  • Senior Data Engineer

    4 days ago

    Bengaluru, India Valiance Solutions Full time

    About Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India.Job Overview:We are seeking a highly skilled and experienced Senior Databricks Engineer to join...

  • Senior Data Engineer

    1 day ago

    Bengaluru, India Valiance Solutions Full time

    About Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India.Job Overview:We are seeking a highly skilled and experienced Senior Databricks Engineer to join...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India News Corp Full time

    Job Description : Senior Data Engineer About the Role We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, DataFusion, SQL , GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data...