Senior Engineer, Data
1 month ago
Job Description
:
Senior Engineer, Data
One of the most innovative and high-profile teams in News Corp is looking for a
seasoned data engineer to help accelerate its vision. The role will involve combining all
of News Corp’s data across categories, countries and organizations into a singular view
of a customer enabling engagement, measurement and targeting. The NewsIQ Senior
Data Engineer will partner closely with product, data & engineering teams to help make
this data available and accessible to our businesses, teams and partners in order to
drive revenue and improve the customer experience.
Responsibilities
• Design, implement and maintain high performance big data
infrastructure/systems & big data processing pipelines scaling to billions of
structured and unstructured events daily
• Design, implement and maintain deep integration with up-stream systems
• Monitor performance of the data platform and optimize as needed
• Monitor and provide transparency into data quality across systems (accuracy,
consistency, completeness, etc)
Support product with the overall roadmap and ensure updates to senior
leadership are 100% technically correct.
Data analysis, understanding of business requirements and translation into
logical pipelines & processes
Conduct timely and effective research in response to specific requests ( data
collection, summarization, analysis, and synthesis of relevant data and
information)
Evaluate and prototype new technologies in the area of data processing
Think quickly, communicate clearly and work collaboratively with product, data,
engineering, QA and operations teams
High energy level, strong team player and good work ethic
Technologies we use
Google Cloud Platform (GCS, Dataflow, BigQuery, DataStudio)
Amazon Web Services (S3, EMR, Athena, Glue, Kinesis, Lambda)
Google Cloud Platform (GCS, Dataflow, BigQuery)
Python, R, Spark (PySpark)
Kubernetes
Airflow
TableauGit for source code management
Jira
Qualifications
• BS in Computer Science or other technical discipline
• 5+ years of experience designing and developing big data processing systems
using distributed computing
• Fluency in Python, Experience in Scala/Java is a huge plus
• Expert knowledge in optimizing complex SQL queries
• Experience with job orchestration tools
• An affinity for automation
• Experience working with cloud platforms such as AWS & GCP
• Familiarity with networking and network application programming, including
HTTP/HTTPS, JSON, and REST APIs
• Experience with at least one object oriented language (ex: Java)
• Strong OO design, data structure, and algorithm design skills
• Strong interest in emerging technologies: Spark, Hadoop, Hive, ElasticSearch,
NoSQL
Nice to Have
• Experience in the digital advertising and marketing industry
• Experience in Scala and Spark
• Experience with data science / modelling (TensorFlow and/or MXNet)
• Familiarity with API development and design
• Contribution to Open Source projects
This job is posted with NTS Technology Services Pvt. Ltd.
Job Category:
-
Senior Mechanical Engineer
1 month ago
bangalore, India Abha Engineer Full timeWe are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.
-
Senior Mechanical Engineer
4 days ago
bangalore, India Abha Engineer Full timeWe are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.
-
Senior Data Engineer
2 weeks ago
bangalore, India NTT DATA Full timeJob Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...
-
Senior Data Engineer
2 weeks ago
bangalore, India Giant Eagle GCC Full timeSenior Software Engineer - Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...
-
Senior Data Engineer
2 weeks ago
bangalore, India Giant Eagle GCC Full timeSenior Software Engineer - Data Analytics Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the...
-
Senior Data Engineer
1 month ago
bangalore, India Giant Eagle GCC Full timeSr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...
-
Senior Data Engineer
2 weeks ago
bangalore, India Twenty20 Systems Full timeWe are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...
-
Senior Data Engineer
4 days ago
bangalore, India Mitchell Martin Inc. Full timeJOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...
-
Senior Data Engineer
3 weeks ago
bangalore, India Huron Full timeThe Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create...
-
Senior Data Engineer
3 weeks ago
Bangalore, India Huron Full timeThe Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create sustainable...
-
Senior Data Engineer
5 days ago
Bangalore, India Huron Full timeThe Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create sustainable...
-
Senior Data Engineer
4 days ago
bangalore, India Huron Full timeThe Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create...
-
Senior Data Engineer
3 weeks ago
bangalore, India Twenty20 Systems Full timeWe are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...
-
Senior Data Engineer
3 days ago
bangalore, India Twenty20 Systems Full timeWe are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...
-
Senior Data Engineer
2 weeks ago
bangalore, India New Relic, Inc. Full timeSenior Data Engineer Senior Data Engineer Senior Data Engineer Req ID FY|S&M|#8 Location(s) Bangalore, India; Work arrangement(s) Hybrid (works from home and New Relic office throughout the week), Office (works primarily in a New Relic office) Your opportunity Do you love the transformative impact data can have on a business? Are you motivated to push for...
-
Senior Data Engineer
4 days ago
bangalore, India New Relic, Inc. Full timeSenior Data Engineer Senior Data Engineer Senior Data Engineer Req ID FY|S&M|#8 Location(s) Bangalore, India; Work arrangement(s) Hybrid (works from home and New Relic office throughout the week), Office (works primarily in a New Relic office) Your opportunity Do you love the transformative impact data can have on a business? Are you motivated to push for...
-
Senior Data Engineer
1 month ago
bangalore, India Dexian India Full timeJob Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, ETL processes, dashboarding, and data warehousing, with a focus on building high-quality, high-volume data pipelines. If you are passionate about leveraging data to drive...
-
Senior Engineer, Data
4 days ago
bangalore, India News Corp Full timeJob Description : Senior Engineer, Data One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement,...
-
Senior Data Engineer
2 months ago
bangalore, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...