Big Data Engineer
11 hours ago
Description :
Teamwork makes the stream work. Roku is changing how the world watches TV. Roku is the #1 TV streaming platform in the Canada, and Mexico, and we've set our sights on powering every television in the world.
Roku pioneered streaming to the TV.
Our mission is to be the TV streaming platform that connects the entire TV ecosystem.
We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers.
From your first day at Roku, you'll make a valuable and valued contribution.
We're a fast-growing public company where no one is a bystander.
We offer you the opportunity to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines.
About the team :
We store over 70 PB of data, run 10+M queries per month, scan over 100 PB of data per month.
Big Data team is the one responsible for building, running, and supporting the platform that makes this possible.
We provide all the tools needed to acquire, generate, process, monitor, validate and access the data in the lake for both streaming data and batch.
We are also responsible for generating the foundational data.
The systems we provide include Scribe, Kafka, Hive, Presto, Spark, Flink, Pinot, and others.
The team is actively involved in the Open Source, and we are planning to increase our engagement over time.
About the Role :
We are working on defining the new architecture to improve user experience, minimize the cost and increase efficiency.
Are you interested in helping us build this state-of-the-art big data platform? Are you an expert with Big Data Technologies? Have you looked under the hood of these systems? Are you interested in Open Source? If you answered Yes to these questions, this role is for you.
What you will be doing :
Making sure the systems run efficiently and with minimal cost is a top priority.
You will be making changes to the underlying systems and if an opportunity arises, you can contribute your work back into the open source.
You will also be responsible for supporting internal customers and on-call services for the systems we host.
Making sure we provided stable environment and great user experience is another top priority for the team.
We are excited if you have :
- Strong programming expertise in Java, Scala, Kotlin or another JVM language.
- A robust grasp of distributed systems concepts, algorithms, and data structures.
- Strong familiarity with the Apache Hadoop ecosystem : Spark, Kafka, Hive/Iceberg/Delta Lake,
Presto/Trino, Pinot, etc.
- Experience working with at least 3 of the technologies/tools mentioned here : Big Data /
Hadoop, Kafka, Spark, Trino, Flink, Airflow, Druid, Hive, Iceberg, Delta Lake, Pinot, Storm etc.
- Extensive hands-on experience with public cloud AWS or GCP.
- BS/MS degree in CS or equivalent.
- AI Literacy /AI growth mindset.
Benefits :
Roku is committed to offering a diverse range of benefits as part of our compensation package to support our employees and their families.
Our comprehensive benefits include global access to mental health and financial wellness support and resources.
Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension).
Our employees can take time off work for vacation and other personal reasons to balance their evolving work and life needs.
It's important to note that not every benefit is available in all locations or for every role.
For details specific to your location, please consult with your recruiter.
The Roku Culture :
We try to surround ourselves with people who are great at their jobs, who are easy to work with, and who keep their egos in check.
We appreciate a sense of humor.
We believe a fewer number of very talented folks can do more for less cost than a larger number of less talented teams.
We're independent thinkers with big ideas who act boldly, move fast and accomplish extraordinary things through collaboration and trust.
In short, at Roku you'll be part of a company that's changing how the world watches TV.
We have a unique culture that we are proud of.
We think of ourselves primarily as problem-solvers, which itself is a two-part idea.
We come up with the solution, but the solution isn't real until it is built and delivered to the customer.
That penchant for action gives us a pragmatic approach to innovation, one that has served us well since
-
Big Data Engineer
4 days ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per yearProfile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...
-
Big Data Engineer
8 hours ago
Bengaluru, Karnataka, India Akshya Patra Services Full time ₹ 5,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled Big Data Engineer with expertise in various Big Data tools and ecosystems. The ideal candidate should have hands-on experience with technologies such as Hadoop, Spark, Hive, and Impala. A strong proficiency in programming languages like Scala, Java, and Python is essential for designing and implementing data processing...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Deqode Full time ₹ 5,00,000 - ₹ 25,00,000 per yearBig Data Engineer Tech Stack: Python, Hive & Apache Spark Java & Advanced SQL Hadoop & Big Data Ecosystem Apache Airflow & ETL Pipelines Docker & Containerization Data Modelling & Warehousing Experience- 5 years Share your updated resume now.
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per yearKey skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full timeJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...
-
Big Data Engineers/Senior Engineers
1 week ago
Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per yearLocation – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...