Data Engineer

3 weeks ago


Bengaluru, India Rakuten India Full time

About Rakuten:

Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engineering, Data Science, Machine Learning, Artificial Intelligence and much more. Our unique 24/7 support center ensures reliability and sustenance of the Rakuten Ecosystem. With dedicated centres of excellence for Mobile Application Development, Data Analytics, Engineering, DevOps and Information Security, we ensure the success of multiple units of Rakuten Group, Inc. With 1700+ employees and growing, Rakuten India is housed in Crimson House Bangalore in the heart of the city.

Our History:

In 1997, Rakuten first began with Rakuten Ichiba, a B2B2C marketplace, with just six employees, one server, 13 merchants. With the mission of "empowering people and society through innovation and entrepreneurship," the Rakuten group rapidly grew with regional headquarters across the world.

In 2016, Rakuten India opened it doors in Bangalore, India, the tech city known as the Silicon Valley of India This research and development center became a key technology hub of the Rakuten Group, championing some of the products and platforms that run the businesses. With 1000+ (and growing) Rakutenians working on the very same mission as Rakuten Group, Inc, we believe that technology and business needs must challenge each other for true innovation to rise and make a telling business impact We have team members who work support Rakuten's global strategy across businesses such as e-Commerce, Digital, Marketing Platforms, Ecosystem Services and so on. "Walk together" is our guiding philosophy and together we continue to grow stronger by taking Rakuten’s businesses to the next level with not just existing products but also create some in the relevancy of Artificial Intelligence and Machine Learning.



Responsibilities:

  • Building next-generation scalable, reliable, flexible, high-performance data pipeline capabilities for ingestion of data from multiple sources containing complex dataset.
  • Continuously improve services you own, making them more performant, and utilising resources in the most optimised way.
  • Collaborate closely with engineering, data science team and product team to propose an optimal solution for a given problem statement
  • Working closely with DevOps team on performance monitoring and MLOps

Required Skills:

5+ Years of Data related technology experience

  • Good understanding of distributed computing principles
  • Experience in Apache Spark
  • Hands on programming with Python
  • Knowledge of Hadoop v2, Map Reduce, HDFS
  • Experience with building stream-processing systems, using technologies such as Apache Storm, Spark-Streaming or Flink
  • Experience with messaging systems, such as Kafka or RabbitMQ
  • Good understanding of Big Data querying tools, such as Hive
  • Experience with integration of data from multiple data sources
  • Good understanding of SQL queries, joins, stored procedures, relational schemas
  • Experience with NoSQL databases, such as HBase, Cassandra/Scylla, MongoDB
  • Knowledge of ETL techniques and frameworks
  • Performance tuning of Spark Jobs
  • General understanding of Data Quality is a plus point
  • Experience on Databrick/snowflake or similar lake houses would be a big plus
  • Nice to have some knowledge in DevOps


“Rakuten is committed to cultivating and preserving a culture of inclusion and connectedness. We are able to grow and learn better together with a diverse team and inclusive workforce. The collective sum of the individual differences, life experiences, knowledge, innovation, self-expression, and talent that our employees invest in their work represents not only part of our culture, but our reputation and Rakuten’s achievement as well. In recruiting for our team, we welcome the unique contributions that you can bring in terms of their education, opinions, culture, ethnicity, race, sex, gender identity and expression, nation of origin, age, languages spoken, veteran’s status, color, religion, disability, sexual orientation and beliefs”


  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)Hands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in any one of the programing languages (python or...

  • Sr data engineer

    2 days ago


    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or go)...

  • Senior Data Engineer

    1 month ago


    Bengaluru, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, India NTT DATA Full time

    Job DescriptionReq ID:268395NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineering Lead to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Lead...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Sr data engineer

    6 days ago


    Bengaluru, India NTT DATA Services Full time

    Req ID:286326NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineerStrong...


  • Bengaluru, India NTT DATA Full time

    Job Description Req ID: 268395 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineering Lead to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Sr data engineer

    1 week ago


    Bengaluru, India NTT DATA Services Full time

    Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineer  Strong...


  • Bengaluru, India NTT DATA Full time

    Job DescriptionAzure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years’ experience...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years' experience on Apache Spark or Azure...


  • Bengaluru, India NTT DATA Services Full time

    Lead Data Engineering Project Team,Expertise in Databricks,Expertise in Azure Cloud and its services,Experienced in Healthcare projects,Experience implementing FHIR Data model and FHIR Server


  • Bengaluru, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Azure Cloud and its services, Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Data Architect

    1 week ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description: Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at SalesforceWe are seeking a Data Modeler...