Data Engineer

3 weeks ago

bangalore, India Rakuten India Full time
About Rakuten:
Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engineering, Data Science, Machine Learning, Artificial Intelligence and much more. Our unique 24/7 support center ensures reliability and sustenance of the Rakuten Ecosystem. With dedicated centres of excellence for Mobile Application Development, Data Analytics, Engineering, DevOps and Information Security, we ensure the success of multiple units of Rakuten Group, Inc. With 1700+ employees and growing, Rakuten India is housed in Crimson House Bangalore in the heart of the city.
Our History:
In 1997, Rakuten first began with Rakuten Ichiba, a B2B2C marketplace, with just six employees, one server, 13 merchants. With the mission of "empowering people and society through innovation and entrepreneurship," the Rakuten group rapidly grew with regional headquarters across the world.
In 2016, Rakuten India opened it doors in Bangalore, India, the tech city known as the Silicon Valley of India This research and development center became a key technology hub of the Rakuten Group, championing some of the products and platforms that run the businesses. With 1000+ (and growing) Rakutenians working on the very same mission as Rakuten Group, Inc, we believe that technology and business needs must challenge each other for true innovation to rise and make a telling business impact We have team members who work support Rakuten's global strategy across businesses such as e-Commerce, Digital, Marketing Platforms, Ecosystem Services and so on. "Walk together" is our guiding philosophy and together we continue to grow stronger by taking Rakuten’s businesses to the next level with not just existing products but also create some in the relevancy of Artificial Intelligence and Machine Learning.
Responsibilities:
Building next-generation scalable, reliable, flexible, high-performance data pipeline capabilities for ingestion of data from multiple sources containing complex dataset.
Continuously improve services you own, making them more performant, and utilising resources in the most optimised way.
Collaborate closely with engineering, data science team and product team to propose an optimal solution for a given problem statement
Working closely with DevOps team on performance monitoring and MLOps
Required Skills:
5+ Years of Data related technology experience
Good understanding of distributed computing principles
Experience in Apache Spark
Hands on programming with Python
Knowledge of Hadoop v2, Map Reduce, HDFS
Experience with building stream-processing systems, using technologies such as Apache Storm, Spark-Streaming or Flink
Experience with messaging systems, such as Kafka or RabbitMQ
Good understanding of Big Data querying tools, such as Hive
Experience with integration of data from multiple data sources
Good understanding of SQL queries, joins, stored procedures, relational schemas
Experience with NoSQL databases, such as HBase, Cassandra/Scylla, MongoDB
Knowledge of ETL techniques and frameworks
Performance tuning of Spark Jobs
General understanding of Data Quality is a plus point
Experience on Databrick/snowflake or similar lake houses would be a big plus
Nice to have some knowledge in DevOps
“Rakuten is committed to cultivating and preserving a culture of inclusion and connectedness. We are able to grow and learn better together with a diverse team and inclusive workforce. The collective sum of the individual differences, life experiences, knowledge, innovation, self-expression, and talent that our employees invest in their work represents not only part of our culture, but our reputation and Rakuten’s achievement as well. In recruiting for our team, we welcome the unique contributions that you can bring in terms of their education, opinions, culture, ethnicity, race, sex, gender identity and expression, nation of origin, age, languages spoken, veteran’s status, color, religion, disability, sexual orientation and beliefs”

  • Sr data engineer

    21 minutes ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services,  Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Sr data engineer

    5 days ago

    bangalore, India NTT DATA Services Full time

    Req ID:  286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data engineer   ...

  • Sr data engineer

    4 days ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data...

  • Senior Data Engineering Lead

    24 hours ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  268395  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineering Lead to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    3 weeks ago

    Bangalore, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Data Architect

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description : Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at Salesforce!We are seeking a Data...

  • Senior Data Engineering Lead

    31 minutes ago

    bangalore, India NTT DATA Services Full time

    Req ID:  268395  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineering Lead to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Lead Data...

  • Senior Data Engineering Lead

    1 day ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 268395  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineering Lead to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Aptus Data Labs

    2 months ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 months ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python   • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or...

  • Data Engineer

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python   • 8 to 13 years of experience in Data engineering • Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB) • Hands-on experience in Snowflake • Proficient in Data Pipeline Orchestration • Proficient in any one of the programing...

  • Data Architect

    3 weeks ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 281978  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description:...

  • Data Architect

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 281978  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description:...

  • Data Architect

    4 weeks ago

    bangalore, India NTT DATA Services Full time

    Req ID:  281978  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description: Data...

  • Staff Engineer

    4 weeks ago

    bangalore, India Hevo Data Full time

    About Hevo Data: Unleash the power of data at Hevo! Join our team of brilliant minds as we revolutionize the world of data connectivity. Our mission is simple: to empower organisations with seamless access to their data universe, enabling smarter decisions and unlocking their full potential. Are you ready to be part of the data revolution that is shaping the...