Senior Data Engineer

2 weeks ago


Bengaluru, Karnataka, India SmartQ Full time

Senior Data Engineer About SmartQ:

We are a leading B2B Food-Tech company built on 4 pillars-great people, great food, great experience, and greater good.

Solving complex business problems with our heart and analysing possible solutions with our mind lie in our DNA. We are on the perpetual route of serving our clients wholeheartedly.

Armed with the stability of an MNC and the agility of a start-up, we have spread across 17 countries, having collaborated and executed successfully with 600 clients.

We have grown from strength to strength with a blend of exuberant youth and exceptional experience.

Bengaluru being our headquarters is known as the innovation hub and we have grown up to be the global leader in the institutional food tech space.

We were recently acquired by the world's largest foodservice company – Compass group which has an annual turnover of 20 billion USD.

To know more about the 5 key pillars that surround our culture check out our 'Life' page.

You will be amazed to be a part of our growth story - Want to be a part of our team: Are you passionate about designing, implementing, and managing the data architecture of an organization? If your response is a resounding yes, then we are hunting for you.

As a Senior Data Engineer at SmartQ, your primary goal will revolve around creating and maintaining the infrastructure and tools necessary for collecting, storing, processing, and analyzing large volumes of data.

In addition, possessing strong technical skills, leadership abilities, and a deep understanding of data engineering principles will keep you functioning a cut above the rest.

If you are a dynamic, results-oriented data wizard with a proven track record in steering MNCs toward unprecedented success, we invite you to seize this opportunity to make a profound impact on our global presence.

Do you possess all these skills and wish to make a significant difference in the world of food and technology? Join us now Key roles and responsibilities Lead the design and development of scalable data pipelines and ETL processes to process and transform large volumes of data efficiently.

Define and implement data integration solutions to consolidate data from multiple sources into a unified view, ensuring data consistency and accuracy.

Optimize data delivery and performance by implementing caching mechanisms, indexing strategies, and other advanced techniques.

Collaborate with Data Analysts, Data Architects, and other stakeholders to understand data requirements and design data solutions aligned with business needs.

Skilled in high data quality standards by implementing data validation and monitoring procedures. Continuous research and stay up to date with emerging data engineering technologies and industry best practices.

Participate in code reviews, mentor, and guide junior data engineers, and contribute to the development of data engineering standards and best practices.

Work closely with the product development teams to seamlessly integrate data engineering solutions into our products and services.

Qualifications:
Bachelor's or master's degree in computer science, Information Technology, or a related field.

4-8 years of hands-on work experience and a proven track record in data engineering, data architecture, or a related role.

proficiency in data modelling, data warehousing concepts, ETL processes and data processing techniques to transform and cleanse raw data. Programming skills in Python, SQL, Scala, Java or any other programming languages used in data engineering.

Hands-on experience with data storage technologies such as Google Data Fusion, and Apache Data Flow, SQL databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g.

Cassandra, MongoDB etc.) Experience with cloud-based data solutions, such as AWS, Azure, or Google Cloud Platform for deploying and managing big data infrastructure. Internal Working knowledge of data store and visualization tools such as Google Looker, Power BI, Tableau is an advantage. Expertise in Data Management/Architecture Practices, including Data Integration, Data Governance, Data Quality, Metadata Management, Data Security, and Data Encryption. Problem-solving and analytical skills with strong communication and collaboration abilities. Ability to lead and mentor a team of data engineers and drive projects to successful completion.

Technical skills:

Data Technologies:
Proficiency in working with big data technologies like Hive, Hadoop, Apache Spark, Apache Flink, Apache Kafka, Apache HBase, Flink, Pig

Ingestion:
Familiarity with tools and frameworks used to ingest data from different sources, such as Apache Nifi, Apache Sqoop, Apache Flume, or custom ingestion solutions

Modelling:
Understanding of data modelling techniques to design efficient and scalable data structures

Computing:
Knowledge of distributed computing concepts and frameworks to handle large-scale data processing. Elastic Search, Cassandra, MapReduce, Dataproc, DataBricks etc.

Security:
Understanding of data security principles and methods to ensure data protection and compliance

Quality Management:
Expertise in data quality assessment, validation, and cleansing techniques to maintain high-quality data.

BENEFITS OF WORKING AT SMARTQ:

SmartQ is an innovative and dynamic company that values its employees and strives to create a positive and fulfilling work environment.

Here are some key benefits that make SmartQ an excellent choice for prospective employees:

Innovative Work Culture :

SmartQ fosters an innovative and collaborative work culture, encouraging employees to think outside the box and contribute creative solutions to challenges.


  • Career Growth and Development : SmartQ is committed to the professional development of its employees. The company offers ongoing training programs, mentorship opportunities, and a clear career path to help employees achieve their professional goals.

Work-Life Balance :

SmartQ understands the importance of work-life balance and strives to create a supportive environment that allows employees to excel in their careers without sacrificing their personal lives.


  • Competitive Compensation and Benefits : SmartQ offers competitive salaries and a comprehensive benefits package, including health insurance, retirement plans, and other perks to ensure the well-being and financial security of its employees.
  • Diverse and Inclusive Environment : SmartQ values diversity and inclusion. The company is committed to creating a workplace that celebrates differences and provides equal opportunities for all employees.

Flexibility :

SmartQ recognizes the changing nature of work and supports flexible work arrangements, including remote work options, to accommodate the diverse needs and preferences of its employees.


Team Collaboration :
SmartQ believes in the power of teamwork. Employees collaborate across departments, fostering a sense of camaraderie and shared achievement.

Social Responsibility :

SmartQ is dedicated to corporate social responsibility and encourages employees to participate in community service initiatives and environmental sustainability programs.


  • Fun and Engaging Work Environment : SmartQ believes that a positive and fun work environment enhances productivity and job satisfaction. The company organizes team building activities, social events, and other initiatives to promote a sense of camaraderie among employees.

Message from CEO:

We've come to realize that we're not merely in the B2B Food service industry; we're in the business of 'Capturing Hearts.' We find ourselves in a unique position to turn ordinary, mundane corporate cafeterias into places of pure delight, where individuals can freely express themselves, find inspiration, and share happiness.

Such a profound transformation opportunity is a rare gift, where the purpose of our enterprise transcends the ordinary.

If this vision resonates with you, we invite you to join us in our mission to spread joy and happiness in a world weighed down by stress and pressure.

Together, let's play our part in making this world a more beautiful place.

  • Bengaluru, Karnataka, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.Manpower Planning.Preparing of Project Cost.Schedule wise work execution.As Drawing & quality work execution.Client & Third Party Manage.Working Team Manage & Review.Reporting to Management.ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Giant Eagle GCC Full time

    Senior Software Engineer - Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country's...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Giant Eagle GCC Full time

    Sr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country's largest food...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Huron Full time

    The OpportunityHuron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create sustainable growth,...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)Hands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in any one of the programing languages (python or...


  • Bengaluru, Karnataka, India Upstox Full time

    Apply for Upstox Senior Data Engineer/ Lead Data Engineer, Career Progress Consultants in Bengaluru/ Bangalore for Year of Experience on

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Lorven Technologies Full time

    JOB TITLE: Senior Data Engineer - Cloud Analytics SpecialistJoin our team as a Senior Data Engineer specializing in Cloud Analytics! You will have a pivotal role in designing, constructing, and managing scalable data pipelines and analytics solutions on various cloud platforms. Utilize your expertise in data engineering, cloud technologies, and analytics...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Commonwealth Bank Full time

    Organisation: At CommBank, we are always aware of the impact we have on people's financial wellbeing. Our goal is to support individuals and businesses in moving forward towards achieving their dreams and aspirations. No matter where you are in our team, your creativity, skills, ideas, and enthusiasm all contribute to the meaningful work we do. Together, we...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Philips Full time

    Job Title: Senior Data EngineerJob Description:Overall Job SummaryThe Senior Data Engineer specializes in designing and developing cutting-edge data pipelines and Analytical Solutions. In this role, you will play a key part in the company's transition from On-Premises to Cloud. Collaborate with Data Scientists, Business Analysts, and Clinical teams; provide...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India TalentPulse Consultant Full time

    Job Description:We are looking for a talented Senior Data Engineer to join our team in Bangalore. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. This position offers a hybrid work model, allowing a combination of remote and onsite...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Infometry Full time

    Senior Data Engineer Company: Infometry IncLocation: RemoteRole : Senior data EngineerShift : 2PM-11PMEXP:4-7 yearsNP: ImmediateJob Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Pplability INC Full time

    Job Title: Senior Data Engineer-Data Modeling Location: Bengaluru, Chennai, Hyderabad.Curious about the role? What your typical day would look like? As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION The client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers. The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...