Senior Data Engineer

1 month ago

belgaum, India redBus Full time

redBus.in is India's largest online bus ticketing platform operating across India, SEA & LATAM (Part of GO-MMT group, Nasdaq: MMYT). We have the largest network of bus operators and satisfied customers booking upto 250,000 transactions a day through mobile and desktop channels. With over 300,000+ live routes in multiple continents we host the largest inventory of bus seats from private bus operators and state road transport corporations. We are a true Indian MNC with global presence and operations across India, Singapore, Malaysia, Indonesia, Vietnam, Peru and Colombia. In India, redBus works with 3000 + bus operators with services across 50,000 + routes and a customer base of more than 10 million.


redBus at its heart is about people. As the pioneer in our space, we are passionate about creating amazing experiences for passengers, partners and our people. Energized by a great work environment, where talent is nurtured, innovation is celebrated and challenges are conquered, we journey towards creating fulfilling moments for everyone whose lives we touch. Always striking a balance between getting the job done, while also having fun along the way. So here is to being a Great Place to Work


Key Responsibilities:

Data Infrastructure & Pipeline Development:

  • Design, build, and maintain scalable data and machine learning pipelines to support real-time processing and high-volume data flows. Oversee the entire pipeline lifecycle to ensure efficient data collection, transformation, and integration across platforms.

Pattern Mining & Anomaly Detection:

  • Develop frameworks for pattern mining and anomaly detection within user behavior and transaction data. Continuously monitor and analyze data to identify actionable patterns and anomalies, supporting proactive decision-making.

Workflow Automation:

  • Automate and orchestrate workflows to optimize data movement, transformation, and ML model deployment, ensuring high availability and operational efficiency across data workflows.

Generative AI for Data Insights:

  • Leverage generative AI tools to automate diagnostic summaries, enhance feature engineering, and make data insights accessible to both technical and non-technical users.

ML Model Deployment & Monitoring:

  • Deploy, monitor, and manage machine learning models in production, focusing on performance and accuracy for anomaly detection and pattern recognition. Use monitoring tools to ensure model health and proactively address issues.

Data Warehousing & Real-Time Analytics:

  • Develop and manage robust data warehousing and real-time analytics solutions to support rapid decision-making and effective anomaly detection across the organization.



Educational Qualification:

Bachelor’s or Master’s degree in Computer Science or a related field.


Years of Experience:

3 to 5 years in Big data engineering.


Nature and Scope of Responsibilities:


The ideal candidate will be responsible for developing cutting-edge services for pattern mining and anomaly detection, utilizing billions of user behavior and transaction signals daily. This role involves handling big data, building resilient and stable data engineering pipelines for high-volume processing, and performing data modeling for databases and data warehouses to support scalable solutions. Collaboration with cross-functional teams, including product, business development and engineering, is essential to drive actionable insights and enhance data accessibility. Key responsibilities include automating data workflows, deploying models, and utilizing generative AI tools to enhance data usability for diverse stakeholders.



Must-Have Skills:

  • Expertise in at least two big data and data pipeline technologies, including Apache Kafka, Apache Nifi, and Apache Spark.
  • Strong understanding of data warehousing concepts and database modeling skills , with experience in tools like Apache Iceberg/Hudi and data warehouses like AWS Redshift.
  • Advanced programming skills in Python, Java, and SQL for data engineering and ML workflows.
  • Strong familiarity with AWS cloud services, including RDS, Redshift, Athena, EC2, ECS, Lambda, Glue, and Fargate.
  • Exposure to advanced statistical and machine learning techniques for anomaly detection and pattern recognition.
  • Familiarity with generative AI applications to enhance data insights.



Good-to-Have Skills:

  • Experience in OLAP databases like Apache Druid and ClickHouse.
  • Strong experience with one of the workflow automation and orchestration tools, such as Apache Airflow, Prefect, or Luigi.
  • Knowledge of predictive maintenance for data pipelines.
  • Proficiency in ML lifecycle management and model monitoring using tools such as Amazon SageMaker and MLflow.
  • Knowledge of GCP and Azure services.
  • Knowledge of front-end application development.

  • Data Engineer for Modern Data Platforms

    6 days ago

    Belgaum, Karnataka, India thinkbridge Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines using modern data platforms such as Snowflake, Azure Data Factory (ADF) OR AWS Redshift.The role requires strong problem-solving skills, attention to detail, and experience in...

  • Data Engineers

    1 month ago

    Belgaum, India DenuoSource India Pvt Ltd Full time

    DenuoSource India is looking for the following positions Data Engineers with Healthcare or Insurance Experience Client is one of the leading Insurance Companies in the world Immediate Requirment :Start Date : December Salary : As per Industry Standards POSITIONS VACANT : 12 NOS : Seniior Data Engineers - 8 Nos ...

  • Data Engineer

    1 month ago

    Belgaum, India L&T Technology Services Full time

    About the CompanyWe are looking for a Data Bricks Engineer with Azure cloud experience.Data Engineer (Databricks + Azure Cloud )About the RoleWe are looking for individuals with 5+ years of relevant data engineering hands-on work experience in data ingestion, processing, and exploratory analysis to build solutions that deliver value through data as an asset....

  • Data Insights Specialist

    7 days ago

    Belgaum, Karnataka, India ACL Digital Full time

    Job Title: Data Insights SpecialistACL Digital is seeking a skilled Data Insights Specialist to support our sales teams in conducting extensive research activities and building accurate databases. This role involves utilizing various search engines and databases to identify mid-to-senior-level executives across the globe, with a strong geographic knowledge...

  • Data Engineer

    1 month ago

    Belgaum, India HARMAN India Full time

    Harman India is hiring Data Engineering experts!Job Location: BangaloreExperience: 4years- 8YearsNotice Period- Immediate to 15/20DaysMode: HybridRequired Skill:Bachelor's degree in computer science or related field (Master's preferred) with 4-8 years of overall work experience. 2. Expertise in ETL processes, data warehousing and data pipeline construction...

  • Senior Backend Engineer

    1 month ago

    Belgaum, Karnataka, India Response Informatics Full time

    About the RoleWe are seeking a skilled Senior Backend Engineer to join our team at Response Informatics. The ideal candidate will have strong expertise in backend services programming, with a focus on Python as the primary language.Key ResponsibilitiesDesign, develop, and maintain scalable and efficient backend systems using Python.Collaborate with...

  • Senior Physical Design Engineer

    1 month ago

    Belgaum, India eInfochips (An Arrow Company) Full time

    Job Role: Physical Design Engineer- Senior/LeadLocation: Bangalore, Hyderabad, Noida ,Chennai and AhmedabadExperience Required: 4+ROLE & RESPONSIBILITIESEngineer will be responsible for floor-planning, timing constraints, physical synthesis, formal verification, clock tree optimization, routing, extraction, timing closure, DFT, Antenna fixing &signal...

  • Data Science Expert with Deep Learning Specialization

    1 week ago

    Belgaum, Karnataka, India iitjobs, Inc. Full time

    Greetings and welcome to our exciting opportunity.About the RoleWe are seeking a highly skilled Senior Machine Learning Engineer with Python to join our team. This is a 6-month contract position, offering the chance to work remotely from anywhere in the world.Key ResponsibilitiesAs a Senior Machine Learning Engineer with Python, you will be responsible...

  • Senior Unity Engineer

    3 weeks ago

    Belgaum, Karnataka, India Smart Working Full time

    Unlock Your Career Potential with Smart WorkingWe are seeking an experienced Senior Unity Engineer to join our dynamic team. As a Senior Unity Engineer, you will be responsible for designing and developing high-quality features and bug fixes within our Unity app and connected API.This is a fantastic opportunity to work on cutting-edge projects, collaborate...

  • Data Engineer

    1 week ago

    Belgaum, India hiReign Innoways Full time

    Primary Skills:Proficient in SQL and Python is a Mandate. Familiarity with cloud platforms like AWS, Azure, or GCP is a plus.Excellent communication skills.Location: HYDERABAD OnlyMode: HybridExperience:3 to 7 years of experience in data analysis, data engineering, or related roles. Candidates with a background in leading corporates like Wipro, Infosys,...

  • Data Engineer

    4 weeks ago

    Belgaum, India LTIMindtree Full time

    Overall 5 to 8 years of exp in Data warehousing and extensive hands on experience in SnowflakeStrong holds in writing complex SQL queries and performance tuningHands on experience with Snowflake stored procedure functions tasks and streamsUnderstanding and familiar with different Snowflake features and concepts eg Virtual Warehouse Micropartition zero copy...

  • Senior Systems Engineer

    2 weeks ago

    Belgaum, India ValueLabs Full time

    Job Title: Senior Systems Engineer - Cisco Voice and VideoCompany: ValueLabsLocation: HyderabadJob Type: Full-timeAbout Us:ValueLabs is a leading provider of IT solutions and services, with a strong focus on innovation and customer satisfaction. We are seeking a highly skilled and experienced Senior Systems Engineer to join our team, specializing in Cisco...

  • Senior Process Development Engineer

    3 weeks ago

    Belgaum, Karnataka, India Aequs Full time

    Aequs is seeking a seasoned Senior Process Development Engineer to join our team in Belagavi, Karnataka, India. As a key member of our process engineering function, you will play a crucial role in conceptualizing and developing manufacturable processes that meet agreed specifications within time and budget constraints.About the Role:Develop and implement...

  • Senior Operations Manager

    4 weeks ago

    Belgaum, Karnataka, India Live Connections Full time

    Hiring an experienced Senior Operations Manager for a renowned manufacturing industry in Belagavi (Karnataka).Salary: Up to 50 LPA.Job Overview:The ideal candidate will oversee the organization's ongoing operations and procedures of all three foundries, machine shops, Engine cooling systems, and EHS.Key Responsibilities:• Lead the efficiency of business...

  • Tata Consultancy Services | Azure Data Engineer | belgaum

    4 weeks ago

    belgaum, India Tata Consultancy Services Full time

    Job Description**mandatorySNRequired InformationDetails1Role**Azure DataBricks/Data/Data Factory Enginner2Required Technical Skill Set**AzureDataBricks/ADF EnginnerDesired Experience Range**8-11 yearsLocation of RequirementBangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**Build and maintain the technology platform for both on premise...

  • Senior Design Verification Engineer

    3 months ago

    Belgaum, India Eximietas Design Full time

    Job Overview:Job Title: Design Verification Engineer4+ Years ExperienceLocation - Bangalore, Ahmedabad, Hyderabad, Chennai, BhubaneswarWe are seeking an experienced and highly skilled Senior Design Verification Engineer with a minimum of 4 years of hands-on experience in Design Verification. As a key member of our team, you will play a pivotal role in...

  • Senior Cloud Infrastructure Specialist

    1 week ago

    Belgaum, Karnataka, India Acuity Knowledge Partners Full time

    Job OverviewAt Acuity Knowledge Partners, we seek a seasoned Senior Cloud Infrastructure Specialist to lead our cloud infrastructure initiatives. This is an excellent opportunity to work with a dynamic team and shape the future of our technology landscape.About the RoleWe are looking for a highly skilled and experienced individual to design and implement...

  • Senior Tool Design Engineer

    4 weeks ago

    Belgaum, Karnataka, India Aequs Full time

    About the RoleWe are seeking a highly skilled Senior Tool Design Engineer to join our Manufacturing Excellence team at Aequs. This is an exciting opportunity for a talented professional to design and develop innovative tools and fixtures that will drive efficiency and quality in our manufacturing processes.ResponsibilitiesDesign and develop jigs, fixtures,...

  • Data Analyst

    1 month ago

    Belgaum, India System Soft Technologies Full time

    Job Description – Data AnalystSystem Soft Technologies is a premier technology company providing exceptional consulting services and solutions that drive innovation, enhance business value, and boost competitiveness. For over 25 years, we have built trusted partnerships with our clients, helping us grow into a $200MM+ enterprise. With the collective...

  • Irisidea | Senior Full-stack Developer

    6 days ago

    Belgaum, India Irisidea Full time

    Company DescriptionIrisidea, founded in 2010, is an innovative software products and solutions company that specializes in real-time data streaming, processing, and analytics. With delivery centers in Ontario, Canada, and Bengaluru, India, Irisidea focuses on digital transformation through Data Engineering, AI/ML, IoT, and B2C/B2B eCommerce. The company...